Anyone have any experience playing over Steam Link on wifi?

It seems like no matter what I do, the performance is really shitty. Both the host and the client are in line of sight of the router, and I can get 500+ mbps and my latency seems good, but the performance is garbage. As soon as I go wired, I can get great performance at 100mbps or less.

Is there a good way to mitigate this? Am I doing something wrong?