I did poke around a bit more and found that I didn't have the direct mode on, so it was hopping around. Switching that on and doing a direct connection made it much better, like 50Mbps. But that's still only 25%-ish of the regular speed, whereas I thought it'd be about 50%. But way better than like 2% of the original speed lol.
