When you start pushing 300 milliseconds, and have some jitter, then the latency will go up. If you open up the multiplayer debug information it can show you UPS/fps, multiplayer buffers
On Factorio no. Keep in mind that factorio saves can get pretty large, so make sure to have the bandwidth to allow you to properly sync during connect.