[1.1.101] Latency pinned at 254 when connected via steam invite

[D4vid]

What did you do?
I connected to my friend's server via a steam invite.

What happened?
Buffer is at like 0/0/1 or 1/0/0, jumps is 0, but latency is constantly pinned at 254 ticks.
The game is quite unplayable and also quite epileptic, see the attached videos.

What did you expect to happen instead? It might be obvious to you, but do it anyway!
The game should be perfectly playable.

Does it happen always, once, or sometimes?
I joined the server again the next day using the Continue button in the main menu and it was the same.

If you can reproduce the issue provide the exact steps!
Have player A host the game, have player B connect to the server, have player B send player C a steam invite. Player C connects to the server via this invite and has 254 ticks latency.

The solution was to join the game via the server browser and not via a steam invite. Then I had latency of 4 ticks.