Using the ingame host button stuff, so no dedicated server stuff.

We both have powerfull computers, both of us have good connections (we have no jitter/rubberbanding bs in any other game), max ping if things are bad is 50, but more often it's 5-15.
This is unmodded.

Both of us suffer from this, if ...