Thank you very much Hornwitser! You pointed me into the right direction.
I am hosting the game on a Hyper-V server and KB5015807 must have broken something in the network stack. After uninstalling the update everything works again! Reinstalling it reintroduces the issue. Can I mark the this topic ...