I get consistent 59-60 FPS/UPS playing on a dedicated server, until i tab out.

After that FPS will reduce to around 10-20 while the UPS stay stable at 60. This will not recover upon reselecting the window. GPU CPU and network traffic seems normal and if i rejoin the server the issue FPS stabilizes ...