[2.0.23] Surface switching misbehavior while in pause

[Amegatron]

Steps to reproduce:

1. In remote-view, pause the game (Pause button by default)
2. Press up or down key (default binding) which should cycle through surfaces shown on the top-left side of the screen.
3. Unpause the game

Expected behavior

Either:
1. Surface is not switched, because the game was paused
Or
2. Surface is switched even while in pause, but player can clearly see it while the game is paused

Actual behavior

1. Surface is switched "under the hood", and after unpausing the game, you see the surface you switched to.
2. Also, sometimes there is a special case when you can switch to solar map - you can see it switched while in pause, and then you can again switch to the next surface, still seeing the result. But it only works one time, and I can't consistently reproduce this particular case.

[Theragus]

can reproduce this behavior, although this one is pretty janky when reproducing...

When pausing in remote view, sometimes the up/down arrow works to switch the surface and sometimes they don't.
Sometimes you can only go 2 surfaces down, while sometimes you can only go 2 up and sometimes you can go only 1 up or down...
Pretty weird actually...

I think there is some index messing up which surface you're viewing in pause versus when the game is unpaused