Update: It seems to actually be a connection issue of some sort, the other night I was juts playing with one of them while hosting and when one of the lockups happened I just waited for my friend to quit to see what would happen and I was able to continue playing and he was able to rejoin for a time ...

My friends and I now have a problem in our 5 hour+ game in which at around roughly 10 mins in it will just lockup for all of us (can still use the menu and see the world but can't do anything in the game), anyone have any idea what could be causing this?