A screenshot says it all:
The ghost underground exit causes the actual belt to go straight. Without the ghost it makes a curve as expected. Placing the ghost will again straighten the belt.
[16.0] Ghost belts influence direction of actual belts
Re: [0.16] Ghost belts influence direction of actual belts
Pretty sure that is a feature.