I am having the same problem. Once I assign a quickbar space to something, it is not possible to reassign it or de-assign it.

*Edit: It's possible to de-assign with the middle wheel button.