Hmmm... that shouldn't be too much of an issue though right? It does make sense! I quite like the fact that you must have men near the towers in order to have them "garrisoned"...
Besides I thought I saw a couple of slots in your Carn Dum gate already? Unless those are just for show?
Awesome work btw!