I have the same issue on my laptop, running Windows 7, and using Steam.
Plain RTW, BI, and Alexander all run in fullscreen, as does RTRPE. I am assuming there's a simple fix I am just not familiar with. A forum search for "fullscreen" only returned this post, so if this has already been covered, my apologies!