Like I said before luring from ambush position so you can attack him is one thing, to trap him using a fort is another. I received answers from 5 of the players who ALL said that it's unfair, so it is not my decision alone. Rules can be added mid-game, I've seen it happen many times before. You are not losing anything, but you will not gain anything either. This is the most fair thing to do, neither side is being punished so play on.
Spoiler Alert, click show to read: