you need to have army in reinforcement range. Only case when it wont work is when you dont have garrison in the city yet. In that case, you need to keep army in the city, until you can finish the barracks that give you garrison units in city that is not yet converted to your culture.