Played a battle and archers weren't shooting arrows so I ran setup again, checked "permanent arrows", started a new game and now everything seems to be working fine.