Nah. Once you get a few settlements you are at critical mass for not really being able to lose. Doing this is actually a bit easier with Saka as they have horse archers. It might seem scary to have such low income and be losing quite a lot per turn at the start of the game if you're used to playing factions which are more established at the start. You can use their raiding mechanic to offset but personally I never bothered, just grabbed a couple of settlements.
i found it quite fun as Saka if you stay nomad for a long time and go for the steppe. Just one way to play them.