to stopp an adventurer invasion, invite him to your court and the invasion will never happen. he will not allways accept, depending on culture and religion, but a wife might if she likes you and he will follow.
you can also support an adventurer that is launching his invasion from your court or is of your kin.