Kings chiefing protected governors

  • Something strange seems to have happened, though it may be normal, I don't feel that it is fair..

    The TL;DR of it is:
    I am a king, and there are 2 governors who have villages within my kingdom's borders.
    Although I have never offered them protection they for some reason were "covered" by my area of influence.
    They start attacking me so I try to chief one village but I get a message that "They were part of my kingdom and must wait 3 days" even though I got no tribute and they belong to an enemy king.
    However it they want to, they can freely chief MY villages without waiting.

    Why is it that I have to wait 3 days to chief they, but they can chief me RIGHT NOW!?

    not really fair is it?