Well, yes, you would. Unless you joined them or bowed to them. Again, same as all the other guilds I´ve listed.
Anyway, I´ve made my point. In the end it´s more about the definition of griefing. You are basically using "their" definition which they used to vilify others and paint themselves in...