They were doing their own business, why didn't you just ignore them and move on to another target?
I know some will say WvW is a competitive mode and everything is valid but there is something called "**etiquette**", if you see 2 enemies fight in a duel, you let them be. I would be pissed too if I were trying to play with my friends and someone else butt in.