I still remember when Phantasmal Berserker was changed people though it was a buff because 300 damage increase of the throw. =)
In reality it was, like you said, a nerf to prevent remaining in stealth while the phantasm was attacking.
I agree with you.
That being said:
All phantasms are trash, some of them were pretty awesome before the "buff".