At least on a PvE server, they should not attack you if you don't initiate combat. They are marked red, to indicate they're hostile, but they don't actually attack. I've danced around in front of them to test this. (There are a few quest NPCs that work this way too.) However -- there's still a known problem related to pets, both Warlock and Hunter, where they will sometimes, for a reason I've not been able to figure out, either aggro on your pet or your pet aggros on them (even if in passive mode, so I think it's the first). So, if you're in a bifactional area like Booty Bay, put away your pets. (Totems may count too. I haven't tried them.)
One day, the Champions of the Fierce Bunny will ride again...<!--sizec--><!--/sizec-->