Outside of very serious discussions I don't have a problem with them. If, though, we're discussing something very serious like war, genocide, etc., it's ultimately damaging to the conversation to let it drift.
Giant Hamburger brings up another good point. Rabbits are scary.
