The things you do with your hands in normal conversation are “distracted habits.” The problem is that, in your speech, they become “distracting habits.”