Did you use the clip in conjunction with the headband?

That makes it more stable.