There’s a UK based company called ALPKIT (ALPKIT.co.uk) who do CR2023 powered lights to go on straps/headbands called the Blip. £6 for 2.
Edit-whoops, I think these come in red only.
Alternatively, try an AAA glotoob, there were AA clones around a few years ago by a Chinese company called EDCgear.