You could try the Zebralight SC53w (330 lumens, $57), or the Zebralight SC52 (300 lumens, $49). You won’t find a more pocket-friendly AA light unless you go to a twist-on switch. The advantage of the SC52 is that it can also use a 14500 for 500 lumen output. I don’t usually run mine that way, but it’s fun when I do.

No. There’s not much demand for newer NiMH tech nowadays, so I don’t think they’re doing much to improve it. There’s small incremental improvements with Eneloop over the past several years, but nothing significant. Just like you don’t see much improvement with alkaline batteries… they’re good-enough for their intended purpose (which is ruining electronics by leaking).