Try low capacity NiMH cells, they are more robust than high capacity cells when being dumb charged and discharged by these solar lights. Plus, they’re cheaper!

A good example would be the Tan coloured low capacity Ladda cells that Ikea sells, which are equivalent to “eneloop Lite” cells.