Just get a dc-dc voltage power supply?
There are plenty of cheap buck/boost ones.
Just keep in mind that most batteries should not be charged by just connecting them to a power supply, they require monitoring and regulation, not just constant voltage.