You need a balanced RC charger, which support 4S Li-Ion.

I did the same with two cordless drill.
—> Be aware that after the rebuild, the drill will fall over easly, because the batteries are lighter!