Both kinds are available: those that keep voltage at 1.2 volt, and those that link the cells up in series, making them 3.6 volt.
But if the OP is talking about an AA to D adapter, then it would need to remain at 1.2V.