I pulled them off for a long time but always hated the little nubbins doing that left (yes there’s ways to deal with it but that can induce rust spots). Now I grind the welds with the cut-off wheel on my dremel, if you’re careful and go slow you can get it cut just perfectly down to the actual battery can and the tab easily and cleanly falls away leaving a smooth terminal.