BLF Ti: Update the switch

Can I removed the white plastic piece without breaking it or is it glued?

Is there a way to use the current aluminium switch pill but just replacing the switch and spring?

I managed to come with a fix for the rough switch travel and getting stuck issue: