Stars-922 may be a nice option: https://www.ebay.com/itm/HY410-STARS-922-Thermal-Compound-Sink-Silicone-CGPU-Silikon-Grease-Glue/163170389586

Takes a little while to harden, it depends on volume to area ratio. No volumetric shift. Once hardened remains slightly fexible but has adequate stiffness. I used this compound to stick an Omten 1288 inside an SK98 pogo switch retaining part whose slot is for bigger switches, like this one: http://kaidomain.com/S024498-DIY-LED-Flashlight-Reverse-Clicky-Switch-14_8mm-x-9_6mm-for-LED-Flashlight. After hardening took the pogo retainer out of my vise and could easily sand down the protruding plaster excesses. Worked like a charm.

Can be removed later with a bit of patience and some spirits help: alcohol, white spirit, gasoline, etc.

Worth a try imho.

Cheers :-)