Like some double faced tape behind it or create a circle of tape and use that
Make sure it is archival tape. Gum on conventional tape turns gummy or yellows.
Bought a stamp collection where they used mounts, but put a tiny bit of tape on the sides to keep them from sliding out. Tape went bad and stained the stamps through the mounts, making them uncollectable, but otherwise brand new.