thank you everyone. So, there isn't much tape residue that I can feel or see under magnification; slightly grainy to touch . . . @captain makes a good point which I considered...you don't see yellow tone on these very often.
@captain, yeah. From the market where I bought it hope, I had a quick look . . . turned out my initial post was wrong; nearly all tape residue. I didn't pay much . . . and Peace dollars with a tape stained X are rarer than ones without :)
anytime you have residue like that its a tough call. the coin would detail either way. if you remove it then your can see the results. you have no way of knowing whats underneath but the coin is better without the tape on it over the long term. maybe a heavy pocket piece will help dull those areas and even it out.