I agree, this is not a mint state coin. The dent around the mint mark does look odd. There is a premium for the San Francisco coin in grades of AU and above, so there is an incentive for an added mint mark alteration.
You definitely made the right call by passing on this coin. How about posting some photos of the one you did purchase?