To sell your junk silver for any CC gold coin is a very smart move, I would do it. Gold spot prices have very little effect on the numismatic value of rare date / mint gold coins and such coins will always hold their value if or when gold takes a dive.
Many years ago I had paid about $450- $500 each for a couple of $5.00 Liberty gold coins, one from Charlotte and one from Dahlonega and sold them for something or other I don't even remember what now. Those prices were more than double a common date at the time. They were in VF condition and the prices are more than three times that now. Compare that to what a common date $5.00 Liberty will cost now.