I'd say there are three things I'd keep in mind: 1) value of the coins in question, 2) how likely you'd be to come across the coin you're looking for again at that price, and 3) how likely you'd be to replace the coins you're trading if you decide to collect them again.
1) It probably doesn't make much sense to trade higher value coins for a lower value one, unless you are absolutely convinced it's a rare coin whose market will take off in the next few years.
2) Will you be able to come across that coin again in the near future, or is it indeed a rare find? If you are likely to encounter it again, perhaps you could hold off. If not, then it might very well be worth the trade, assuming again that you're not really losing much, or any, money on that swap.
3) If the coins you're considering trading are ones you can easily acquire again, and the coin you're looking to acquire is not, then assuming the value is similar, I'd absolutely make that trade.