Honestly, don't start a Wheat cent collection and then start complaining that your individual coins have little value. 
I actually don't see a problem here. I collect a few type sets myself simultaneously, I have a few coins in larger quantities, I have tons of coins that don't make sense when brought together, at least according to some people, and I'm very happy with my collection. Because it's my collection and I defined it as my collection. So all I put in my collection fits perfectly in my collection, because I decided it does. To me it actually adds charm to have some 'weird' coins in my collection.
I think you take this 'doesn't fit with my collection' thing a bit too serious or you really are a purist. To me, having quarters and dimes and nickels and cents makes perfect sense, as it's all 'Murican coins. Use them as conversation pieces or as added context for your other coins. If you really want to narrow it down and are 1000% sure that you never will start collecting some of those types and if they're seriously bothering you, then try to sell them or trade them for some coins you actually value. My personal experience, however, is that 'regret' shows up at your door at some point and refuses to leave your house afterwards. Usually he's accompanied by 'growing insight' or 'change of view'.
And don't worry too much about not having done it 'right' the first time. The nice thing about this long term hobby is that we all keep on learning and growing into it. And that you can easily replace any piece with a better fitting piece, without having to take the rest apart first. I made a lot of mistakes and probably still make, according to my future self, when starting mine.
I actually don't see a problem here. I collect a few type sets myself simultaneously, I have a few coins in larger quantities, I have tons of coins that don't make sense when brought together, at least according to some people, and I'm very happy with my collection. Because it's my collection and I defined it as my collection. So all I put in my collection fits perfectly in my collection, because I decided it does. To me it actually adds charm to have some 'weird' coins in my collection.
I think you take this 'doesn't fit with my collection' thing a bit too serious or you really are a purist. To me, having quarters and dimes and nickels and cents makes perfect sense, as it's all 'Murican coins. Use them as conversation pieces or as added context for your other coins. If you really want to narrow it down and are 1000% sure that you never will start collecting some of those types and if they're seriously bothering you, then try to sell them or trade them for some coins you actually value. My personal experience, however, is that 'regret' shows up at your door at some point and refuses to leave your house afterwards. Usually he's accompanied by 'growing insight' or 'change of view'.
And don't worry too much about not having done it 'right' the first time. The nice thing about this long term hobby is that we all keep on learning and growing into it. And that you can easily replace any piece with a better fitting piece, without having to take the rest apart first. I made a lot of mistakes and probably still make, according to my future self, when starting mine.



















