Sounds like a great start. Wheat Cents are very collectable.
There are a number of different coins in circulation that you should be looking for. There are two references that I refer to all the time, "Strike it Rich with Pocket Change" by Ken Potter and Dr. Brian Allen. "Cherrypickers' Guide" by Bill Fivaz & J.T. Stanton.
You should also have the Red Book " A Guide Book of United States Coins" by R.S. Yeoman.
All these could be found at book stores ie. Barnes/Noble or as used books on line.
Used books are the cheaper way to go with the same information.