Almost all new coin collectors ask those questions. Somewhere there should be a permanent post where everyone can add their 2 CENTS on how to store, collect, etc.
My advise is to first get familiar with the different coins you many be interested in. Find out if there are any coin shows, coin stores, hobby stores that carry coins in your area. Go there with the intent of learning, not buying until you know what you want. Never get stuck in the rut of investing, only keep it as a hobby. That way it will always be fun regardless of what it costs. Look for those 2x2 flips. By the way they also come in 1 1/2 x 1 1/2 inch sizes which if you go to a coin show you'll notice most dealers have gone to those. (Cheapskates). Just kidding. They fit in their display cases better.
Now here is what I suggest as a starter. Go to a bank and buy a $50 bag of cents (pennies) and look through them for different dates, mint marks and errors. You may want to check out the coppercoins.com web site. You can do the same with nickels, dimes, etc. Then return the ones you don't want to another bank. Most banks don't like people that take them out and only to return them.
Great hobby, have fun and never take it to seriously.