I am in the "keep track" crowd. I really can't afford not to keep track and it helps keep goals in-line.
I'm currently at $24.11 cost average.
The most I have paid over spot was $502.60/oz for a SMALL rare coin, the lowest I have paid was $11.41/oz for a much larger sterling item. (excludes trades and gifts)