In a bit of a personal journey I experienced something similar. I was trying to get into collecting the classic 1892-1954 commemorative halves. I started getting stressed out about the size of the collection and the prices of many of the examples (here's looking at you Hawaii, Spanish Trail, Hudson) and realized that I don't even really care for some of the expensive ones, like Spanish Trail especially. Knowing how much I would eventually have to invest into the set just to complete it in any condition and knowing that there are lots of designs I don't even much care for that would still run me $100-$200 a piece was really weighing on me.
I decided to adapt my 7070 to include 8 classic commems, and added a second of the bicentennial page to include the Isabella, Columbus, and Lafayette where the bicentennials normally go. For me, this means I can just focus on 1 album, my 7070, even though it isn't a pure Dansco 7070 anymore. Now, collecting just 8 classic commems plus the OGs means that I can collect just the ones I want and I can much more easily justify $1000-$2000 on the 11 coins I like, instead of $10000+ on 55 that I don't like all of. Like you say, I felt a bit distracted trying to put money into a 7070 and a 7094 (classic commem album) at the same time.