DH had a convention there a few years back and we only had a few free hours each day. We went to the parks for one day (at the beginning) out of the 6 we were there.
I spent alot of my time going to the other resorts via buses and lazing about the resort. We also in the evenings, went to resort restaurants and walked around the grounds. I don't think it would be much different than if you went just to the waterparks.
I've stayed at POP and FQ and would have no problem spending the day amusing myself at FQ, but I don't think I could have at POP.
So maybe a compromise is to stay at a mod and then plan to things at the resorts like horseback riding, Wilderness segway tour, Hoop De Doo, etc. You could still even go and watch the fireworks from the Poly or one of the boat tours.
Personally, I couldn't get that close to a Dolewhip and not get in to get one!

Though, I have heard rumors that you can get them at Poly . . . .
Good Luck with your Trip!