tellicoriver,
What you propose is normally the way things work. less competition between bucks (especially older bucks) for breeding rights reduces daylight rutting activity. But this year, even some areas with exceptional buck competition levels saw no obvious daylight rutting activity.
On my place, 1 out of every 4 antlered bucks is 3 1/2+ (1 out of 10 are mature), and our adult sex ratio has been around 0.6 does per buck (yes, far more bucks than does) for almost six years running. THAT is a lot of buck competition! And normally we see a lot of rutting sign and rutting behavior (pestering and tending chases). But this year, virtually nothing, other than some heavy early scraping.