I don't honestly think yearly CoDs are killing it off. MW, MW2, and now Black Ops have each been bigger than the last. The only black sheep was WaW, which had a WW2 setting.
However, when Activision finally starts rolling out all of it's spinoffs and subscription models, it will begin to decline.