I think the crux of the issue here is that an action film these days is a very different animal to an action film made a quarter of a century ago.
Perhaps something like For Your Eyes Only does have twice as much action as Casino Royale. But the action in that film is relatively light, compared to the high-octane, in-yer-face, action we're seeing nowadays (with an accompanying soundtrack blasting out at ten million decibels). As a result, the action in something like Casino Royale feels a lot more overpowering than the type of action we saw in the older films. Even if there is less of it. Doubling that type of action could be too much. Which is obviously what's concerning some people.
Completely, 100% agreed.