Already, several European nations have fertility rates even more modest than Japan's (though they still have a lower ratio of elderly, due to shorter life spans).
In his fiction, the ratio of smart to stupid is far more advantageous than it is in real life, but this is a minor complaint, gladly passed over for the pleasure of reading pages of implausibly brilliant speech.