I see the general point, it’s just the perforce absolutism of it that I don’t get.

For example, if what you say is true and as long as a large population survives, all its genes necessarily do to, then shouldn’t there be people somewhere in some numbers that exhibit every trait in every one of our evolutionary ancestors? Even in your own examples you only go up to one in a billion, but odds do actually go lower than that.