I don’t understand how it evolved to be made in that form factor, and why it is still being done that way.

Probably for being easier, cheaper and faster to produce in printing press machines. If you made the sheets smaller, you’d end needing to make much more cuts and it would also be harder to hold many smaller sheets together without some sort of binding