Going backwards in time, they had metal and brass containers, before that they had wooden buckets and barrels, ceramic pots, carved out animal parts or fruit of plants.

Before farming, probably a good portion of the water early people subsisted on was from the food they ate. (Berries and fruit, fish, meat, etc.) Water might pool around rocky areas after rain, even if there was no stream nearby in a pinch.