Was early man really predominantly a cave dweller?

I can't imagine there were enough cave space to go around to support the early human populations. So do we think of early man as a cave dweller only because this is where we find undisturbed remains of him, while the majority of early man lived in the trees or shelters built in the ground - like most modern day hunter gatherers? Was early man mainly based in one place or was he more like the seasonal animal herders who would move according to the season and where the hunting or harvesting happened to be good, and then might take advantage of a cave if it happened to be on his route.