Could be because life was better in the (relatively) short term, but ended up worse overall. Maybe it also seemed better than it actually was. Evolution had prepared us to see and fear the hazards of hunter-gatherer lifestyle (such as hunger), but not of agricultural lifestyle (such as eventual disease).