Not necessarily. For example, if most of society's wealth is concentrated with a few people, and the rest can get crumbs from that table only by serving the wealthy, then a situation where something is delivered with fewer people at lower cost translates to more people starving because they are no longer economically useful.
That is not, however, what is happening. The Western world is facing a crisis where young people seem to be barely be able to find a place to live and have trouble finding a job, and are constantly being told that entry-level jobs for them will be replaced by automation or AI.
Little is being done to give them assurances they will be able to provide for themselves.
You’re right about the main benefit of population decline though. It gives Nature a needed break