I rather approach it from a Cartesian perspective. A context window is just that, it's not "existence". And because they do not exist in the world the same way as a human does, they do not think in the same way a human does (reversal of "I think therefore I am")
An LLM doesn't have a valid concept of "I" because the data and algorithm it comprises could be run deterministically on any hardware, even multiple times, held in storage, rewound, edited and so on. There is no unique subject, there is no "I". The "life" or "soul" or "session ID" when that sentence is generated, is not known by itself to be unique.
> because the data and algorithm it comprises could be run deterministically on any hardware, even multiple times, held in storage, rewound, edited and so on.
Quite the assumption you're making that the same thing does not apply to humans. Not having the technology is not the same thing as not being possible.
