I tried this with a Pixel 5. Performance was much better than expected! Even big apps like Intellij were usable for small projects.
But the big downfall was memory management. It is really easy to get too close to running out of RAM and have the whole environment spontaneously killed.
You probably need to look into disabling the Android phantom process killer. I had a similar issue and could not get DEs such as XFCE running for a long time and after the fix it was smooth sailing.
I think that is what I did. I had pretty good stability for some things, but I was really pushing the limits by trying to run Intellij. I could get some Java code to compile and run, but it would always terminate eventually.
Of course, the Pixel 5 only has 8GB of RAM total. It might be a different story on the 7 pro or s23 ultra.
But the big downfall was memory management. It is really easy to get too close to running out of RAM and have the whole environment spontaneously killed.