They are going to add more abilities onto the system, for example, toolformers or goal planning (like the recent Q* stuff at OpenAI people are talking about). This will make the overall product very powerful.

But even if you’re looking just at the LLM it seems like there’s a lot of ways it can be improved still.