I'm also largely skeptical of the claim that Google is going to completely drop the ball here, but this is classic Innovator's Dilemma - sometimes a business can't effectively segment their existing customers enough to introduce a higher initial cost but ultimately better technology.
I think a Google Search Premium that cost $50/month would go over pretty poorly with Google's existing customer base (advertisers), but a startup can experiment with the business model with the right early adopters (e.g. Neeva).
Is the exact definition important? The point is, they developed a thing and integrated into their core product. BERT allows them to handle conversational queries much better than before.
I think it does, because LLMs allow things that LMs like BERT don't - like answering complex question on their own etc which is being discussed in the context of this thread.
I think a Google Search Premium that cost $50/month would go over pretty poorly with Google's existing customer base (advertisers), but a startup can experiment with the business model with the right early adopters (e.g. Neeva).