> 10,000 round trips by car between Los Angeles and New York City.
That seems like very low impact, especially considering training only happens once. I have to imagine that the ongoing cost of inference is the real energy sink.
It doesn't happen only once. It happened once, for one version of one model, but every model (and there are others much larger) has its own cost and that cost is repeated with each version as models are continuously being retrained
That seems like very low impact, especially considering training only happens once. I have to imagine that the ongoing cost of inference is the real energy sink.