I mean ChatGPT can't do it but humans can and are... Why do you think Microsoft / Apple / Google are all introducing NPU / AI coprocessing chips?
The new ARM powered surface laptops that consume like 30W of power are more capable of running an AI model than my gaming PC from 2 years ago that consumes ~300W of power.
Cars collectively emit far more carbon than ChatGPT, and ChatGPT is only going to get more optimized from here.
Ultimately the answer should be in a heavy carbon tax, rather than having a divine ruler try and pick and choose where it's worth it to spend carbon.