Today at work I tried to give those hyped AIs a shot.
I gave #Copilot a task I thought should be easy for an #LLM: Take a file with 3500 translations and provide matching suggestions for the 100 missing ones. It did an OK job for German. It failed miserably for Traditional Chinese.
It kept bugging me with followup questions, like how it should handle strings containing just spaces (there were none). It started responding in Chinese. It sent me a file where all the translations were filled as "[TRANSLATION_NEEDED]". It sent me a file where all translations were copied from English. It kept rambling about Python resource limits and sent me the result in small chunks.
I gave up after 20 minutes of back and forth. It was like the most stupid intern ever.