Did some more LLM-assisted coding on a personal project over the weekend. Blew through SO MANY credits working on an old iOS app I never finished, and a website for it. I basically spent my monthly quota in two days, which is wildly unsustainable.
The thing that keeps getting me, though, is how inconsistent and unreliable the outputs are. Sometimes the LLM absolutely nails it. It implements clean, simple code that does the job. In other cases, it totally biffs what I assume will be a simple task, or confidently insists that failing tests are a test framework problem, not an issue with the implementation. (Spoiler: it’s almost never the test framework.)
I keep wanting it to work, and sometimes it does, but the number of times where it doesn’t… that really breaks the immersion in the shared fantasy that this is “intelligent.” And given the cost to get outputs that are sub-par… that’s frustrating.