This seems like a perfectly reasonable experiment and not something they’re going to release without extensive human and security review.

Oauth libraries aren’t new and A.I. can probably generate adequate code. My main problem with A.I. for this purpose is that senior developers/experts don’t pop out of thin air. You need junior developers now if you want any real experts in the future. Maybe you need fewer and more specialized training. Maybe the goal is to offload the training cost to Universities and tech companies only want PhDs. Maybe someday LLMs will be good enough to not need much supervision. But that’s not where we are.

We probably need a Level x capability scale like self-driving cars for this sort of thing.

Agreed. It creates a new normal for what the engineer needs to actually know. In another comment I claimed that the same was true at the advent of stack overflow

Looking through the commit history there are numerous "Manually fixed..." commits, where the LLM doesn't do what the programmer wants after repeated prompting, so they fix it themself.

And here is the problem. It required expert supervision for the prompts to be repeatedly refined, and the code manually fixed, until the code was correct. This doesn't save any labour, it just changes the nature of programming into code review.

If this programmer wasn't already an expert in this problem domain then I have no doubt that this component would be full of bugs and security issues.

If you read the commentary on the process you notice heavy reliance on experts in the field to ensure the code is good and secure. Claude is great at pumping out code, but it can really get confused and forget/omit earlier work, for example.

I think the notion of junior developers disappearing because of AI is false. These tools accelerate productivity, they don't replace human experience.

I think this take undervalues the AI. I think we self select for high quality code and high quality engineers

But many of us would absolutely gawk at something like Dieselgate. That is real code running in production on safety critical machinery.

I'm basically convinced that Claude would have done better

Dieselgate wasn't a "bug" it was an designed in feature to circumvent emissions. Claude absolutely would have done the same, since it's exactly what the designers would have asked it for.
Somehow I doubt it would have gone undetected as long if Claude wrote it tho, it'd probably mess it up some other way.

I hear you, and there’s merit to the concerns. My counter is

1. The same was true at the Advent of books, the Internet, and stack overflow
2. It’s Luddite to refuse progress and tools based on an argument about long term societal impact. The reality is that capitalism will choose the path of least resistance

I don’t know anything about you, obviously, but I suspect you should to take a more nuanced, historical view of Luddites. Writing someone off as a “Luddite” probably isn’t the burn you think it is.

I’m all for technological progress. Who isn’t? It’s the politics and ownership that causes issues.

1. I'm not really interested in trying to burn anyone and despite my nuanced understanding of the Luddites, I do think dismissing a Luddite take in the context of technological progress is legitimate
2. I care about ethics and governance too but I live in a capitalist society and I'm here to discuss the merits of a technology

Agreed, and yet the AI accelerated the project