why don't they program them

AI models aren't programmed traditionally. They're generated by machine learning. Essentially the model is given test prompts and then given a rating on its answer. The model's calculations will be adjusted so that its answer to the test prompt will be closer to the expected answer. You repeat this a few billion times with a few billion prompts and you will have generated a model that scores very high on all test prompts.

Then someone asks it how many R's are in strawberry and it gets the wrong answer. The only way to fix this is to add that as a test prompt and redo the machine learning process which takes an enormous amount of time and computational power each time it's done, only for people to once again quickly find some kind of prompt it doesn't answer well.

There are already AI models that play chess incredibly well. Using machine learning to solve a complexe problem isn't the issue. It's trying to get one model to be good at absolutely everything.

Regurgitating an impression of, not regurgitating verbatim, that's the problem here.

Chess is 100% deterministic, so it falls flat.

I don't understand why this is so important, marketing is all about exaggerating, why expect something different here.

no.

the answer is always, no.

Can ChatGPT actually play chess now? Last I checked, it couldn't remember more than 5 moves of history so it wouldn't be able to see the true board state and would make illegal moves, take it's own pieces, materialize pieces out of thin air, etc.

ChatGPT must adhere honorably to the rules that its making up on the spot. Thats Dallas

They are starting to do this. Most new models support function calling and can generate code to come up with math answers etc

Do they though? No one I talked to, not my coworkers that use it for work, not my friends, not my 72 year old mother think they are sentient.

From a technology standpoint, nothing is stopping them. From a business standpoint: hubris.

To put time and effort into creating traditional logic based algorithms to compensate for this generic math model would be to admit what mathematicians and scientists have known for centuries. That models are good at finding patterns but they do not explain why a relationship exists (if it exists at all). The technology is fundamentally flawed for the use cases that OpenAI is trying to claim it can be used in, and programming around it would be to acknowledge that.

Yeah its like judging how great a fish is at climbing a tree. But it does show that it's not real intelligence or reasoning

ChatGPT has been, hands down, the worst AI coding assistant I've ever used.

It regularly suggests code that doesn't compile or isn't even for the language.

It generally suggests AC of code that is just a copy of the lines I just wrote.

Sometimes it likes to suggest setting the same property like 5 times.

It is absolute garbage and I do not recommend it to anyone.

The answer might be no today, but always seems like a stretch.

It's not important. You said AI isn't being marketed to be able to do everything. I said yes it is. That's it.

I find it really hit and miss. Easy, standard operations are fine but if you have an issue with code you wrote and ask it to fix it, you can forget it

Google Maps doesn't pretend to be good at chess. ChatGPT does.

I'm guessing it's not even hard to get it to "confidently" violate the rules.

I've found Claude 3.7 and 4.0 and sometimes Gemini variants still leagues better than ChatGPT/Copilot.

Still not perfect, but night and day difference.

I feel like ChatGPT didn't focus on coding and instead focused on mainstream, but I am not an expert.

Don't call my fish stupid.

A toddler can pretend to be good at chess but anybody with reasonable expectations knows that they are not.

I don't use it for coding. I use it sparingly really, but want to learn to use it more efficiently. Are there any areas in which you think it excels? Are there others that you'd recommend instead?