Can someone who understands this better explain to me how this thing actually places the order into whatever POS they use? Like if LLMs are just advanced auto-complete, I get how they can do "fuzzy" tasks like answering questions or carrying on a conversation, but how do they do rigid tasks like entering the tacos into whatever system the cash register and kitchen use?

The LLM isn't limited to just what it does. It can interact with other programs.

There are a ton of audio recognition systems available, almost all of them predate this LLM bubble. There's already an API for interacting with the ordering system. So it's just down to having the LLM pull what is then do that corresponding action for the order.

This is so simple it doesn't require anything nearly as complicated as an LLM. The old phone assistants like Siri and Alexa could do this type of thing. It's literally the same as telling Alexa to place an order for something, and that's been an ability for years.

The LLM isn't limited to just what it does. It can interact with other programs.

There are a ton of audio recognition systems available, almost all of them predate this LLM bubble. There's already an API for interacting with the ordering system. So it's just down to having the LLM pull what is then do that corresponding action for the order.

This is so simple it doesn't require anything nearly as complicated as an LLM. The old phone assistants like Siri and Alexa could do this type of thing. It's literally the same as telling Alexa to place an order for something, and that's been an ability for years.

So the output from the LLM is just a text description that's fed into another, smarter piece of software that interprets that text into an order? What task is the LLM actually doing in this case?

“Sometimes it lets me down, but sometimes it really surprises me," he said.

That’s what I want from a drive through. To be surprised or let down.

In a fair world, we would be celebrating our machine labor achievement and enjoy our free time. Instead we have capitalism and virtual luddites shouting to protect menial labor.

Humanity.. sigh

Can someone who understands this better explain to me how this thing actually places the order into whatever POS they use? Like if LLMs are just advanced auto-complete, I get how they can do "fuzzy" tasks like answering questions or carrying on a conversation, but how do they do rigid tasks like entering the tacos into whatever system the cash register and kitchen use?

So the output from the LLM is just a text description that's fed into another, smarter piece of software that interprets that text into an order? What task is the LLM actually doing in this case?

The luddites didn't hate machines because they loved manual labor...

They wanted to ensure that mechanization benefited the workers via less hours and increased wages rather than the same wages and less jobs to go around.

Destroying mechanization was just an accomplishable goal in that fight.

What you're doing is falling for propaganda from a long ass time ago by the owner class...

The luddites didn't hate machines because they loved manual labor...

They wanted to ensure that mechanization benefited the workers via less hours and increased wages rather than the same wages and less jobs to go around.

Destroying mechanization was just an accomplishable goal in that fight.

What you're doing is falling for propaganda from a long ass time ago by the owner class...

same wages and less jobs to go around

If we're lucky. It's more likely to be lower wages. "We don't need to pay experienced programmers anymore, they aren't writing the code after all. We just need cheaper, less skilled people to review the code that is already 99% fine".

Not about the tech, it's about who is going to use the tech to make life worse for the working class.

“AI will took ur jerb!”

AI: cant even hack it at Taco Bell or McDonalds

I mean to be fair... that's the current drive through experience anyway isn't it?

Its just an API.

There's a few ways they could go about it. They could have part of the prompt be something like "when the customer is done taking their order, create a JSON file with the order contents" and set up a dumb register essentially that looks for those files and adds that order like a standard POS would.

They could spell out a tutorial in the prompt, "to order a number 6 meal, type "system.order.meal(6)" calling the same functions that a POS system would, and have that output right to a terminal.

They could have their POS system be open on an internal screen, and have a model that can process images, and have it specify a coordinate pair, to simulate a touch screen, and make it manually enter an order that way as an employee would.

There's lots of ways to hook up the AI, and it's not actually that different from hooking up a normal POS system in the first place, although just because one method does allow an AI to interact doesn't mean it'll go about it correctly.

LLMs, with a little coaxing, perform well at returning well formed JSON.