What is it with vegans and comparing literally everything to veganism? I was in another thread and it was compared to genocide, rape, and climate change all in the same thread. Insanity

is there any picture of the guy without his hand up like that?

Because the AI industry is a bubble that exists to sell more GPUs and drive fossil fuel demand

Because, uhhh, whoa what's that? ducks behind the podium

Do they do earnings calls? They’re not public.

I mean, they're both bad.

But also, "Throw that burger in the trash I'm not eating it" and "Uninstall that plugin, I'm not querying it" have about the same impact on your gross carbon emissions.

These are supply side problems in industries that receive enormous state subsides. Hell, the single biggest improvement to our agriculture policy was when China stopped importing US pork products. So, uh... once again, thank you China for saving the planet.

It's not, you're just personally insulted. The livestock industry is responsible for about 15% of human caused greenhouse gas emissions. That's not negligible.

Unlikely. 5 is just all of OpenAIs previous models in a trenchcoat.

probably because the animal death industry is comparable to those things

intense electricity demands, and WATER for cooling.

those are his lying/making up hand gestures. its the same thing trump does with his hands when hes lying or exaggerating, he does the wierd accordian hands.

MS already released, thier AI doesnt make money at all, in fact its costing too much. of course hes freaking out.

its like crypto, they wanted to make money of VC funds, and thats probably running dry right now, and the investors are probably going to demand returns very soon. why do you think the massive layoffs started in 2023.

I wonder if at this stage all the processors should simply be submerged into a giant cooling tank. It seems easier and more efficient.

Not really, if it were they would be announcing their new highly efficient model.

Dude, wtf?!
You can't just go around pointing out peoples hypocrisy. Companies killing the planet is big bad.

People joining in? Dude just let us live!! It is only animals...

big /s

Wait so the biggest improvement came when there was a massive decline in demand?

probably VC money, the investors going to want some answers.

It's safe to assume that any metric they don't disclose is quite damning to them. Plus, these guys don't really care about the environmental impact, or what us tree-hugging environmentalists think. I'm assuming the only group they are scared of upsetting right now is investors. The thing is, even if you don't care about the environment, the problem with LLMs is how poorly they scale.

An important concept when evaluating how something scales is are marginal values, chiefly marginal utility and marginal expenses. Marginal utility is how much utility do you get if you get one more unit of whatever. Marginal expenses is how much it costs to get one more unit. And what the LLMs produce is the probably that a token, T, follows on prefix Q. So P(T|Q) (read: Probably of T, given Q). This is done for all known tokens, and then based on these probabilities, one token is chosen at random. This token is then appended to the prefix, and the process repeats, until the LLM produces a sequence which indicates that it's done talking.

If we now imagine the best possible LLM, then the calculated value for P(T|Q) would be the actual value. However, it's worth noting that this already displays a limitation of LLMs. Namely even if we use this ideal LLM, we're just a few bad dice rolls away from saying something dumb, which then pollutes the context. And the larger we make the LLM, the closer its results get to the actual value. A potential way to measure this precision would be by subtracting P(T|Q) from P_calc(T|Q), and counting the leading zeroes, essentially counting the number of digits we got right. Now, the thing is that each additional digit only provides a tenth of the utility to than the digit before it. While the cost for additional digits goes up exponentially.

So, exponentially decaying marginal utility meets exponentially growing marginal expenses. Which is really bad for companies that try to market LLMs.

He's also already admitted that they're out of training data. If you've wondered why a lot more websites will run some sort of verification when you connect, it's because there's a desperate scramble to get more training data.