Elon Musk wants to rewrite "the entire corpus of human knowledge" with Grok
Technology
199
Beiträge
159
Kommentatoren
909
Aufrufe
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out
-
"If we take this 0.84 accuracy model and train another 0.84 accuracy model on it that will make it a 1.68 accuracy model!"
~Fucking Dumbass
1.68 IQ move
-
in the unable-to-reason-effectively sense
That's all LLMs by definition.
They're probabilistic text generators, not AI. They're fundamentally incapable of reasoning in any way, shape or form.
They just take a text and produce the most probable word to follow it according to their training model, that's all.
What Musk's plan (using an LLM to regurgitate as much of its model as it can, expunging all references to Musk being a pedophile and whatnot from the resulting garbage, adding some racism and disinformation for good measure, and training a new model exclusively on that slop) will produce is a significantly more limited and prone to hallucinations model that occasionally spews racism and disinformation.
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::We have never been at war with Eurasia. We have always been at war with East Asia
-
So where will Musk find that missing information and how will he detect "errors"?
I expect he'll ask Grok and believe the answer.
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::Elon should seriously see a medical professional.
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::First error to correct:
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing
informationerrors and deletingerrorsinformation. -
Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out
Garbage out is what he aims for.
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::How high on ketamine is he?
3.5 (maybe we should call it 4)
I think calling it 3.5 might already be too optimistic
-
Elon should seriously see a medical professional.
He should be locked up in a mental institute. Indefinitely.
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::Whatever. The next generation will have to learn to trust whether the material is true or not by using sources like Wikipedia or books by well-regarded authors.
The other thing that he doesn't understand (and most "AI" advocates don't either) is that LLMs have nothing to do with facts or information. They're just probabilistic models that pick the next word(s) based on context. Anyone trying to address the facts and information produced by these models is completely missing the point.
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::Grok will round up physics constants and pi as well... nothing will work but Musk will say that humanity is dumb
-
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::I believe it won't work.
They would have to change so much info that won't make a coherent whole. So many alternative facts that clash with so many other aspects of life. So asking about any of it would cause errors because of the many conflicts.
Sure it might work for a bit, but it would quickly degrade and will be so much slower than other models since it needs to error correct constantly.
An other thing is that their training data will also be very limited, and they would have to check every single other one thoroughly for "false info". Increasing their manual labour.
-
Whatever. The next generation will have to learn to trust whether the material is true or not by using sources like Wikipedia or books by well-regarded authors.
The other thing that he doesn't understand (and most "AI" advocates don't either) is that LLMs have nothing to do with facts or information. They're just probabilistic models that pick the next word(s) based on context. Anyone trying to address the facts and information produced by these models is completely missing the point.
Thinking wikipedia or other unbiased sources will still be available in a decade or so is wishful thinking. Once the digital stranglehold kicks in, it'll be mandatory sign-in with gov vetted identity provider and your sources will be limited to what that gov allows you to see. MMW.
-
Whatever. The next generation will have to learn to trust whether the material is true or not by using sources like Wikipedia or books by well-regarded authors.
The other thing that he doesn't understand (and most "AI" advocates don't either) is that LLMs have nothing to do with facts or information. They're just probabilistic models that pick the next word(s) based on context. Anyone trying to address the facts and information produced by these models is completely missing the point.
asdf
-
Training an AI model on AI output? Isn't that like the one big no-no?
They used to think that, but it is actually not that bad.
Like iterations with machine learning, you can train it with optimized output.
That isn't the dumb part about this.
-
Thinking wikipedia or other unbiased sources will still be available in a decade or so is wishful thinking. Once the digital stranglehold kicks in, it'll be mandatory sign-in with gov vetted identity provider and your sources will be limited to what that gov allows you to see. MMW.
Wikipedia is quite resilient - you can even put it on a USB drive. As long as you have a free operating system, there will always be ways to access it.
-
Surprised he didn’t name it Giga Reasoning or some other dumb shit.
Gigachad Reasoning
-
Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out
Maybe someone should write a new Art of War to explain to tech CEOs the basic ins and outs of technology development.
- Like you can't throw more developers on a project to make it finish faster.
- Cutting budgets isn't just free money, they come with detriments.
- You can't scamp on security. It can take a single zero day to bankrupt a company.
- There are limits to an internet connection. You can't expect everyone to have gigabit internet.
The basic shit every person working in the field understands. Except for the out-of-touch management.
Call it the Art of Commerce or something. -
We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.
Then retrain on that.
Far too much garbage in any foundation model trained on uncorrected data.
::: spoiler More Context
Source.
:::You want to have a non-final product write the training for the next level of bot? Sure, makes sense if you're stupid. Why did all these companies waste time stealing when they could just have one bot make data for the next bot to train on? Infinite data!
