gpt-oss: OpenAI releases 2 open-source models
Technology
9
Beiträge
6
Kommentatoren
5
Aufrufe
-
This post did not contain any content.
-
This post did not contain any content.
Crazy but sure ig
-
This post did not contain any content.
I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
-
This post did not contain any content.
Finally, their company name is starting to make SOME sense
-
I tried the 20b on my PC with ollama and Open WebUI and I have to say for some of my use cases it preforms similar to the online version, I was impressed.
What card are you running it on?
-
What card are you running it on?
Nvidia rtx 3060 the 12GB Vram one
-
Nvidia rtx 3060 the 12GB Vram one
Not bad. Does it use all the VRAM?
-
This post did not contain any content.
It's awesome but that 128k context window is a throwback to Llama3 days
I bet the closed $ource model has like 2MB context
-
Not bad. Does it use all the VRAM?
I need to check with that model but usually yes.
