this post was submitted on 18 Jul 2024
490 points (98.4% liked)

Memes

45704 readers
1278 users here now

Rules:

  1. Be civil and nice.
  2. Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.

founded 5 years ago
MODERATORS
 
top 27 comments
sorted by: hot top controversial new old
[–] neidu2@feddit.nl 47 points 4 months ago* (last edited 4 months ago) (6 children)

Technically possible with a small enough model to work from. It's going to be pretty shit, but "working".

Now, if we were to go further down in scale, I'm curious how/if a 700MB CD version would work.

Or how many 1.44MB floppies you would need for the actual program and smallest viable model.

[–] Naz@sh.itjust.works 16 points 4 months ago (1 children)

squints

That says , "PHILLIPS DVD+R"

So we're looking at a 4.7GB model, or just a hair under the tiniest, most incredibly optimized implementation of <INSERT_MODEL_NAME_HERE>

[–] curbstickle@lemmy.dbzer0.com 13 points 4 months ago (1 children)

llama 3 8b, phi 3 mini, Mistral, moondream 2, neural chat, starling, code llama, llama 2 uncensored, and llava would fit.

[–] BudgetBandit@sh.itjust.works 1 points 4 months ago (1 children)

Just interested in the topic did you 🔨 offline privately?

[–] curbstickle@lemmy.dbzer0.com 1 points 4 months ago

I'm not an expert on them or anything, but feel free

[–] PixelatedSaturn@lemmy.world 12 points 4 months ago (3 children)

Might be a dvd. 70b ollama llm is like 1.5GB. So you could save many models on one dvd.

[–] ignotum@lemmy.world 8 points 4 months ago (3 children)

70b model taking 1.5GB? So 0.02 bit per parameter?

Are you sure you're not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that's a lot of DVDs

[–] PixelatedSaturn@lemmy.world 9 points 4 months ago

Ah yes probably the Smaler version, your right. Still, a very good llm better than gpt 3

[–] 9point6@lemmy.world 7 points 4 months ago

Less than half of a BDXL though! The dream still breathes

[–] Steve@startrek.website 5 points 4 months ago

For some reason, triple layer writable blu-ray exists. 100GB each

https://www.verbatim.com/prod/optical-media/blu-ray/bd-r-xl-tl/bd-r-xl-tl/

[–] errer@lemmy.world 8 points 4 months ago

It is a DVD, can faintly see DVD+R on the left side

[–] DannyBoy@sh.itjust.works 5 points 4 months ago

It does have the label DVD-R

[–] kindenough@kbin.earth 8 points 4 months ago* (last edited 4 months ago)
[–] Num10ck@lemmy.world 7 points 4 months ago

ELIZA was pretty impressive for the 1960s, as a chatbot for psychology.

[–] lidd1ejimmy@lemmy.ml 4 points 4 months ago

yes i guess it would be a funny experiment for just a local model

[–] veroxii@aussie.zone 3 points 4 months ago

pkzip c:\chatgpt*.* a:\chatgpt.zip -&

[–] Lucidlethargy@sh.itjust.works 33 points 4 months ago (3 children)

Not needed, I've got this gem. Encarta 99

Y'all can look, but don't touch.

[–] amenji@programming.dev 3 points 4 months ago

Mummified corpse killed by Wikipedia

[–] black0ut@pawb.social 3 points 4 months ago

Wow, I've actually never seen this disc. However, funnily enough, I have another disc with that program burned into it. Someone didn't read the notice, it seems.

[–] InFerNo@lemmy.ml 1 points 4 months ago

Do you also have a Route99 disc?

[–] Sparky@lemmy.blahaj.zone 10 points 4 months ago* (last edited 4 months ago)

Fun fact: you can download llama3, an llm model made by meta (which is surprisingly good for its size), and it's only 4.7gb. A dvd can store 4.7 gb of data, meaning you could in theory have an llm on a DVD.

Model link

CC BY-NC-SA 4.0

[–] Master@lemm.ee 8 points 4 months ago (1 children)
[–] blandfordforever@lemm.ee 11 points 4 months ago (1 children)

Please keep us updated with all future inconsequential misinterpretations.

-Management

[–] Facebones@reddthat.com 3 points 4 months ago

Dear Management,

I was just brushing my teeth without my glasses on, anf out of the corner of my eye it sorta looked like Versace.

Hope this helps, Facebones

[–] JimVanDeventer@lemmy.world 7 points 4 months ago
[–] Steamymoomilk@sh.itjust.works 4 points 4 months ago

Seems legit

[–] dch82@lemmy.zip 1 points 4 months ago

…disc 1 of 150