this post was submitted on 25 Jan 2024
550 points (97.1% liked)

Greentext

4459 readers
852 users here now

This is a place to share greentexts and witness the confounding life of Anon. If you're new to the Greentext community, think of it as a sort of zoo with Anon as the main attraction.

Be warned:

If you find yourself getting angry (or god forbid, agreeing) with something Anon has said, you might be doing it wrong.

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] WaxedWookie@lemmy.world 4 points 10 months ago (2 children)

Look into ollama and mixtral variants... You'll be limited by things like GPU memory though.

[–] miss_brainfarts@lemmy.blahaj.zone 3 points 10 months ago (1 children)

Mixtral 8x7B seems fairly capable to me so far. It's just that I need to wait a few minutes for it to reply, given I'm running it on a 1st gen Ryzen...

Any models you'd reccommend that fit into 4GB of VRAM?

I've tried Deepseek Coder, and it certainly works well for quickly churning out bash scripts for whatever purpose I can possibly think of

[–] WaxedWookie@lemmy.world 2 points 10 months ago (1 children)

Similar story here with an old 10xx GPU. I've just started tinkering with dolphin-mixtral-8x7b, but it's early days.

[–] miss_brainfarts@lemmy.blahaj.zone 3 points 10 months ago

Dolphin is just peak amusement to me. I've asked so many weird things of it that it's basically just cowering in a corner now, afraid of answering any question for fear of getting another kitten killed.

[–] UnRelatedBurner@sh.itjust.works 1 points 10 months ago (1 children)

what'd you say a good GPU is for it?

[–] WaxedWookie@lemmy.world 2 points 10 months ago (1 children)

An nvidia card with as much memory as possible - the newer the better.

I'm also beginning to look into the dedicated accelerators like the coral, but at first wash, it looks like lack of onboard memory will be a massive bottleneck.

[–] UnRelatedBurner@sh.itjust.works 1 points 10 months ago (1 children)

dang, I got an amd one. Should I even try? (16GB)

[–] WaxedWookie@lemmy.world 2 points 10 months ago

That I don't have any experience with - I hear it's harder, but not impossible.