Fisch

joined 3 years ago
[–] Fisch@lemmy.ml 1 points 9 months ago

"No, you can't give this to people for free and make their life easier! Then we can't make them pay for it anymore!"

[–] Fisch@lemmy.ml 2 points 9 months ago (4 children)

Maybe 50% GPU is already using too much VRAM and it crashes. You could try to set it to 0% GPU and see if that works.

[–] Fisch@lemmy.ml 8 points 9 months ago* (last edited 9 months ago) (6 children)

Unfortunately LLMs need a lot of VRAM. You could try using koboldcpp, it runs on the CPU but let's you offload layers onto the GPU. That way you might be able to stay withing those 4gb even with larger models.

Edit: I forgot to mention there's a fork of koboldcpp with rocm for AMD cards, which is about twice as fast if I remember correctly. Only relevant if you have an AMD card tho.

Edit 2: This is the model I use btw

[–] Fisch@lemmy.ml 15 points 9 months ago (3 children)

It's not about USB C but about the USB version. Only their Pro models have USB 3 but the other ones have USB 2.

[–] Fisch@lemmy.ml -4 points 9 months ago

I'm only 19, so I'm part of the generation that grew up with phones. Me and my friends all saw 2 girls 1 cup and that gore stuff but I don't feel like it really had any lasting negative effect on us. At the end of the day, it was still just videos. I think watching that stuff was just kind of showing the others how tough or manly you were.

[–] Fisch@lemmy.ml 8 points 9 months ago (1 children)

Sorry, it's not burning through enough diesel

[–] Fisch@lemmy.ml 6 points 9 months ago

I know this exists but from what I understand, OP is using VirtualBox, which doesn't support it and instead of going through the effort to set it up, you might as well just dual boot

[–] Fisch@lemmy.ml 20 points 9 months ago (22 children)

The issue is that programs can't directly use your gpu when using a virtual machine

[–] Fisch@lemmy.ml 1 points 9 months ago

I actually bought a one year subscription yesterday. Will see how it goes.

[–] Fisch@lemmy.ml 1 points 9 months ago (5 children)

I mean German dubs. Also, there's a lot of immigrants here so a lot of people speak more than just German and English and we do learn other languages like French or Spanish in school but it's mostly optional or only if you continue school after 10th grade. Calling us all braindead because we're not forced to learn languages that we'll never use is not very nice.

[–] Fisch@lemmy.ml 1 points 9 months ago

Are the subtitles the main issue here? Because there's bazarr for that.

[–] Fisch@lemmy.ml 4 points 9 months ago (4 children)

I literally just replied to someone else saying that it's very hard to find German stuff. Will take a look at this once I get home, thanks a lot.

view more: ‹ prev next ›