danhab99

joined 2 years ago
[–] danhab99@programming.dev 9 points 10 months ago

I'm working on self-hosting my own LLMs.

I realized there are things I wanna talk about and research but I don't want to send it to open AI. Frankly I feel gross about how much I've sent to open AI. My desktop is a beefy gaming rig that I don't use for gaming much. I have a 20thread core, 64gb ram, an Nvidia gtx 3060 and 5 spare TB so why not.

  • I keep a few ollama models downloaded and I'm slowly getting to know them and what they can do. Gemma seems to answer the fastest so I've been using that. Deepseek is like the reasoning button on chatgpt.
  • I use openai-whisper to transcribe meetings I record using OBS. It's really slow so I have a cronjob transcribe all my meetings for that day overnight.
  • Open Web UI is a fantastic LLM frontend. It provides tools, rags, web searching, and model ranking all as a simple to use UI.
  • My desktop has a Wireguard server which makes it easy to use my OpenWebUI on my phone.

Now I want to work on giving the LLM access to my Google calendar so it can create reminders for me. I'm sick of forgetting to think about remembering to do things so I hope if I can just ramble at the LLM about what I'm doing or what's on my mind it can organize my thoughts. What else are these LLM actually for?

[–] danhab99@programming.dev 3 points 11 months ago

½TB nvme SSD for the OS and any system/user level binary

1TB sata SSD for code projects, docker, and videogames

10tb HDD for just having a massive amount of fairly stable storage space. I gotta tell you I sleep really well knowing that at 4 in the morning a compressed disk image of my work SSD is being written to the hard drive.

[–] danhab99@programming.dev 49 points 11 months ago (19 children)

Can I ask who even clicks on these Google ads? Who is making Google ads valuable by interacting with them?

[–] danhab99@programming.dev 2 points 11 months ago (1 children)

I tried attaching movement controls to my logitech g600's number pad, it wasn't practical

[–] danhab99@programming.dev 10 points 11 months ago (1 children)

For your education:

Pacman like many other package managers tries to minimize network queries, to do this you download a manifest of every package available and its installation instructions. -Sy downloads the latest manifest from all of your pacman repos, -u installs the packages whose "version" field changed between the old and new manifests.

These error messages show that the domain name the manifest had for your package was unavailable, this is why you should check for updates.

[–] danhab99@programming.dev 11 points 11 months ago

Resting your eyes means going back to sleep

[–] danhab99@programming.dev 1 points 1 year ago

Makes it easier to distribute and set up

[–] danhab99@programming.dev 2 points 1 year ago

IMO if Lemmy had all the features that old.reddt had it would still be an objectivly worse UX experience. Federating reduces UX, that's just a rule.

We should focus on making the onboarding process as simple as possible like enabling social login (inb4 insecure and not private: let people make their choices), and making it easier to move between instances and understand what instance you're looking at.

[–] danhab99@programming.dev 3 points 1 year ago

I had a really frustrating time when I was trying to have a SATA and m.2 drive. Turns out some sata ports cannot be used while an SSD is in a given m.2 slot.

Look up your motherboards instruction manual, it should have the rules listed out. Give them to chatgpt and ask it to tell you how to plug your drives in.

[–] danhab99@programming.dev 13 points 1 year ago (1 children)

PC gamers moving to console? What's next the existing consoles adopting keyboard+mouse?..

There is no downside to this

[–] danhab99@programming.dev 2 points 1 year ago

I liked them the same, but I could name more episodes that I enjoyed and Voyager than DS9

[–] danhab99@programming.dev 5 points 1 year ago (4 children)

I'll die on the hill that ds9 wasn't bad. It wasn't the best, lowest of the 4.. but if ds9 was the worst and it's still good than the other shows are great

view more: ‹ prev next ›