this post was submitted on 05 Nov 2024
293 points (95.4% liked)

Technology

59534 readers
3135 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Estebiu@lemmy.dbzer0.com 6 points 2 weeks ago (1 children)

OpenWebUI? pretty easy to selfhost and works wonders on my rtx a6000

[–] lemmeBe@sh.itjust.works 3 points 2 weeks ago (2 children)

OpenWebUI says it's designed to operate entirely offline - that's not an alternative to Perplexity. I need online search functionality, that's pretty much the only reason why I pay them. I have offline solutions set up on my pc.

[–] Estebiu@lemmy.dbzer0.com 2 points 2 weeks ago

oh, sorry. never used perplexity so i didnt know. if you find a viable alternative tell me pls

[–] Disaster@sh.itjust.works 0 points 2 weeks ago

OWui has a search module which can be enabled. For me, running it entirely offline is more or less the draw. I think it also supports RAG search, although I don't know how "good" it is.. mostly I was just after a little magic box to play with.

Now, if only enterprise glass GPU's weren't so power hungry and expensive..