I think that at least some instances use Cloudflare for various things, so depending upon what and how much stuff at Cloudflare is broken, some lemmy instances may be impacted.
tal
joined 2 years ago
When you stop using a search engine and use AI-generated responses for everything, I guess having your LLM backends go down could qualify as having a disruptive functional impact.
Yeah, I remember reading about AI Horde a while back and thought about it, but wasn't comfortable with having an system that fields requests from the outside world, as my GPU is on a desktop and I'm not totally sold on how well these guys have hardened the thing. If I had a dedicated compute node for doing renders, I'd probably be fine with it, as it just eats some electricity then.
Hahaha, that's fantastic. Thanks, @db@lemmy.dbzer0.com. I can't believe that I had been unaware of this for years.
I've got local hardware myself, but this makes generation way more accessible to random users on the Threadiverse without tying them to commercial services, including users who are using a phone and can't really run the stuff locally.
skims bot FAQ more
It does look like the bot tries to block NSFW stuff, but outside of that, it looks pretty permissive of whatever, and while the style list doesn't clearly distinguish between styles consisting of prompts for one model and different models, there are a lot of models in there that I recognize. Just append style: flux to the end of the prompt. It's got Flux (style: flux), Pony (style: pony), Pony Realism (style: pony realism), the Nova family (style: nova anime xl, style: nova, style: nova furry pony), Stable Diffusion 3 (style: sd3), SDXL (style: sdxl), Mistoon (style: mistoon anime), just from a very quick skim. I guess AI Horde must have a list of models and the ability to just download models or something if it doesn't already have them present on a node?
skims bot FAQ
Oh, dang, it even runs multiple models, and it looks like it can run Flux, which can handle fairly English-language-looking prompts.
I gotta see this.
@aihorde@lemmy.dbzer0.com draw for me An engraving of a skunk. style: flux
Hahaha, awesome, db0, didn't know that you'd set this up until now.
A couple of my favorites from that thread:
@FlyingSquid@lemmy.world
@ThunderWhiskers@lemmy.world
@YodaDaCoda@sh.itjust.works
@DredUnicorn@lemmy.world
@Thelsim@sh.itjust.works
@anonymoose@lemmy.ca
@itslilith@lemmy.blahaj.zone
@starcat@lemmy.world
@Tlaloc_Temporal@lemmy.ca
@Usernameblankface@lemmy.world (also OP here, also the person who brought the idea up in another thread)
@WandFliesenWodka@lemmy.world
Link to the original version of this thread to which OP is referring, which was quite a hit some time back:
Up to par with your usual work, merde!
@mutilated_sphincter@lemmy.world:
Operating on the assumption that even merde may not want to touch this one, using realmixXL_v15:
If the costs are mostly variable in how much they serve up, and uptime is sufficiently important, maybe have two CDNs and use the other one as a fallback when things start going tits-up?