Sadly, it seems Meta made some good decisions in LLM area at least. Llama is a de facto base of most good 7b and 13b LLMs, the ones that have potential on running on low grade hardware.
gorogorochan
joined 1 year ago
Sadly, this. Average consumer, and I don’t mean it as an insult, will not look for an alternative to streaming. All these giant streaming companies are gauging how far they can go to increase the profit margins.
I do self-host some services but it bugs me that a lot of articles that talk about costs do not factor in a lot of additional costs. Drives for NAS need replacement. Running NUCs means quite an energy draw compared to most ARM based SBCs.