Alternative headline: household spyware cash machine forced to pay $20 for being bad.

If you want to punish Meta then you have to punish the wonder boy who runs it. Not even share holders can fight off the guy spending 80B on the metaverse.

You're not wrong, but the problem for Meta is that this, along with their other fine for mental harm is setting a precedence.

This fine is somewhat larger, at $375 million, but the other one (https://www.msn.com/en-us/health/other/meta-and-youtube-fine...) basically open the gates for millions of people suing.

Sadly I don't think it's enough for Meta to change, because they have no business model if they are forced to be serious about online safety. That's probably also why they are pushing so hard for age verification, make safety a problem for someone else.

The poster probably is hoping someone will post the archived version in the comments

I heard a delightful term for building apps only for yourself “houseplant programming”.

Could you share what you are using for inference and how you are running it? I have a 64G VRAM/128G system RAM setup.

Most people are using something in the llama family for inference. Llama server is my go to. Unsloth guides describe how to configure inference for your model of choice.

Good, because it’s fucking ridiculous that pharma gets special patent loop holes to maintain a monopoly beyond what the basic protection grants.

I don’t know why this keeps coming up. Has this been a big deal for everyone else? Like ok usability improvement, but the number of times I have read an article about this is silly.

I doubt this is about the asterisks at this point. It’s about Rust, rewriting working tools in Rust and showing that Rust is the way and the only way.

Yes, when the poetry people purposely added a feature to fail CI with a 1/10 chance because they wanted to depreciate a feature, I depreciated poetry.

MOE but 120B range. Man I wish it was an 80B. I have 2 GPUs with 62Gib of usable VRAM. A 4bit 80B gives me some context window, but 120B puts me into system RAM

Either some q3 or since it's a MoE, maybe a REAP version of q4 might work (or could be terrible, I'm not sure about REAP'd models).

Yeah, well might just come on your new laptop

Or your phone.

Hopefully not vendor locked with pay-per-token licensing.

Give me a 120B dense model on one of these and yeah my API use will probably drop.