Post by @ofcourse@lemmy.ml

2026-10-17 15:17 UTC

I know everyone hates on Meta but they just released an open weight 800B parameter model: Muse Spark Open. Their smaller 30B parameter open model Muse Glimmer has also been out for a few weeks and is highly competitive with Qwen 3.8 27B. So I hope we will start seeing more open models from US labs especially in the sub-20GB category which can be deployed on daily use machines.

Replies (1)

@brucethemoose@lemmy.world 2026-10-19 03:35

In case anyone forgot, Meta was the pioneer of open weight models, with Llama 1 released/leaked February 2023. They literally set the standard. Everything in the open weight space is derived from the Llama series, its footprint is in newest Chinese models. The world was their oyster. …And after one bad experiment Zuckerberg meddled with (Llama 4), Zuck fired the whole Llama team, hired a bunch of tech bros in their place, who proceeded to nothing for a good long while. Muse is… not terrible? Its architecture (GQA + sliding window attention) is about a year or two out of date, but it… could be worse. But this is just a reminder to anyone who thinks Zuck won’t find some way to feel insecure and fuck Muse up. He will. It is what he does. Same with Musk. And Altman. The U.S. AI industry was basically doomed from the beginning.

Open ##5251278