Meta今日发布Muse Spark Open,一个具有816B总参数(其中42B为活跃参数)的开源多模态大型语言模型,拥有100万token的上下文窗口1。该模型被Meta称为"最强大的美国开源权重模型"2,首次可在搭载Apple M5 Ultra芯片的Mac Studio上运行12。
这次发布标志着Meta与Apple的一次合作。Meta首席执行官Mark Zuckerberg在社交媒体上表示:"Muse Spark Open - weights releasing today - runs great on new Mac Studios thanks to work with @johnternus and Apple"2。Apple新任首席执行官John Ternus随后回复:"Congrats to the team! Amazing to run a model of Muse"2。两台Mac Studios配合使用可提供最高512GB统一内存和1.2TB/s的内存带宽1。
Muse Spark Open支持多个推理引擎,包括SGLang、vLLM、TensorRT-LLM、Hugging Face Transformers、Apple MLX、llama.cpp和Unsloth1。模型在NVIDIA和AMD GPU上实现了1.03至3.95倍的核心级加速,在AMD MI350上实现了3%的端到端加速1。该模型已在Hugging Face、Amazon SageMaker AI、Google Cloud Model Garden和Microsoft Foundry Models等平台开放权重下载1,并通过Baseten、Fireworks AI、Groq、Modal、Nebius、OpenRouter和Together AI等多个平台提供API访问1。
Muse Spark Open采用Muse Model License发布,包含有限商业条款,允许许多开发者免费使用1。该模型针对代码编写和AI代理工作进行了优化1。
Meta has released Muse Spark Open, an open-source multimodal large language model featuring 816 billion total parameters with 42 billion active parameters and a context window of 1 million tokens 1. The model represents what Meta describes as the most powerful American open-source weights model 2, and marks a rare collaboration between Meta and Apple to optimize its performance on consumer hardware 2.
For the first time, the model can run on Apple's latest Mac Studios equipped with M5 Ultra chips, leveraging up to 512GB of unified memory and 1.2TB/s memory bandwidth across two machines 1. The model is optimized specifically for code writing and AI agent tasks 1.
Beyond Mac compatibility, Muse Spark Open supports multiple inference engines including SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, Apple MLX, llama.cpp, and Unsloth 1. On NVIDIA and AMD GPUs, the model achieves core-level acceleration ranging from 1.03x to 3.95x, though AMD MI350 implementations show 3% end-to-end acceleration 1. The model weights are now available for download on Hugging Face, Amazon SageMaker AI, Google Cloud Model Garden, and Microsoft Foundry Models 1. Additionally, API access is provided through platforms including Baseten, Fireworks AI, Groq, Modal, Nebius, OpenRouter, and Together AI 1.
Meta CEO Mark Zuckerberg stated that the model "runs great on new Mac Studios thanks to work with @johnternus and Apple" 2, while Apple CEO John Ternus responded with congratulations, calling it "amazing to run a model of Muse" 2. The model is released under the Muse Model License, which includes limited commercial terms while allowing many developers to use it freely 1.
评论
还没有评论,欢迎留下第一条。