Snowflake Launches Arctic: The Most Open, Enterprise-Grade Large Language Model 

April 24, 2024 -- Snowflake today announced Snowflake Arctic, a state-of-the-art large language model (LLM) uniquely designed to be the most open, enterprise-grade LLM on the market. With its unique Mixture-of-Experts (MoE) architecture, Arctic delivers top-tier intelligence with unparalleled efficiency at scale.

Snowflake Arctic is optimized for complex enterprise workloads, topping several industry benchmarks across SQL code generation, instruction following, and more. In addition, Snowflake is releasing Arctic’s weights under an Apache 2.0 license and details of the research leading to how it was trained, setting a new openness standard for enterprise AI technology. The Snowflake Arctic LLM is a part of the Snowflake Arctic model family, a family of models built by Snowflake that also include the best practical text-embedding models for retrieval use cases.

“This is a watershed moment for Snowflake, with our AI research team innovating at the forefront of AI,” said Sridhar Ramaswamy, CEO, Snowflake. “By delivering industry-leading intelligence and efficiency in a truly open way to the AI community, we are furthering the frontiers of what open source AI can do. Our research with Arctic will significantly enhance our capability to deliver reliable, efficient AI to our customers.”

Arctic Breaks Ground With Truly Open, Widely Available Collaboration

According to a recent report by Forrester, approximately 46 percent of global enterprise AI decision-makers noted that they are leveraging existing open source LLMs to adopt generative AI as a part of their organization’s AI strategy.1 With Snowflake as the data foundation to more than 9,400 companies and organizations around the world2, it is empowering all users to leverage their data with industry-leading open LLMs, while offering them flexibility and choice with what models they work with.

Now with the launch of Arctic, Snowflake is delivering a powerful, truly open model with an Apache 2.0 license that permits ungated personal, research, and commercial use. Taking it one step further, Snowflake also provides code templates, alongside flexible inference and training options so users can quickly get started with deploying and customizing Arctic using their preferred frameworks.

These will include NVIDIA NIM with NVIDIA TensorRT-LLM, vLLM, and Hugging Face. For immediate use, Arctic is available for serverless inference in Snowflake Cortex, Snowflake’s fully managed service that offers machine learning and AI solutions in the Data Cloud. It will also be available on Amazon Web Services (AWS), alongside other model gardens and catalogs, which will include Hugging Face, Lamini, Microsoft Azure, NVIDIA API catalog, Perplexity, Together AI, and more.

Arctic Provides Top-Tier Intelligence with Leading Resource-Efficiency

Snowflake's AI research team, which includes a unique composition of industry-leading researchers and system engineers, took less than three months and spent roughly one-eighth of the training cost of similar models when building Arctic. Trained using Amazon Elastic Compute Cloud (Amazon EC2) P5 instances, Snowflake is setting a new baseline for how fast state-of-the-art open, enterprise-grade models can be trained, ultimately enabling users to create cost-efficient custom models at scale.

As a part of this strategic effort, Arctic’s differentiated MoE design improves both training systems and model performance, with a meticulously designed data composition focused on enterprise needs. Arctic also delivers high-quality results, activating 17 out of 480 billion parameters at a time to achieve industry-leading quality with unprecedented token efficiency.

In an efficiency breakthrough, Arctic activates roughly 50 percent less parameters than DBRX, and 75 percent less than Llama 3 70B during inference or training. In addition, it outperforms leading open models including DBRX, Mixtral-8x7B, and more in coding (HumanEval+, MBPP+) and SQL generation (Spider), while simultaneously providing leading performance in general language understanding (MMLU).

Snowflake Continues to Accelerate AI Innovation for All Users

Snowflake continues to provide enterprises with the data foundation and cutting-edge AI building blocks they need to create powerful AI and machine learning apps with their enterprise data. When accessed in Snowflake Cortex, Arctic will accelerate customers’ ability to build production-grade AI apps at scale, within the security and governance perimeter of the Data Cloud.

In addition to the Arctic LLM, the Snowflake Arctic family of models also includes the recently announced Arctic embed, a family of state-of-the-art text embedding models available to the open source community under an Apache 2.0 license. The family of five models are available on Hugging Face for immediate use and will soon be available as part of the Snowflake Cortex embed function (in private preview).

These embedding models are optimized to deliver leading retrieval performance at roughly a third of the size of comparable models, giving organizations a powerful and cost-effective solution when combining proprietary datasets with LLMs as part of a Retrieval Augmented Generation or semantic search service.

Snowflake also prioritizes giving customers access to the newest and most powerful LLMs in the Data Cloud, including the recent additions of Reka and Mistral AI’s models. Moreover, Snowflake recently announced an expanded partnership with NVIDIA to continue its AI innovation, bringing together the full-stack NVIDIA accelerated platform with Snowflake’s Data Cloud to deliver a secure and formidable combination of infrastructure and compute capabilities to unlock AI productivity. Snowflake Ventures has also recently invested in Landing AI, Mistral AI, Reka, and more to further Snowflake’s commitment to helping customers create value from their enterprise data with LLMs and AI.

Get more information and additional resources on Snowflake Arctic, here.

About Snowflake

Snowflake makes enterprise AI easy, efficient, and trusted. Thousands of companies around the globe, including hundreds of the world’s largest, use Snowflake’s Data Cloud to share data, build AI and machine learning applications, and power their business. The era of enterprise AI is here. Learn more at snowflake.com (NYSE: SNOW).

Source: Snowflake