Search
Close this search box.

ServiceNow, Hugging Face, and NVIDIA Collaborate to Launch Open-Access LLMs for Code Generation

ServiceNow, Hugging Face, and NVIDIA have joined forces to introduce StarCoder2, a family of open-access large language models (LLMs) designed for code generation.

ServiceNow, Hugging Face, and NVIDIA have joined forces to introduce StarCoder2, a family of open-access large language models (LLMs) designed for code generation. This collaborative effort aims to set new standards in performance, transparency, and cost-effectiveness within the realm of generative AI.

Empowering Developers with Enhanced Code Generation Capabilities

StarCoder2, developed by the BigCode community, a collaboration stewarded by ServiceNow and Hugging Face, offers developers a suite of advanced tools for code generation. Trained on a vast array of programming languages, StarCoder2 models can be further customized and integrated into enterprise applications to perform specialized tasks such as source code generation, workflow creation, text summarization, and more. These capabilities are poised to accelerate innovation and improve productivity across various industries.

Model Variants and Performance

StarCoder2 is available in three model sizes, each offering powerful performance tailored to different compute requirements. These variants include a 3 billion-parameter model developed by ServiceNow, a 7 billion-parameter model by Hugging Face, and a 15 billion-parameter model by NVIDIA, leveraging NVIDIA NeMo and trained on NVIDIA accelerated infrastructure. Despite their varying sizes, these models deliver impressive performance, with the 3 billion-parameter model matching the capabilities of the original 15 billion-parameter model.

Advancing Responsible AI Practices

The collaborative effort underscores a commitment to responsible AI practices, ensuring transparency and accountability in model development. Harm de Vries, lead of ServiceNow’s StarCoder2 development team, highlighted the significance of open scientific collaboration and ethical data practices in advancing generative AI capabilities.

Fostering Open Scientific Collaboration

BigCode, led jointly by Hugging Face and ServiceNow, fosters open scientific collaboration in the development of LLMs for code. Through transparent governance and the utilization of responsibly sourced data, BigCode aims to drive innovation while upholding ethical standards in AI development.

Support for Industry-Specific Applications

StarCoder2 models can be fine-tuned with industry or organization-specific data, further enhancing their capabilities for specialized tasks. Organizations have already leveraged the foundational StarCoder model to create task-specific capabilities tailored to their business needs, demonstrating the versatility and applicability of generative AI in various domains.

Availability and Accessibility

StarCoder2 models will be made available under the BigCode Open RAIL-M license, ensuring royalty-free access and use for developers. Additionally, the models will be accessible for download from Hugging Face and NVIDIA platforms, enabling developers to experiment with them directly or through API endpoints.

About ServiceNow, Hugging Face, and NVIDIA

ServiceNow is a leading digital workflow company focused on digitizing and unifying organizations to enhance productivity and innovation. Hugging Face is a prominent open-source platform enabling collaboration in the machine learning community. NVIDIA is a pioneer in accelerated computing, reshaping industries with its data center-scale offerings.

Anshika Mathews
Anshika Mathews
Anshika is an Associate Research Analyst working for the AIM Leaders Council. She holds a keen interest in technology and related policy-making and its impact on society. She can be reached at anshika.mathews@aimresearch.co
Meet 100 Most Influential AI Leaders in USA
MachineCon 2024
26th July, 2024, New York
Latest Edition

AIM Research Apr 2024 Edition

Subscribe to our Latest Insights
By clicking the “Continue” button, you are agreeing to the AIM Media Terms of Use and Privacy Policy.
Recognitions & Lists
Discover, Apply, and Contribute on Noteworthy Awards and Surveys from AIM
AIM Leaders Council
An invitation-only forum of senior executives in the Data Science and AI industry.
Stay Current with our In-Depth Insights
Our Upcoming Events
Intimate leadership Gatherings for Groundbreaking Insights in Artificial Intelligence and Analytics.
AIMResearch Event
Supercharge your top goals and objectives to reach new heights of success!

Cutting Edge Analysis and Trends for USA's AI Industry

Subscribe to our Newsletter