NinjaTech AI, a cutting-edge generative AI company based in Silicon Valley, has announced the launch of its pioneering AI product, Ninja. This innovation represents a leap beyond conventional AI assistants and co-pilots, venturing into the realm of autonomous AI agents.
NinjaTech AI is leveraging the advanced machine learning capabilities of Amazon Web Services (AWS), utilizing AWS’s purpose-built Trainium and Inferentia2 chips alongside Amazon SageMaker, a cloud-based machine learning service. This collaboration aims to create, train, and deploy custom AI agents capable of performing complex tasks autonomously, such as conducting research and scheduling meetings, thereby saving time and money for users by integrating generative AI into daily workflows.
“Partnering with AWS’s Annapurna Labs has been transformative for NinjaTech AI,” said Babak Pahlavan, founder and CEO of NinjaTech AI. “The Trainium and Inferentia2 chips have exceeded our expectations in terms of power and flexibility, allowing us to scale our reinforcement-learning AI agents efficiently. These next-generation chips support larger variants of popular open-source models like Llama 3, cutting our costs by up to 80% and enhancing energy efficiency by 60% compared to traditional GPUs. The collaborative technical support from AWS has been invaluable in our development of deep tech.”
Exciting news! 🚀
— AWS Startups (@AWSstartups) May 21, 2024
Meet @NinjaTechAI, a startup harnessing the power of AWS Trainium and Inferentia2 machine learning chips to launch their #generativeAI autonomous agent, Ninja,
Learn more about this game-changing collaboration: https://t.co/CIoShMLVOr #AWS #AI #Startups pic.twitter.com/K57nxFvxQZ
The AI agents developed by NinjaTech AI utilize highly-customized large language models (LLMs) that are optimized using reinforcement learning to ensure accuracy and speed. Developing such AI agents typically requires affordable and scalable chips tailored for reinforcement learning, a challenging and costly endeavor due to the current scarcity of GPUs and high compute costs. AWS addresses this challenge with its unique chip technology, enabling rapid, scalable training cycles across thousands of nodes. Amazon SageMaker further enhances this process by allowing the use of open-source models, making the training of AI agents faster, more flexible, and more affordable.
“AI agents are poised to become the next wave of productivity tools, reshaping how we work, collaborate, and learn,” said Gadi Hutt, senior director at Annapurna Labs, AWS. “NinjaTech AI has developed fast, accurate, and cost-effective agents that can scale rapidly using AWS’s Trainium and Inferentia2 AI chips. We’re thrilled to support NinjaTech AI in bringing autonomous agents to market while advancing AWS’s mission to support open-source machine learning and popular frameworks like PyTorch and Jax.”
NinjaTech AI has trained its models on AWS Trainium (Amazon EC2 Trn1 instances) and deployed them using AWS Inferentia2 (Amazon EC2 Inf2 instances). Trainium enables high-performance compute clusters on AWS, facilitating faster and cost-efficient training of LLMs with lower energy consumption. Inferentia2, in turn, allows models to generate inferences more swiftly and cost-effectively, boasting up to 40% better price performance.
“Our collaboration with AWS has accelerated our development of a novel generative AI-based planner and action engine, essential for building state-of-the-art AI agents,” added Pahlavan. “For generative AI companies seeking on-demand, flexible, and high-speed AI chips, AWS offers an unmatched solution.”
Ninja is now accessible to users via myninja.ai, featuring four conversational AI agents capable of performing multi-step, real-time web research, scheduling meetings, assisting with coding tasks, and drafting emails. Additionally, Ninja provides side-by-side comparisons of results from world-class models by companies such as OpenAI, Anthropic, and Google. Its asynchronous infrastructure allows users to handle an almost infinite number of tasks simultaneously. Ninja will continuously improve with usage, enhancing productivity in everyday life.
This collaboration between NinjaTech AI and AWS heralds a new era of productivity, powered by advanced AI technologies and innovative cloud-based solutions.