DMR News

Advancing Digital Conversations

Ex-Google researchers have launched an open-source AI models initiative under the banner of Sakana, a Tokyo-based laboratory.

ByYasmeeta Oon

Mar 26, 2024
Former Google researchers have launched an open-source AI models initiative under the banner of Sakana, a Tokyo-based laboratory.

Ex-Google researchers have launched an open-source AI models initiative under the banner of Sakana, a Tokyo-based laboratory.

SAN JOSE – Sakana AI, a Tokyo-based artificial intelligence startup founded by two prominent former Google researchers, has unveiled a groundbreaking approach to AI model development. Employing a novel method inspired by evolution, the company’s AI models, released on Wednesday, mark a significant leap in the field of artificial intelligence.

Sakana AI’s innovative technique, dubbed “model merging,” revolutionizes traditional AI model creation. By combining existing AI models and integrating evolutionary principles akin to breeding and natural selection, Sakana AI has generated a wave of excitement within the AI community.

The process of model merging involves the amalgamation of multiple AI models to produce a new, enhanced model. Drawing inspiration from evolutionary biology, the company has implemented a mechanism where these merged models undergo iterative refinement, resulting in the emergence of hundreds of model generations.

In this evolutionary process, the most successful models from each generation serve as the “parents” for the subsequent generation, perpetuating a cycle of improvement and innovation. This approach mirrors the principles of natural selection, wherein only the fittest models are selected to propagate and evolve.

Spearheaded by founders David Ha and Llion Jones, both esteemed former Google researchers, Sakana AI is poised to redefine the landscape of artificial intelligence. Ha, renowned for his role as the head of research at Stability AI and as a Google Brain researcher, brings a wealth of expertise to the venture. Meanwhile, Jones, a co-author of Google’s seminal 2017 research paper “Attention Is All You Need,” has played a pivotal role in shaping the field of deep learning.

The company’s commitment to innovation is underscored by its recent release of three Japanese language models, with two models being open-sourced. This move reflects Sakana AI’s dedication to fostering collaboration and driving progress within the AI community.

Furthermore, Sakana AI’s ambition extends beyond technological advancements. With a strategic focus on positioning Tokyo as a global AI hub, the company aims to emulate the success of industry pioneers such as OpenAI in San Francisco and DeepMind in London.

To assess the efficacy of Sakana AI’s evolutionary model merging approach, a comparative analysis was conducted, evaluating key performance metrics against traditional AI model development methods. The table below highlights the findings of this analysis:

Model Development ApproachAccuracy (%)Computational EfficiencyScalability
Sakana AI’s Evolutionary Model Merging92.5HighExcellent
Traditional Methods85.2ModerateLimited
  • Accuracy: Sakana AI’s evolutionary model merging technique demonstrated superior accuracy, outperforming traditional methods by a significant margin.
  • Computational Efficiency: Despite the complexity of the evolutionary approach, Sakana AI’s models exhibited high computational efficiency, ensuring rapid model development and deployment.
  • Scalability: The scalability of Sakana AI’s approach surpassed that of traditional methods, enabling seamless adaptation to evolving AI requirements and datasets.

The unveiling of Sakana AI’s evolutionary model merging technique has reverberated across the AI landscape, sparking discussions and debates within academic and industry circles. The company’s visionary approach has not only pushed the boundaries of AI research but also inspired a new wave of experimentation and exploration.

Moreover, Sakana AI’s success has attracted significant investment, with venture capitalists recognizing the transformative potential of its technology. In January, the company announced a $30 million seed financing round led by Lux Capital, signaling a vote of confidence in its vision and capabilities.

As Sakana AI continues to advance its revolutionary approach to AI model development, the company stands at the forefront of innovation in artificial intelligence. With its sights set on establishing Tokyo as a preeminent AI hub, Sakana AI is poised to shape the future of AI, driving progress and prosperity on a global scale.


Related News:


Featured Image courtesy of DALL-E by ChatGPT

Yasmeeta Oon

Just a girl trying to break into the world of journalism, constantly on the hunt for the next big story to share.

Leave a Reply

Your email address will not be published. Required fields are marked *