Chinese Lab Build the World Largest Model and Challenges Google… and the western as a whole.
The Beijing Academy of Artificial Intelligence (BAAI), AKA OpenAI of China, recently launched the latest version of Wudao, a pre-trained deep learning model that is called “the world largest model ever”. The model has an incredible 1.75, wait for it…. TRILLION parameters. But how big is it really? Well, the model is 10 times bigger than the OpenAI GPT-3 model which, until now, has the title of the best model for language generation tasks.
Another feature of Wudao is that the model was built and trained to tackle multi-modal problems, text, and image at the same time, two very different realms for the current deep learning models. At BAAI Wudao demonstrated performing tasks such as natural language processing, text generation, image recognition, and image generation.
Generally, deep learning architectures are built to be highly specialized in one set of problems per time, like Convolutional Neural Networks for images and Recurrent Neural Networks for text. Because of that, multi-modal models (which can tackle multiple problems at once) are gaining popularity in the AI field as they are seen as an important step towards AGI.
At BAAI, they believe that AGI can be achieved with big models (or a massive quantity of parameters) and big computers (literally big computers). This makes me wonder… What’s the next step of EUA (and west in general) to face the emergence of China’s AI supremacy?
THE BLOG
News, lessons, and content from our companies and projects.
41% of small businesses that employ people are operated by women.
We’ve been talking to several startups in the past two weeks! This is a curated list of the top 5 based on the analysis made by our models using the data we collected. This is as fresh as ...
Porto Seguro Challenge – 2nd Place Solution
We are pleased to announce that we got second place in the Porto Seguro Challenge, a competition organized by the largest insurance company in Brazil. Porto Seguro challenged us to build an ...
Predicting Reading Level of Texts – A Kaggle NLP Competition
Introduction: One of the main fields of AI is Natural Language Processing and its applications in the real world. Here on Amalgam.ai we are building different models to solve some of the problems ...
Porto Seguro Challenge
Introduction: In the modern world the competition for marketing space is fierce, nowadays every company that wants the slight advantage needs AI to select the best customers and increase the ROI ...
Sales Development Representative
At Exponential Ventures, we’re working to solve big problems with exponential technologies such as Artificial Intelligence, Quantum Computing, Digital Fabrication, Human-Machine ...
Exponential Hiring Process
The hiring process is a fundamental part of any company, it is the first contact of the professional with the culture and a great display of how things work internally. At Exponential Ventures it ...
Exponential Ventures annonce l’acquisition de PyJobs, FrontJobs et RecrutaDev
Fondé en 2017, PyJobs est devenu l’un des sites d’emploi les plus populaires du Brésil pour la communauté Python. Malgré sa croissance agressive au cours de la dernière année, ...
Exponential Ventures announces the acquisition of PyJobs, FrontJobs, and RecrutaDev
Founded in 2017, PyJobs has become one of Brazil’s most popular job boards for the Python community. Despite its aggressive growth in the past year, PyJobs retained its community-oriented ...
Sales Executive
At Exponential Ventures, we’re working to solve big problems with exponential technologies such as Artificial Intelligence, Quantum Computing, Digital Fabrication, Human-Machine ...
What is a Startup Studio?
Spoiler: it is NOT an Incubator or Accelerator I have probably interviewed a few hundred professionals in my career as an Entrepreneur. After breaking the ice, one of the first things I do is ask ...
Social Media
At Exponential Ventures, we’re working to solve big problems with exponential technologies such as Artificial Intelligence, Quantum Computing, Digital Fabrication, Human-Machine ...
Hunting for Unicorns
Everybody loves unicorns, right? But perhaps no one loves them more than tech companies. When hiring for a professional, we have an ideal vision of who we are looking for. A professional with X ...
Stay In The Loop!
Receive updates and news about XNV and our child companies. Don't worry, we don't SPAM. Ever.