Chinese Teams Have Made Iron Man's JARVIS AI a Reality

Science Express April 03, 2023

In today's world, we heavily rely on specialized AIs to solve complex problems such as content generation, image or voice recognition, and decision-making. However, for tasks such as video production, we often require a team of AIs, with a human captain to manage them. But what if we had a deputy to assist with the managerial work? Enter HuggingGPT, a system jointly developed by researchers from Zhejiang University and Microsoft Research Asia in Shanghai.

HuggingGPT uses large language models (LLMs) like ChatGPT to connect various AI models in machine learning communities (such as HuggingFace) to solve complicated AI tasks. It uses language as a generic interface to manage existing AI models and solve tasks in different domains and modalities, such as language, vision, speech, and others. By leveraging the strong language capability of ChatGPT and the abundant AI models in HuggingFace, HuggingGPT can cover numerous sophisticated AI tasks and achieve impressive results.