News Report Technology
May 03, 2023

Carnegie Mellon Researchers Present MLC LLM for Running Language Models on Any Device

Carnegie Mellon University researchers have presented MLC LLM, a set of tools that could revolutionize how language models are run on any device. Such models allow users to create a range of natural language applications, such as virtual assistants and smart chatbots. Through separate performance optimizations, MLC LLM can now be used on different platforms and scenarios.

Carnegie Mellon Researchers Present MLC LLM for Running Language Models on Any Device
@Midjourney / Peerapon#6116
Read more: 10 Best Universities to Study Artificial Intelligence

The new tool, known as Web LLM, is also part of this initiative. It allows for the launch of language models directly in the browser, meaning users don’t have to manually download the system, which can be several gigabytes in size. The Vicuna 7B model, which has 7 billion parameters, has been created this way. This can be extremely useful when designing more fitting virtual assistants and chatbots as they require large amounts of parameters.

Using MLC LLM and Web LLM, it is now possible to deploy any language model of choice on any device. The researchers at Carnegie Mellon have reported that this would open up a range of applications that weren’t possible before. Any language model can now be deployed on various computing devices, such as laptops and phones, or even processors and video accelerators. This opens up a world of possibilities for natural language processing and machine learning.

The new initiative from Carnegie Mellon paves the way for a range of new applications and usages for natural language understanding. As you can use these language models on any device, it is much easier to deploy such technology in many different scenarios. Whether it’s for virtual assistants or automated customer service, this new tool could have a drastic impact on the way these tasks are done.

Carnegie Mellon’s research team developed MLC LLM to be run on any device, including iPhones and other smart home devices, with a modern processor and 6GB or more of RAM. This streamlined approach means that devices can now run language models with almost real-time generation speed, even when optimized by external developers and not Apple engineers.

In addition to allowing for natural interactions with products, MLC LLM can also be used to optimize device management tasks. With only 4GB to 6GB of RAM needed to run, this revolutionary language model will make an excellent addition to future iPhone models and could potentially be rolled into production without the lengthy development process.

By introducing the MLC LLM language model, Carnegie Mellon researchers have created an efficient and robust way to run language models on any device. The MLC LLM system is a breakthrough in natural language processing and will enable users to interact naturally with their devices more effectively. It also has the potential to significantly speed up the development process for future device management tasks. The possibilities are endless with MLC LLM, and Carnegie Mellon’s work will surely transform the way we think about language models for the better.

Read more about AI:

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet. 

More articles
Damir Yalalov
Damir Yalalov

Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet. 

Hot Stories
Join Our Newsletter.
Latest News

Supply and Demand Zones

Cryptocurrency, like any other currency, is a financial instrument based on the fundamental economic principles of supply ...

Know More

Top 10 Crypto Wallets in 2024

With the current fast-growing crypto market, the significance of reliable and secure wallet solutions cannot be emphasized ...

Know More
Join Our Innovative Tech Community
Read More
Read more
Binance Executive Tigran Gambaryan Files Lawsuit Against Nigerian Government
Business News Report
Binance Executive Tigran Gambaryan Files Lawsuit Against Nigerian Government
March 29, 2024
FTX’s Meteoric Ascent and Crash. Inside Sam Bankman-Fried’s Ambitious Venture
Stories and Reviews Technology
FTX’s Meteoric Ascent and Crash. Inside Sam Bankman-Fried’s Ambitious Venture
March 29, 2024
Binance Unveils Launchpool Project Ethena for BNB, FDUSD and TUSD Staking
News Report Technology
Binance Unveils Launchpool Project Ethena for BNB, FDUSD and TUSD Staking
March 29, 2024
Parcl Unveils Tokenomics Ahead of PRCL Launch, Allocates 75M Tokens to Point Holders
News Report Technology
Parcl Unveils Tokenomics Ahead of PRCL Launch, Allocates 75M Tokens to Point Holders
March 28, 2024
What You
Need to Know

Subscribe To Our Newsletter.
Daily search marketing tidbits for savvy pros.