News Report Technology
February 24, 2023

Meta Releases LLaMA: A State-of-the-Art Foundational Language Model for AI Research

meta llama

Meta has released a new large language model called LLaMA (Large Language Model Meta AI) to support AI researchers. The model will enable more people in the research community to study language models and provide easier access to this important field.

LLaMA is available in several sizes (7B, 13B, 33B, and 65B parameters). By training smaller foundation models like LLaMA, researchers can use less computing power and resources to test new approaches and explore new use cases. Meta wrote that LLaMA is ideal for fine-tuning a variety of tasks as it trains on a large set of unlabeled data. Meta claims to be committed to responsible AI practices and shares a LLAMA model card that details how the model was built.

To develop LLaMA, Meta selected texts from the 20 most widely spoken languages, focusing on languages that use Latin and Cyrillic alphabets. This large language model generates text by taking a sequence of words as input and predicting the next word recursively, similar to other models in this category.

“As a foundation model, LLaMA is designed to be versatile and can be applied to many different use cases, versus a fine-tuned model that is designed for a specific task. By sharing the code for LLaMA, other researchers can more easily test new approaches to limiting or eliminating these problems in large language models,”

Meta wrote.

The company admits it still needs to address the risks of bias, toxic comments, and hallucinations in large language models, including LLaMA.

Meta is releasing the model under a noncommercial license focused on research use cases “to maintain integrity and prevent misuse.” Individuals and organizations seeking access to the model will be evaluated on a case-by-case basis. Eligible parties include academic researchers, government and civil society organizations, and industry research laboratories worldwide.

You can read an entire paper on LLaMA here. If eligible, you can also apply to test the language model.

Read more:

Tags:

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on [email protected].

More articles
Agne Cimerman
Agne Cimerman

Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in literature and has an extensive background in writing about a wide range of topics including travel, art, and culture. She has also volunteered as an editor for the animal rights organization, where she helped raise awareness about animal welfare issues. Contact her on [email protected].

Hot Stories
Join Our Newsletter.
Latest News

Web3 Fundraising Report Q3 2023: A Overview of Evolving Trends and Strategies

In this report, we explore all the trends in the AI, crypto and web3 sectors and identify ...

Know More

Virtual Reality Superior Than Video Conferencing for Remote Work Collaboration: PWC Report

In today’s modern era of remote work, the traditional landscape of digital meetings and workshops is undergoing ...

Know More
Join Our Innovative Tech Community
Read More
Read more
Microsoft will Invest $3.2 Billion in UK to Boost AI Development
News Report Technology
Microsoft will Invest $3.2 Billion in UK to Boost AI Development
December 1, 2023
Suspected Crypto Whale Amassed $187 Million in Diverse Binance Assets
Business Markets News Report
Suspected Crypto Whale Amassed $187 Million in Diverse Binance Assets
December 1, 2023
Kognitos Raises $20 Million for Generative AI-powered Business Automation Platform
News Report Technology
Kognitos Raises $20 Million for Generative AI-powered Business Automation Platform
December 1, 2023
KyberSwap Hacker Demands Extraordinary Control for $47 Million Theft Recovery
Markets News Report
KyberSwap Hacker Demands Extraordinary Control for $47 Million Theft Recovery
December 1, 2023
What You
Need to Know

Subscribe To Our Newsletter.
Daily search marketing tidbits for savvy pros.