News Report Technology
September 28, 2023

Meta Unveils ‘Emu’ to Improve AI Image Generation

Emu: Meta AI's Innovative Approach to Enhance Image Generation Models

Meta AI recently shared its research paper detailing a novel approach developed to enhance the generation of stickers and images within its services. The paper, titled “Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystack,” aims to demonstrate how a “quality-tuned” training method can significantly elevate the quality of image generation — even on a small dataset.

Meta’s Pre-Training Method and Model Details

The initial stage involves pre-training a diffusion model using a vast dataset comprising 1.1 billion image-text pairs from Meta AI’s internal resources. The phase relies on a U-Net model with a hefty 2.8 billion parameters. Text encoders, specifically CLIP ViT-L and T5-XXL, are used in conjunction with the model. The ultimate goal of the model is to generate an image, 1024×1024 pixels in resolution.

The model’s dataset undergoes rigorous filtering, eliminating more than 200,000 samples from a pool of over a billion examples. Multiple filters, including classifiers assessing image aesthetics, mechanisms for discarding undesirable content, optical character recognition (OCR) for excluding text-heavy images, and resolution and proportion-based filtering, are applied. Popularity metrics, such as likes, also influence the filtration process.

Related: Meta Unveils AI Integration Across Services, from Generative Emu Model to Smart Glasses

In this phase, human expertise takes center stage. Generalists, individuals possessing a comprehensive grasp of data annotation, assess the remaining 200,000 images and assemble a subset of 20,000. The primary objective here is to identify and remove significantly subpar images in case the heuristics employed in the preceding step prove inadequate.

Related: Meta Introduces 28 AI Characters and AI Studio for Expanded Creativity

Emu’s Image Generation Prowess

A team of photography specialists, highly knowledgeable in photographic principles, takes on the task of filtering and selecting images. Their goal is to identify and preserve images with the highest aesthetic quality. They meticulously consider factors such as composition, lighting, color schemes, contrasts, thematic relevance, and backgrounds.

The final touch includes the meticulous crafting of high-quality text annotations for this curated dataset of 2,000 image-text pairs.

Lastly, the model trains on this refined dataset, completing 15,000 steps with a batch size of 64. This batch size is relatively small compared to large generative models. While the model may appear overtrained based on validation loss, human evaluations indicate otherwise. A similar phenomenon has been observed in language models.

Through this orchestrated multi-stage process, Meta AI achieves high-quality image generation. This methodology not only aims to enhance the practical benefits of their services but also underscores the significance of careful curation and human expertise in refining AI-generated content. For further details, you can explore the complete article.

An example of generation for the same prompts. On the left is the model after step 1 (that is, just pretrain, without fiddling with the data), and on the right is after going through all the procedures.

Read more related topics:

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet. 

More articles
Damir Yalalov
Damir Yalalov

Damir is the team leader, product manager, and editor at Metaverse Post, covering topics such as AI/ML, AGI, LLMs, Metaverse, and Web3-related fields. His articles attract a massive audience of over a million users every month. He appears to be an expert with 10 years of experience in SEO and digital marketing. Damir has been mentioned in Mashable, Wired, Cointelegraph, The New Yorker, Inside.com, Entrepreneur, BeInCrypto, and other publications. He travels between the UAE, Turkey, Russia, and the CIS as a digital nomad. Damir earned a bachelor's degree in physics, which he believes has given him the critical thinking skills needed to be successful in the ever-changing landscape of the internet. 

Hot Stories
Join Our Newsletter.
Latest News

Web3 Fundraising Report Q3 2023: A Overview of Evolving Trends and Strategies

In this report, we explore all the trends in the AI, crypto and web3 sectors and identify ...

Know More

Virtual Reality Superior Than Video Conferencing for Remote Work Collaboration: PWC Report

In today’s modern era of remote work, the traditional landscape of digital meetings and workshops is undergoing ...

Know More
Join Our Innovative Tech Community
Read More
Read more
Chainlink (LINK) Announces Stacking Mechanism v0.2 Upgrade to Improve Network Functionality
Markets News Report
Chainlink (LINK) Announces Stacking Mechanism v0.2 Upgrade to Improve Network Functionality
November 30, 2023
Seraph Studio Launches ARPG Web3 Game ‘SERAPH: In The Darkness’ on Arbitrum One
Business News Report
Seraph Studio Launches ARPG Web3 Game ‘SERAPH: In The Darkness’ on Arbitrum One
November 30, 2023
NASA and IBM Partner to Develop Geospatial AI for Weather Prediction
News Report Technology
NASA and IBM Partner to Develop Geospatial AI for Weather Prediction
November 30, 2023
AntPool to Refund Record $3 Million Bitcoin Transaction Fee After User Error
News Report
AntPool to Refund Record $3 Million Bitcoin Transaction Fee After User Error
November 30, 2023
What You
Need to Know

Subscribe To Our Newsletter.
Daily search marketing tidbits for savvy pros.