Business News Report
August 10, 2023

Futureverse Unveils JEN-1: Revolutionary AI Model for Real-time Text-to-Music Generation

Futureverse's New AI Model Can Generate Music in Real Time

Futureverse, an AI and metaverse technology and content company, has announced the launch of JEN-1, a new AI model for text-to-music generation. JEN-1 is a significant advancement in music AI, as it is the first model to achieve state-of-the-art performance in text-music alignment and music quality while maintaining computational efficiency.

“We extensively evaluate JEN-1 against state-of-the-art baselines across objective metrics and human evaluations. Results demonstrate JEN-1 produces music of perceptually higher quality (85.7/100) compared to the current best methods (83.8/100),” Futureverse wrote.

Creating music from text is difficult because of the intricate nature of musical arrangements and the need for a high sampling rate. According to Futureverse’s paper, JEN-1 can overcome these challenges as its diffusion model is based on autoregressive and non-autoregressive training. This allows JEN-1 to generate music that is realistic and creative.

Because of its computational efficiency, it is possible to use JEN-1 to generate music in real-time, which opens up new possibilities for music production, live performance, and virtual reality.

The AI model uses a special autoencoder and diffusion model to directly produce detailed stereo audio at a high sampling rate of 48kHz. Moreover, JEN-1 avoids the usual quality loss when converting audio features. The model is trained in multiple tasks, including generating music, continuing music sequences, and filling in missing parts, making it versatile.

JEN-1 also cleverly combines autoregressive and non-autoregressive methods to balance the trade-off between capturing dependencies in music and generating it efficiently. In addition, the AI model employs smart learning techniques and is trained to handle various musical aspects at once. 

JEN-1 Versus MusicLM, MusicGen, and Other AI Models

Futureverse compares JEN-1 with the current state-of-the-art models, such as MusicLM from Google and MusicGen from Meta, and demonstrates that its approach produces better results in fidelity and realism.

The evaluation was based on the performance of different models on the MusicCaps test set, which is a dataset of music and text pairs. Futureverse used both quantitative and qualitative measures to evaluate the models. Quantitative measures included the FAD (Fidelity-Awareness-Disentanglement) score and the CLAP (Continuity-and-Local-Anomaly-Penalties) score. Qualitative measures included human assessments of the quality and alignment of the generated music.

The results showed that JEN-1 outperformed the other models on quantitative and qualitative measures. JEN-1 had the highest FAD and CLAP scores and received the highest scores from human assessors. In addition, JEN-1 was more computationally efficient than the other models, with only 22.6% of the parameters of MusicGen and 57.7% of the parameters of Noise2Music.

JEN-1 is a sign of the growing potential of AI in the music industry. AI is already used to create music, but JEN-1 is a significant step forward. It is the first model to achieve state-of-the-art performance on both quantitative and qualitative measures, and it is also more computationally efficient than previous models.

Read more:

Disclaimer

Any data, text, or other content on this page is provided as general market information and not as investment advice. Past performance is not necessarily an indicator of future results.


The Trust Project is a worldwide group of news organizations working to establish transparency standards.

Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in Literary Studies from the University of Amsterdam and has an extensive background in writing about a wide range of topics including cybersecurity, travel, art, and culture. She has also volunteered as an editor for the animal rights organization, “Open Cages,” where she helped raise awareness about animal welfare issues. Currently, Agne splits her time between Barcelona, Spain, and Vilnius, Lithuania, where she continues to pursue her passion for journalism. Contact her on [email protected].

More articles
Agne Cimermanaite
Agne Cimermanaite

Agne is a journalist who covers the latest trends and developments in the metaverse, AI, and Web3 industries for the Metaverse Post. Her passion for storytelling has led her to conduct numerous interviews with experts in these fields, always seeking to uncover exciting and engaging stories. Agne holds a Bachelor’s degree in Literary Studies from the University of Amsterdam and has an extensive background in writing about a wide range of topics including cybersecurity, travel, art, and culture. She has also volunteered as an editor for the animal rights organization, “Open Cages,” where she helped raise awareness about animal welfare issues. Currently, Agne splits her time between Barcelona, Spain, and Vilnius, Lithuania, where she continues to pursue her passion for journalism. Contact her on [email protected].

Hot Stories
Join Our Newsletter.
Latest News

20 Most Underrated AI Startups in 2023: Ranked by Funding

AI remains a constant focal point for investors and entrepreneurs alike. While the spotlight often falls on ...

Know More

Ranked: Top 10 Countries by Estimated AI Contribution to Economy by 2030

AI stands at the cusp of a transformative era, poised to reshape virtually every sector and ignite ...

Know More
Join Our Innovative Tech Community

Read More

Read more
Justin Sun Announces 5,000 ETH Hack at HTX, Assures Full Coverage of Losses
Markets News Report
Justin Sun Announces 5,000 ETH Hack at HTX, Assures Full Coverage of Losses
September 25, 2023
Mitsubishi UFJ Trust Bank Partners with Binance Japan to Advance Stablecoin Adoption 
Markets News Report
Mitsubishi UFJ Trust Bank Partners with Binance Japan to Advance Stablecoin Adoption 
September 25, 2023
Mystiko.Network Unveils First Privacy Solution for L2 on Base Mainnet
News Report Technology
Mystiko.Network Unveils First Privacy Solution for L2 on Base Mainnet
September 25, 2023
OpenAI’s ChatGPT Unveils Major Upgrade, Adds Voice Conversation and Image Chat
News Report Technology
OpenAI’s ChatGPT Unveils Major Upgrade, Adds Voice Conversation and Image Chat
September 25, 2023
What You
Need to Know

Subscribe To Our Newsletter.
Daily search marketing tidbits for savvy pros.