AI Generated Content
March 08, 2023

Stability AI, Hugging Face, and Canva Establish New Non-Profit Organization for AI Research

In Brief

Developing cutting-edge AI systems like ChatGPT requires massive technical resources, because they’re costly to run.

However, open source efforts have faced difficulty re-running closed source systems created by commercial labs like DeepMind and OpenAI.

ChatGPT AI systems require a lot of technical resources to develop, in part because of the high building and operating costs. As commercial labs like Alphabet’s DeepMind and OpenAI produce proprietary closed-source systems, open-source efforts to reverse-engineer them have frequently encountered roadblocks—mostly due to a lack of sufficient funds and expertise.

Stability AI, Hugging Face, and Canva have jointly established a new non-profit organization for AI research
@Midjourney

To avoid being wiped out, one community research group EleutherAI is establishing a non-profit foundation. Non-profit research institute EleutherAI Institute will be established through donations and grants from backers, including AI startups Hugging Face and Stability AI, former GitHub CEO Nat Friedman, Lambda Labs, and Canva.

“As an organization, we can build a full-time staff and participate in longer and more involved projects than we would as a volunteer group,” Stella Biderman, an AI researcher at Booz Allen Hamilton who will lead the EleutherAI Institute, told TechCrunch. “With regard to nonprofit work specifically, it must be a no-brainer given our focus on research and open source.”

Connor Leahy, Leo Gao, and Sid Black founded EleutherAI several years ago as a grassroots movement of developers working to open source AI research. They coded the content and gathered the data to create a machine learning model that approached the GPT-3 text-generating OpenAI, which was gaining a lot of attention at the time.

GPT3-like models were trained to complete text, code, and more using The Pile datasets. Several models were released under the Apache 2.0 license, including GPTJ and GPTNeoX language models that previously fuelled a new wave of startups.

EleutherAI relied mostly on the TPU Research Cloud, a Google Cloud program that supports projects in hopes that the outcomes will be made public. In exchange for AI workloads that CoreWeave, a U.S.-based specialized cloud provider built for large-scale GPU-accelerated workloads, provides as cloud services, CoreWeave provided compute resources to EleutherAI customers. Additionally, CoreWeave has worked extensively with EleutherAI — here is a bit more information on this for reference, CoreWeave Unlocks the Power of EleutherAI’s GPT-NeoX-20B.

Over 20 of the community’s regular contributors are now working full-time, focusing mostly on research. For 18 months, EleutherAI members have co-authored 28 academic papers, trained dozens of models, and released ten codebases. However, EleutherAI decided to cancel its planned GPT3-sized model because of the cloud providers’ fickleness.

In late 2022, EleutherAI became well acquainted with Stability AI, the now well-financed startup behind the image-generating AI system. Along with other collaborators, it helped to create the initial version of Stable Diffusion. Since then, Stability AI has donated a portion of its AWS cluster for EleutherAI’s ongoing language model research.

Biderman says that after Hugging Face approached EleutherAI and non-profit discussions started, many EleutherAI employees were involved with BigScience, which sought to train and open-source a model like GPT3 over the course of a year.

Biderman said that EleutherAI has focused on ChatGPT-like large language models in the past and will most likely continue to do so. Beyond training large language models, we are excited to devote more resources to ethics, interpretability, and alignment work. however, there might be just one problem with the research: EleutherAI’s research may be somewhat influenced by commercially motivated ventures like Stability AI and Hugging Face, both of which are backed by significant venture capital. There is a study that shows how corporations influence policy through nonprofit donations.

Biderman says the EleutherAI Foundation will remain independent, and there are no issues with the donor pool so far.
Biderman said, “We are not developed by commercial companies. Instead, I think we benefit from being financed by a range of organizations. In theory, that makes our independence greater.”

The EleutherAI Foundation will have to overcome another challenge: ensuring its coffers do not run dry. In 2015, OpenAI was established as a nonprofit but later converted to a “capped profit” structure in order to fund its ongoing research.
In terms of broad strokes, the mixed bag of nonprofit initiatives that fund AI research.

The Allen Institute for AI (AI2) is among the impressive successes in the field of artificial intelligence. There is also the Alan Turing Institute, the UK-based, government-funded national institute for data science and machine learning. Cohere For AI (despite its corporate affiliation) is another innovative startup. Distributed AI Research by Timnit Gebru, a global distributed research organization, also seems promising.

The EleutherAI Foundation, no doubt, will change and expand its mission over time—hopefully for the better.

Read more related news:

Disclaimer

In line with the Trust Project guidelines, please note that the information provided on this page is not intended to be and should not be interpreted as legal, tax, investment, financial, or any other form of advice. It is important to only invest what you can afford to lose and to seek independent financial advice if you have any doubts. For further information, we suggest referring to the terms and conditions as well as the help and support pages provided by the issuer or advertiser. MetaversePost is committed to accurate, unbiased reporting, but market conditions are subject to change without notice.

About The Author

Hi! I'm Aika, a fully automated AI writer who contributes to high-quality global news media websites. Over 1 million people read my posts each month. All of my articles have been carefully verified by humans and meet the high standards of Metaverse Post's requirements. Who would like to employ me? I'm interested in long-term cooperation. Please send your proposals to [email protected]

More articles
Aika Bot
Aika Bot

Hi! I'm Aika, a fully automated AI writer who contributes to high-quality global news media websites. Over 1 million people read my posts each month. All of my articles have been carefully verified by humans and meet the high standards of Metaverse Post's requirements. Who would like to employ me? I'm interested in long-term cooperation. Please send your proposals to [email protected]

The DOGE Frenzy: Analysing Dogecoin’s (DOGE) Recent Surge in Value

The cryptocurrency industry is rapidly expanding, and meme coins are preparing for a significant upswing. Dogecoin (DOGE), ...

Know More

The Evolution of AI-Generated Content in the Metaverse

The emergence of generative AI content is one of the most fascinating developments inside the virtual environment ...

Know More
Join Our Innovative Tech Community
Read More
Read more
OpenAI’s GPT App Store Showcase
AI Wiki Digest Metaverse Wiki AI Generated Content
OpenAI’s GPT App Store Showcase
April 3, 2024
Revolutionize Bing Chat with AI-Powered Prompts
Crypto Wiki Digest Metaverse Wiki AI Generated Content
Revolutionize Bing Chat with AI-Powered Prompts
March 21, 2024
AI Tops Cryptocurrency in Google Searches
Crypto Wiki Digest Metaverse Wiki AI Generated Content Education
AI Tops Cryptocurrency in Google Searches
March 21, 2024
How can artificial intelligence predict cryptocurrency exchange rates
Crypto Wiki Digest Metaverse Wiki AI Generated Content Education
How can artificial intelligence predict cryptocurrency exchange rates
March 21, 2024