Facebook-Owner Meta Opens Access to Large Language Model for AI Research

Facebook-owner Meta Platforms Inc is opening up entry to a big language mannequin for synthetic intelligence analysis, the social media firm stated on Tuesday.

Meta stated its mannequin was the primary 175-billion-parameter language mannequin to be made out there to the broader AI analysis group.

“Large language models” are pure language processing techniques that are skilled on large volumes of textual content, and are able to answering studying comprehension questions or producing new textual content.

In a blog post, Meta stated the discharge of its “Open Pretrained Transformer (OPT-175B)” mannequin would enhance researchers’ talents to know how giant language fashions work.

Meta stated restrictions on entry to such fashions had been “hindering progress on efforts to improve their robustness and mitigate known issues such as bias and toxicity”.

Artificial intelligence expertise, which is a key space of analysis and growth for a number of main on-line platforms, can perpetuate people’ societal biases round points like race and gender. Some researchers have considerations in regards to the harms that may be unfold by means of giant language fashions.

Meta stated it “hoped to increase the diversity of voices defining the ethical considerations of such technologies.”

The tech big stated to stop misuse and “maintain integrity,” it was releasing the mannequin underneath a noncommercial license to concentrate on analysis use circumstances.

Meta stated entry to the mannequin can be granted to educational researchers and other people affiliated with authorities, civil society, and educational organisations, in addition to trade analysis laboratories. The launch will embrace the pretrained fashions and the code to coach and use them.

© Thomson Reuters 2022