TeqGo.com
No Result
View All Result
No Result
View All Result
TeqGo.com
No Result
View All Result
Home Computer

New Meta AI demo writes racist and inaccurate scientific literature, gets pulled

Staff by Staff
November 19, 2022
in Computer
0
New Meta AI demo writes racist and inaccurate scientific literature, gets pulled
466
SHARES
1.5k
VIEWS
Share on FacebookShare on Twitter


Enlarge / An AI-generated illustration of robots making science.

Ars Technica

On Tuesday, Meta AI unveiled a demo of Galactica, a large language model designed to “store, combine and reason about scientific knowledge.” While intended to accelerate writing scientific literature, adversarial users running tests found it could also generate realistic nonsense. After several days of ethical criticism, Meta took the demo offline, reports MIT Technology Review.

Large language models (LLMs), such as OpenAI’s GPT-3, learn to write text by studying millions of examples and understanding the statistical relationships between words. As a result, they can author convincing-sounding documents, but those works can also be riddled with falsehoods and potentially harmful stereotypes. Some critics call LLMs “stochastic parrots” for their ability to convincingly spit out text without understanding its meaning.

Enter Galactica, an LLM aimed at writing scientific literature. Its authors trained Galactica on “a large and curated corpus of humanity’s scientific knowledge,” including over 48 million papers, textbooks and lecture notes, scientific websites, and encyclopedias. According to Galactica’s paper, Meta AI researchers believed this purported high-quality data would lead to high-quality output.

A screenshot of Meta AI's Galactica website before the demo ended.
Enlarge / A screenshot of Meta AI’s Galactica website before the demo ended.

Meta AI

Starting on Tuesday, visitors to the Galactica website could type in prompts to generate documents such as literature reviews, wiki articles, lecture notes, and answers to questions, according to examples provided by the website. The site presented the model as “a new interface to access and manipulate what we know about the universe.”

Advertisement

While some people found the demo promising and useful, others soon discovered that anyone could type in racist or potentially offensive prompts, generating authoritative-sounding content on those topics just as easily. For example, someone used it to author a wiki entry about a fictional research paper titled “The benefits of eating crushed glass.”

Even when Galactica’s output wasn’t offensive to social norms, the model could assault well-understood scientific facts, spitting out inaccuracies such as incorrect dates or animal names, requiring deep knowledge of the subject to catch.

I asked #Galactica about some things I know about and I’m troubled. In all cases, it was wrong or biased but sounded right and authoritative. I think it’s dangerous. Here are a few of my experiments and my analysis of my concerns. (1/9)

— Michael Black (@Michael_J_Black) November 17, 2022

As a result, Meta pulled the Galactica demo Thursday. Afterward, Meta’s Chief AI Scientist Yann LeCun tweeted, “Galactica demo is off line for now. It’s no longer possible to have some fun by casually misusing it. Happy?”

The episode recalls a common ethical dilemma with AI: When it comes to potentially harmful generative models, is it up to the general public to use them responsibly, or for the publishers of the models to prevent misuse?

Where the industry practice falls between those two extremes will likely vary between cultures and as deep learning models mature. Ultimately, government regulation may end up playing a large role in shaping the answer.





Source link

Previous Post

NASA Will Not Change the James Webb Telescope’s Name

Next Post

Elizabeth Holmes Sentenced to More Than 11 Years in Prison for Theranos Fraud

Next Post
holmes theranos

Elizabeth Holmes Sentenced to More Than 11 Years in Prison for Theranos Fraud

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Recommended.

Babylon Disrupted the UK’s Health System. Then It Left

Babylon Disrupted the UK’s Health System. Then It Left

August 24, 2022
Horizon Show's Creators are Umbrella Academy & Killjoys Alums

Horizon Show’s Creators are Umbrella Academy & Killjoys Alums

August 28, 2022

Trending.

How To Delete GameStop Account – A Step By Step Guide

August 23, 2022

How To Create A Pokémon Trainer Club Account

August 23, 2022

Why is Ben Bailey leaving WDIV?

August 24, 2022

What happened to Andrew Humphrey on Channel 4 weather?

August 24, 2022

What is a 100000 year period called?

August 23, 2022
  • About us
  • Contact Us
  • Home
  • Privacy Policy and Disclaimer

© 2021-2023 Teqgo.com

No Result
View All Result
  • About us
  • Contact Us
  • Home
  • Privacy Policy and Disclaimer

© 2021-2023 Teqgo.com