[ML News] This AI completes Wikipedia! Meta AI Sphere | Google Minerva | GPT-3 writes a paper

Channel:

Yannic Kilcher

Subscribers:

284,000

Published on July 31, 2022 1:33:13 PM ● Video Link: https://www.youtube.com/watch?v=xnChXNUNS2A

Duration: 17:18

33,781 views

1,374

#mlnews #ai #minerva

This episode is all about models that reason.

OUTLINE:
0:00 - Intro
0:35 - Meta AI learns Wikipedia citations
5:25 - Google's Minerva solves math problems by reading papers
9:10 - GPT-3 writes a paper on itself
13:35 - Jürgen Schmidhuber prompts LeCun for missing citations

References:
Meta AI learns Wikipedia citations
https://tech.fb.com/artificial-intelligence/2022/07/how-ai-could-help-make-wikipedia-entries-more-accurate/
https://ai.facebook.com/blog/introducing-sphere-meta-ais-web-scale-corpus-for-better-knowledge-intensive-nlp/?d=%7B%22u%22%3A100051861999022%2C%22f%22%3A207799259245384%2C%22t%22%3A1658664021%2C%22ed%22%3A[]%7D&s=AWVELTip1y4HowJprXc
https://github.com/facebookresearch/sphere
https://github.com/facebookresearch/side
https://verifier.sideeditor.com/main
https://openreview.net/forum?id=qfTqRtkDbWZ

Google's Minerva solves math problems by reading papers
https://minerva-demo.github.io/#category=Precalculus&index=9
https://ai.googleblog.com/2022/06/minerva-solving-quantitative-reasoning.html

GPT-3 writes a paper on itself
https://www.scientificamerican.com/article/we-asked-gpt-3-to-write-an-academic-paper-about-itself-then-we-tried-to-get-it-published/
https://hal.archives-ouvertes.fr/hal-03701250v1
https://hal.archives-ouvertes.fr/hal-03701250/document

Jürgen Schmidhuber prompts LeCun for missing citations
https://people.idsia.ch/~juergen/lecun-rehash-1990-2022.html

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n