[ML Olds] Meta Research Supercluster | OpenAI GPT-Instruct | Google LaMDA | Drones fight Pigeons
503#mlnews #rsc #gpt3
Some things we've missed in recent weeks!
OUTLINE:
0:00 - Intro & Overview
0:40 - Meta builds AI Research Supercluster (RSC)
2:25 - OpenAI trains GPT-3 to follow instructions
4:10 - Meta AI releases multilingual language models
4:50 - Google LaMDA dialogue models
5:50 - Helpful Things
8:25 - Training the alpha matte generator for Pixel 6
10:15 - Drones used to deter pigeons on buildings
11:05 - IBM sells some Watson Health assets for USD 1B
Merch: http://store.ykilcher.com
References:
https://ai.facebook.com/blog/ai-rsc/?utm_source=pocket_mylist
https://openai.com/blog/instruction-following/
https://cdn.openai.com/papers/Training_language_models_to_follow_instructions_with_human_feedback.pdf
https://openai.com/blog/deep-reinforcement-learning-from-human-preferences/
https://twitter.com/MetaAI/status/1486745968372551686?utm_source=pocket_mylist
https://arxiv.org/pdf/2112.10668.pdf
https://github.com/pytorch/fairseq/tree/main/examples/xglm
https://ai.googleblog.com/2022/01/lamda-towards-safe-grounded-and-high.html?m=1&utm_source=pocket_mylist
https://arxiv.org/pdf/2201.08239.pdf
https://evolutiongym.github.io/?utm_source=pocket_mylist
https://evolutiongym.github.io/all-tasks
https://evolutiongym.github.io/documentation
https://arxiv.org/pdf/2201.09863.pdf
https://github.com/EvolutionGym
https://huggingface.co/blog/sb3
https://twitter.com/Sentdex/status/1489991413005787139
https://github.com/lvwerra/trl?utm_source=pocket_mylist
https://ai.googleblog.com/2022/01/accurate-alpha-matting-for-portrait.html
https://polyhaven.com/hdris
https://ieeexplore.ieee.org/document/9656717
https://www.bloomberg.com/news/articles/2022-01-21/ibm-is-said-to-near-sale-of-watson-health-to-francisco-partners
https://archive.ph/xadf9
Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/2017636191
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n