[ML News] Google introduces Pathways | OpenAI solves Math Problems | Meta goes First Person
0#pathways #mlnews #ego4d
Your irregular dose of Machine Learning News.
OUTLINE:
0:00 - Intro
0:20 - Sponsor: Weights & Biases
2:10 - Google Introduces Pathways AI Architecture
6:30 - OpenAI trains Language Models to do High School Math
8:25 - Sam Altman says Neural Networks truly learn
9:35 - Google AI researchers frustrated with lawyers
12:10 - DeepMind RL Lecture Series 2021
12:40 - Fashion Store sells Adversarial Patches
13:15 - A viable method to remove the GIL from CPython
15:05 - BigScience Workshop releases T0
17:40 - Huggingface Hub Dataset Viewer
18:10 - Scite classifies scientific citations
19:25 - Facebook AI Ego4D dataset & challenges
21:50 - Tesla Dojo Configurable Floating Point Spec
23:10 - Windows releases PyTorch-DirectML for Deep Learning on DirectX GPUs
23:50 - Helpful Things
33:00 - Traders use ML to analyze CEOs' language
34:20 - Cadbury creates DeepFake ads for local Indian businesses
35:25 - This Shoe Does Not Exist
Sponsor: Weights & Biases
https://wandb.com
References:
Google Introduces Pathways AI Architecture
https://blog.google/technology/ai/introducing-pathways-next-generation-ai-architecture/?utm_source=pocket_mylist
OpenAI trains Language Models to do High School Math
https://openai.com/blog/grade-school-math/
https://arxiv.org/abs/2110.14168
Sam Altman says Neural Networks truly learn
https://twitter.com/sama/status/1450857134648823809?s=09&t=KazQPHo6Epn0M6ihs4DqHg&utm_source=pocket_mylist
Google AI researchers frustrated with lawyers
https://archive.ph/lsQJJ#selection-2855.0-2855.294
DeepMind RL Lecture Series 2021
https://deepmind.com/learning-resources/reinforcement-learning-series-2021
Fashion Store sells Adversarial Patches
https://twitter.com/naotokui/status/1450673712722702340
A viable method to remove the GIL from CPython
https://lwn.net/Articles/872869/
BigScience Workshop releases T0
https://bigscience.huggingface.co/
https://arxiv.org/abs/2110.08207
https://huggingface.co/bigscience/T0pp
Huggingface Hub Dataset Viewer
https://twitter.com/huggingface/status/1454079471154257923
Scite classifies scientific citations
https://scite.ai
https://direct.mit.edu/qss/article/doi/10.1162/qss_a_00146/102990/scite-A-smart-citation-index-that-displays-the
Facebook AI Ego4D dataset & challenges
https://ai.facebook.com/blog/teaching-ai-to-perceive-the-world-through-your-eyes
Tesla Dojo Configurable Floating Point Spec
https://tesla-cdn.thron.com/static/SBY4B9_tesla-dojo-technology_OPNZ0M.pdf?xseo=&response-content-disposition=inline%3Bfilename%3D%22tesla-dojo-technology.pdf%22
Windows releases PyTorch-DirectML for Deep Learning on DirectX GPUs
https://devblogs.microsoft.com/windowsai/introducing-pytorch-directml-train-your-machine-learning-models-on-any-gpu/
Helpful Things
https://github.com/achaiah/pywick?utm_source=pocket_mylist
https://github.com/orybkin/lexa-benchmark?utm_source=pocket_mylist
https://orybkin.github.io/lexa/
https://twitter.com/danijarh/status/1438137568688807942?utm_source=pocket_mylist
https://github.com/RobertTLange/mle-hyperopt
https://keras.io/examples/vision/mobilevit/?utm_source=pocket_mylist
https://twitter.com/osanseviero/status/1451929248231563265?utm_source=pocket_mylist
https://huggingface.co/spaces/flax-community/image-captioning
https://huggingface.co/transformers/master/model_doc/visionencoderdecoder.html
https://github.com/facebookresearch/bitsandbytes
https://arxiv.org/abs/2110.11216
https://arxiv.org/pdf/2110.11216.pdf
https://github.com/facebookresearch/xformers
https://superbbenchmark.org/
https://arxiv.org/abs/2110.07731
https://github.com/BaguaSys/bagua?utm_source=pocket_mylist
https://github.com/cgarciae/treex
https://jax.readthedocs.io/en/latest/pytrees.html
Traders use ML to analyze CEOs' language
https://www.reuters.com/technology/ai-can-see-through-you-ceos-language-under-machine-microscope-2021-10-20/
Cadbury creates DeepFake ads for local Indian businesses
https://www.bgr.in/entertainment/shah-rukh-khan-not-just-a-cadbury-ad-twitter-diwali-celebration-1016913/
This Shoe Does Not Exist
https://www.thisshoedoesnotexist.com/
Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
Parler: https://parler.com/profile/YannicKilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/1824646584
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher