[ML News] New ImageNet SOTA | Uber's H3 hexagonal coordinate system | New text-image-pair dataset
0#truthfulqa #efficientnet #laion400M
Your regularly irregular updates on what's happening in the Machine Learning world.
OUTLINE:
0:00 - Intro
0:20 - TruthfulQA benchmark shines new light on GPT-3
2:00 - LAION-400M image-text-pair dataset
4:10 - GoogleAI's EfficientNetV2 and CoAtNet
6:15 - Uber's H3: A hexagonal coordinate system
7:40 - AWS NeurIPS 2021 DeepRacer Challenge
8:15 - Helpful Libraries
9:20 - State of PyTorch in September 2021
10:05 - Physics-Based Deep Learning Book
10:35 - Music-conditioned 3D dance generation
11:40 - Stallman's take on legal issues with Codex
12:20 - Tensorflow DirectML on AMD GPUs
13:00 - Schmidhuber Blog: Turing Oversold
ERRATA:
Uber's H3 is actually not new, but from 2018
References:
TruthfulQA - A benchmark assessing truthfulness of language models
https://owainevans.github.io/pdfs/truthfulQA_lin_evans.pdf
LAION-400M image-text-pair dataset
https://laion.ai/laion-400-open-dataset/
https://laion.ai/#top
https://gogetfunding.com/help-us-build-the-worlds-largest-open-billion-scale-image-text-dataset-perfect-for-training-dall-e-clip-other-multimodal-models/
https://rom1504.github.io/clip-retrieval/?back=https%3A%2F%2Fsplunk.vra.ro&index=laion_400m_128G&query=yellow+train
GooleAI releases EfficientNetV2 and CoAtNet
https://ai.googleblog.com/2021/09/toward-fast-and-accurate-neural.html
Uber's H3 hexagonal coordinate systems
https://eng.uber.com/h3/?utm_source=pocket_mylist
NeurIPS 2021 DeepRacer Challenge
https://www.aicrowd.com/challenges/neurips-2021-aws-deepracer-ai-driving-olympics-challenge?utm_source=pocket_mylist
https://aws.amazon.com/deepracer/
https://gitlab.aicrowd.com/deepracer/neurips-2021-aws-deepracer-starter-kit/-/tree/master/deepracer-gym
Helpful Libraries
https://github.com/rom1504/img2dataset
https://github.com/facebookresearch/vissl?utm_source=pocket_mylist
https://github.com/pyg-team/pytorch_geometric
https://aws.amazon.com/blogs/machine-learning/announcing-the-amazon-s3-plugin-for-pytorch/
State of PyTorch in September 2021
https://dev-discuss.pytorch.org/t/state-of-pytorch-core-september-2021-edition/332
Physics-Based Deep Learning Book
http://physicsbaseddeeplearning.org/intro.html
https://arxiv.org/pdf/2109.05237.pdf
Music Conditioned 3D dance generation
https://ai.googleblog.com/2021/09/music-conditioned-3d-dance-generation.html
Richard Stallman on Codex legal issues
https://news.slashdot.org/story/21/09/18/0432224/richard-stallman-shares-his-concerns-about-githubs-copilot----and-about-github
Tensorflow DirectML on AMD
https://wccftech.com/amd-microsoft-bring-tensorflow-directml-to-life-4x-improvement-with-rdna-2-gpus/
Schmidhuber: Turing Oversold
https://people.idsia.ch//~juergen/turing-oversold.html
Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher
Parler: https://parler.com/profile/YannicKilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/1824646584
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n