[ML News] ConvNeXt: Convolutions return | China regulates algorithms | Saliency cropping examined

Subscribers:
284,000
Published on ● Video Link: https://www.youtube.com/watch?v=yVKiMh2vEWQ



Duration: 18:37
37,356 views
1,718


#mlnews #convnext #mt3

Your update on what's new in the Machine Learning world!

OUTLINE:
0:00 - Intro
0:15 - ConvNeXt: Return of the Convolutions
2:50 - Investigating Saliency Cropping Algorithms
9:40 - YourTTS: SOTA zero-shot Text-to-Speech
10:40 - MT3: Multi-Track Music Transcription
11:35 - China regulates addictive algorithms
13:00 - A collection of Deep Learning interview questions & solutions
13:35 - Helpful Things
16:05 - AlphaZero explained blog post
16:45 - Ru-DOLPH: HyperModal Text-to-Image-to-Text model
17:45 - Google AI 2021 Review

References:
ConvNeXt: Return of the Convolutions
https://arxiv.org/abs/2201.03545
https://github.com/facebookresearch/ConvNeXt
https://twitter.com/giffmana/status/1481054929573888005
https://twitter.com/wightmanr/status/1481150080765739009
https://twitter.com/tanmingxing/status/1481362887272636417

Investigating Saliency Cropping Algorithms
https://openaccess.thecvf.com/content/WACV2022/papers/Birhane_Auditing_Saliency_Cropping_Algorithms_WACV_2022_paper.pdf
https://vinayprabhu.github.io/Saliency_Image_Cropping/paper_html/main.html
https://vinayprabhu.medium.com/on-the-twitter-cropping-controversy-critique-clarifications-and-comments-7ac66154f687
https://vinayprabhu.github.io/Saliency_Image_Cropping/

YourTTS: SOTA zero-shot Text-to-Speech
https://github.com/coqui-ai/TTS?utm_source=pocket_mylist
https://arxiv.org/abs/2112.02418?utm_source=pocket_mylist
https://coqui.ai/?utm_source=pocket_mylist
https://coqui.ai/blog/tts/yourtts-zero-shot-text-synthesis-low-resource-languages

MT3: Multi-Track Music Transcription
https://arxiv.org/abs/2111.03017
https://github.com/magenta/mt3
https://huggingface.co/spaces/akhaliq/MT3
https://www.reddit.com/r/MachineLearning/comments/rtlx0r/r_mt3_multitask_multitrack_music_transcription/

China regulates addictive algorithms
https://technode.com/2022/01/05/china-issues-new-rules-to-regulate-algorithms-targeting-addiction-monopolies-and-overspending/
https://qz.com/2109618/china-reveals-new-algorithm-rules-to-weaken-platforms-control-of-users/

A collection of Deep Learning interview questions & solutions
https://arxiv.org/abs/2201.00650?utm_source=pocket_mylist
https://arxiv.org/pdf/2201.00650.pdf

Helpful Things
https://docs.deepchecks.com/en/stable/index.html
https://github.com/deepchecks/deepchecks
https://docs.deepchecks.com/en/stable/examples/guides/quickstart_in_5_minutes.html
https://www.dagshub.com/
https://www.dagshub.com/docs/index.html
https://www.dagshub.com/blog/launching-dagshub-2-0/
https://bayesiancomputationbook.com/welcome.html
https://mlcontests.com/
https://github.com/Yard1/ray-skorch
https://github.com/skorch-dev/skorch
https://www.rumbledb.org/?utm_source=pocket_mylist
https://github.com/DarshanDeshpande/jax-models
https://github.com/s3prl/s3prl

AlphaZero explained blog post
https://joshvarty.github.io/AlphaZero/?utm_source=pocket_mylist

Ru-DOLPH: HyperModal Text-to-Image-to-Text model
https://github.com/sberbank-ai/ru-dolph
https://colab.research.google.com/drive/1gmTDA13u709OXiAeXWGm7sPixRhEJCga?usp=sharing

Google AI 2021 Review
https://ai.googleblog.com/2022/01/google-research-themes-from-2021-and.html

Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yannic-kilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n




Other Videos By Yannic Kilcher


2022-02-17CM3: A Causal Masked Multimodal Model of the Internet (Paper Explained w/ Author Interview)
2022-02-16AI against Censorship: Genetic Algorithms, The Geneva Project, ML in Security, and more!
2022-02-15HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learning (w/ Author)
2022-02-10[ML News] DeepMind AlphaCode | OpenAI math prover | Meta battles harmful content with AI
2022-02-08Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents (+Author)
2022-02-07OpenAI Embeddings (and Controversy?!)
2022-02-06Unsupervised Brain Models - How does Deep Learning inform Neuroscience? (w/ Patrick Mineault)
2022-02-04GPT-NeoX-20B - Open-Source huge language model by EleutherAI (Interview w/ co-founder Connor Leahy)
2022-01-29Predicting the rules behind - Deep Symbolic Regression for Recurrent Sequences (w/ author interview)
2022-01-27IT ARRIVED! YouTube sent me a package. (also: Limited Time Merch Deal)
2022-01-25[ML News] ConvNeXt: Convolutions return | China regulates algorithms | Saliency cropping examined
2022-01-21Dynamic Inference with Neural Interpreters (w/ author interview)
2022-01-19Noether Networks: Meta-Learning Useful Conserved Quantities (w/ the authors)
2022-01-11This Team won the Minecraft RL BASALT Challenge! (Paper Explanation & Interview with the authors)
2022-01-05Full Self-Driving is HARD! Analyzing Elon Musk re: Tesla Autopilot on Lex Fridman's Podcast
2022-01-02Player of Games: All the games, one algorithm! (w/ author Martin Schmid)
2021-12-30ML News Live! (Dec 30, 2021) Anonymous user RIPS Tensorflw | AI prosecutors rising | Penny Challenge
2021-12-28GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
2021-12-27Machine Learning Holidays Live Stream
2021-12-26Machine Learning Holiday Live Stream
2021-12-24[ML News] AI learns to search the Internet | Drawings come to life | New ML journal launches



Tags:
deep learning
machine learning
arxiv
explained
neural networks
ai
artificial intelligence
paper
deep learning tutorial
deep learning ai
deep learning projects
mlnews
ml news
kilcher news
salicency cropping
twitter cropping
image cropping
twitter image cropping
convnext
facebook research
meta research
meta ai
convolutional neural networks
cnns vs transformers
mt3
yourtts
text to speech
ai for music
china regulation
china algorithms
china ai