[ML News] AI models that write code (Copilot, CodeWhisperer, Pangu-Coder, etc.)

Channel:

Yannic Kilcher

Subscribers:

284,000

Published on August 10, 2022 8:55:14 PM ● Video Link: https://www.youtube.com/watch?v=_9aN1-0T8hg

Duration: 21:17

52,199 views

1,647

#mlnews #ai #copilot

OUTLINE:
0:00 - Intro
0:20 - Copilot Now Generally Available
3:20 - FOSS Org leaves GitHub
6:45 - Google's Internal ML Code Completion
9:10 - AI Trains Itself to Code Better
14:30 - Amazon CodeWhisperer in Preview
15:15 - Pangu-Coder: A New Coding Model
17:10 - Useful Things

References:
Copilot Now Generally Available
https://github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/

FOSS Org leaves GitHub
https://www.theregister.com/2022/06/30/software_freedom_conservancy_quits_github/
https://sfconservancy.org/blog/2022/jun/30/give-up-github-launch/
https://sfconservancy.org/GiveUpGitHub/
https://sfconservancy.org/docs/SupportGiveUpGitHub-README-snippet.md

Google's Internal ML Code Completion
https://ai.googleblog.com/2022/07/ml-enhanced-code-completion-improves.html

AI Trains Itself to Code Better
https://arxiv.org/abs/2207.14502
https://arxiv.org/pdf/2207.14502.pdf

Amazon CodeWhisperer in Preview
https://aws.amazon.com/blogs/aws/now-in-preview-amazon-codewhisperer-ml-powered-coding-companion/
https://aws.amazon.com/codewhisperer/
https://aws.amazon.com/codewhisperer/features/

Pangu-Coder: A New Coding Model
https://arxiv.org/abs/2207.11280
https://arxiv.org/pdf/2207.11280.pdf

Useful Things
https://github.com/qdrant/quaterion
https://github.com/facebookresearch/torchdim
https://www.mosaicml.com/blog/farewell-oom
https://github.com/hristo-vrigazov/mmap.ninja#when-do-i-use-it

Links:
Homepage: https://ykilcher.com
Merch: https://ykilcher.com/merch
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://ykilcher.com/discord
LinkedIn: https://www.linkedin.com/in/ykilcher

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannickilcher
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n