Understanding AI #1 - Series Introduction + What Is GPT In ChatGPT? (links in description)
7Welcome to my new series called Understaing AI where I research and talk about various topics within Artificial Intelligence.
In this first episode I talk a little bit about my own exposure to AI and then get on to this weeks question, what is GPT in ChatGPT?
Here are the links to what I found out about in the episode, for the term, Generative pre-trained transformer
Wikipedia Article on Generative pre-trained transformer - https://en.wikipedia.org/wiki/Generative_pre-trained_transformer
A Mathematical Theory of Communication - https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf
Improving Language Understanding by Generative Pre-Training - https://cdn.openai.com/research-covers/language-unsupervised/language_understanding_paper.pdf
GENERATIVE AND DISCRIMINATIVE CLASSIFIERS: NAIVE BAYES AND LOGISTIC REGRESSION - https://www.cs.cmu.edu/~tom/mlbook/NBayesLogReg.pdf
On Discriminative vs. Genrative classifiers http://robotics.stanford.edu/~ang/papers/nips01-discriminativegenerative.pdf
Discrimanative, Genrative and Imitative Learning - https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.7.513&rep=rep1&type=pdf
Attention Is All You Need - https://arxiv.org/pdf/1706.03762.pdf
Additional Wikipedia API Generated Reserach Terms
For search term = Generative pre-trained transformer (performed on 2023-03-10 12:00:51)
Chatbot
Language model
Feature learning
OpenAI
Transformer (machine learning model)
BERT (language model)
GPT-3
GPT-2
DALL-E
Self-supervised learning