GPT4ALL on AMD 6800u - Speed & answer comparison - mpt vs. gpt4all - 7b vs. 13b [Linix]

Channel:
Subscribers:
817
Published on ● Video Link: https://www.youtube.com/watch?v=esyldfBZiXc



Duration: 12:07
1,058 views
33


This is my second video running GPT4ALL on the GPD Win Max 2.
This time I do a short live demo of different models, so you can compare the execution speed and output quality of those models.
It is only a short test, as it is sufficient to demonstrate execution speed.
Output quality varies a lot depending on model, prompt and question. Also new models will come frequently, so the results would be outdated very soon anyways.

GPT4ALL in an easy to install AI based chat bot.
It works on Windows and Linux.
In this demo, we are running Linux. For Windows, see my other Video.

------------
Links:

GPT4ALL website: https://gpt4all.io/index.html
GPT4ALL Git: https://github.com/nomic-ai/gpt4all
GPT4ALL Discord: https://discord.gg/MexcSdVytv
Interview with founder: https://github.com/nomic-ai/gpt4all

Help me and subscribe: https://www.youtube.com/channel/UCjLMAxvG4CxOqVfai_JhnLQ?sub_confirmation=1

------------

Timestamps:

00:00 - Introduction
00:56 - Overview of the models in this comparison
02:30 - Question 1: Psychology (Post Error Slowing)
04:37 - Question 2: Story about Mage & Knight
07:12 - Question 3: Programming, C++ - Raw pointer vs. Smart pointer
09:46 - conclusion & personal opinion




Other Videos By Mystechry


2023-08-13GPD Win Max 2 - 7840u vs. 6800u - Low end efficiency test in games [800p,30fps]
2023-08-06GPD Win Max 2 2023 refresh - A not so refreshing story - First week experience
2023-07-30Sengoku Basara 4 Sumeragi - Inscriptions English version [v. 0.85]
2023-07-23More Storage - Integrate external storage via Symbolic Links [All handhelds: GPD, Steam Deck, All]
2023-07-09GPD Win Max 2 - Teardown (bottom) + Mouse-Gamepad switch repair
2023-06-25GPD Win Max 2 - Space bar disassembly/repair tutorial
2023-06-18GPD Win Max 2 - Keyboard swap the easy way - Get any layout you want - [No disassembly]
2023-06-10More battery life and efficiency for your handheld [auto-performance] [GPD Win Max 2/ Win 4/AYA Neo]
2023-05-29Sengoku Basara 4: Sumeragi - Skills English [Part 5] [v0.85]
2023-05-20GPD G1 vs One Dock - Overview & size comparison [No GPU, A2000 & RTX 3060 TI mini mounted]
2023-05-13GPT4ALL on AMD 6800u - Speed & answer comparison - mpt vs. gpt4all - 7b vs. 13b [Linix]
2023-05-06GPT4ALL on AMD 6800u - Local Chat GPT alternative on a handheld computer [Linux & Windows]
2023-05-01Sengoku Basara 4: Sumeragi - Skills English [Part 4] [v0.85]
2023-04-23GPD G1 - Bad news!!! - Price too high & - bad port placement
2023-04-16GPD G1 vs. Nvidia Pocket AI - Round 1 - [Size & specs] [Portable GPU]
2023-04-10Sengoku Basara 4: Sumeragi - Skills English [Part 3] [v0.85]
2023-04-01What a fun toy - IIIF150 B1 Pro - Great addition to my GPD Win Max 2
2023-03-18Sengoku Basara 4: Sumeragi - Skills English [Part 2] [v0.85]
2023-03-12You will not see this elsewhere - GPD Win Max 2: Prototype vs final unit
2023-03-04Sengoku Basara 4 Sumeragi - English - Skills Part 1- [v0.85] [2023]
2023-02-25AMD 6800u - tdp/fps/cpu/gpu/battery overlay [GPD Win Max 4, GPD Win 4, Aya Neo, OneXPlayer]



Tags:
GPD
WIN Max 2
GPT
GPT4ALL
ChatGPT
GPT4ALL-j
Handheld
llama
LLM
Vicuna
OpenAI
Steam Deck
mpt