AI text generation speed example

Channel:
Romania Exiton
Subscribers:
364
Published on ● Video Link: https://www.youtube.com/watch?v=xNF-T3J2_F0


Duration: 3:40
13 views
0

Oobabooga running Nethena 23B GPTQ model.

It certainly looks like AI text generation came a long way in term of speed compared to the project's last year example.    • AI character dream text generation sp...  

Same project, same hardware, marginally more complex model. Ability to order the model to continue from where it stopped, or to prompt it to continue without any user input is a very welcome addition.

(When looking at the stats take into account that the screen is being recorded by the same GPU.)

P. S. I may have come up with a bit unconventional scenario for the model in an effort to make the example more entertaining.



Other Videos By Exiton


2024-07-19Cyberpunk 2077: Appreciation
2024-07-19Fallout 4: The inadvertent killing of Geneva
2024-06-10Cyberpunk 2077: City exploration
2024-06-10Cyberpunk 2077: NCPD brutality
2024-05-09Elite Dangerous: Some very lazy PvE
2024-05-09Elite Dangerous: Using SCO FSD in Mamba
2024-05-09Elite Dangerous: Alien attack on megaship in Deciat
2024-05-09Elite Dangerous: Using SCO FSD in Corvette
2024-04-10Cyberpunk 2077: Gruesome story of banana and butter bears
2024-04-10Cyberpunk 2077: Dogshit AI, lack of persistence and total disconnect from the rest of the world
2024-02-16AI text generation speed example
2024-01-10Cyberpunk 2077 v. 2.1: Secret ending
2024-01-10Cyberpunk 2077 v. 2.1: Rogue ending
2024-01-06Cyberpunk 2077: NCPD brutality
2024-01-04Cyberpunk 2077 v. 2.1 Katana build fights on its own
2024-01-04Experimental content: footage of today's pigeons :)
2023-12-26Cyberpunk 2077: Ambushed convoy and unlucky salesman world events
2023-12-26Cyberpunk 2077: Poison Ivy Dogtown hidden boss
2023-12-26Cyberpunk 2077: The saddest and yet the most realistic encounter in the entire game
2023-12-26Cyberpunk 2077: Might as well jump world event
2023-12-26Cyberpunk 2077: He was too old for this