Category:

Tutorial

Duration: 8:40

566 views

5

A time-lapse video of hours spent troubleshooting, trial and error, trying to set up OpenAI on my desktop PC. What is frustrating about it is that some or few of the line-by-line instructions don't always work when applied, at least on my system. The main issue was the missing mention of GIT, which was not clearly emphasized or included in the instructions. Once I was able to isolate and resolve this portion, I encountered more errors that surfaced, and I had to use another AI program (ChatGPT) to help me troubleshoot (a bit ironic, I know ;)...

My personal opinion on this OpenAI variant, the 'H2oGPOT' - It's like having my very own HAL 9000 or TARS (the sarcastically funny bullshit robot in the movie Interstellar).

PRO:
When it comes to usable applications that you would actually use on a daily basis, and not just shelfware, it's good, and I like it. It lives up to its promise of being portable, and it runs great on fast GPUs. The H2oGPT is an excellent training tool. And, of course, anything, especially free software that can help you, is always a big welcome. Having your own island (not part of the internet) with R2-D2 on it is really not bad at all.

CON:
Needs to work on the clarity of Install instructions.

1) Git should be a requisite.
2) AMD or Nvidia? If Nvidia is the choice at 3:05, it should state that it's for users with AMD GPUs, rather than being an open option. I install anything optional (the more the merrier, right?). However, running this was a red flag since it threw an error.
3) Once the installation is completed - a how-to on relaunching it would be nice.

My Reason for Portability:

1.) I don't want to be part of the collective [Borg], where all data I add is automatically contributed to the cloud (other people's PCs - Big Brother's Network).

2.) I want to use it as a portable system in my very own sandbox, where I have total control over what I teach it and what I will allow it to know.

3.) I want to utilize it as my workplace 'Helpfile' or work environment database, where I can add my daily tasks, access certain company procedures and how-tos to assist me with my job, including passwords.

I will post another video as soon as I iron out the process and maybe find a way to install it more efficiently, (without the time-consuming tinkering.)

My next try is probably to get it up on a VMWare Windows 10 container (so far, not progressing, as some of the Windows pre-requisites needed will not install on VMWare - Microsoft Edge WebView). Anyway, it will be interesting to see if it works in the future (or when I find a work-around), being truly internet-free... Fingers crossed

OpenAI Version: h2oai/h2ogpt-gm-oasst1-en-2048-falcon-40b-v2]
Running on Nvidia GPU/ 3080 CUDA.

My PC Spec:
CPU: AMD Ryzen 9 5950X
GPU: Nvidia RTX 3080
Mainboard: ASUS ROG Dark Hero
64 GB DDR4 memory
OS: Windows 11

Music credit:
Paul Ruskay - Homeworld (1999) Original Soundtrack (Remaster)


---------------------



“The only thing necessary for the triumph of evil is for good men to do nothing.” Martin Luther King Jr.