Use Bitsandbytes on Windows

Channel:
IMJONEZZ
Subscribers:
825
Published on ● Video Link: https://www.youtube.com/watch?v=MKDl1fd_ETs


Duration: 2:08
1,280 views
19

bitsandbytes-windows makes the basic functionality work, but that doesn't mean it will just work out of the box! Sorry!

Here are the 2 changes you need to make to allow loading in int8 and int4 (eventually)



Other Videos By IMJONEZZ


2025-02-19Helldivers 2 Tribute
2024-12-03Just a dumb meme about extraction
2024-03-03How it feels getting your NG+ character ready for the DLC
2024-02-05Create a ChatGPT server on a Raspberry Pi
2023-12-04Star Wars: Jedi Survivor - Reveal all Uncollected Upgrades
2023-12-01Use Bitsandbytes on Windows
2023-11-27Star Wars: Jedi Survivor - How to get into those 2 houses in Rambler's Reach
2023-11-05Make your own video game with AI: Emrys Quest (Hackathon Presentation)
2023-09-20Star Wars: Jedi Survivor - Why you should go to the abandoned shack asap
2023-09-13Star Wars: Jedi Survivor - What's inside that creepy camera building on Koboh?
2023-07-14Star Wars: Jedi Survivor - Taming the Trontoshell (What's that big dinosaur for?)
2023-07-07Star Wars: Jedi Survivor - Who is Vashtan Wolfe and what is he guarding?
2023-06-30Star Wars: Jedi Survivor - How to lift the ship and Recruit the Pit Droid
2023-06-23Star Wars: Jedi Survivor - What's behind the suspicious door on Coruscant?
2023-05-04Hogwarts Legacy: Unlock all 3 Secrets of Hogwarts
2023-03-18Run ChatGPT on a Raspberry Pi (not really, it's Alpaca)
2023-02-14Hogwars Legacy: Unforgivable Curses are not missable
2023-02-14Hogwarts Legacy: What do the Daedulus keys unlock?
2023-02-06High on Life is bananas
2022-12-01This video is fake: Stable Diffusion Level 5 - Textual Inversion & Dreambooth
2022-11-27Home alone 2