I used Stable Diffusion to turn all of GTA V's sound effects into music

Channel:
Jake Kaufman
Subscribers:
8,210
Published on ● Video Link: https://www.youtube.com/watch?v=kyNXvEiGdno


Grand Theft Auto V
Game:
Grand Theft Auto V (2013)
Duration: 1:28
2,850 views
171

(Warning: Ragdoll Injuries!)
The soundtrack you're hearing is not coming from the radio in GTA. Each track was generated from a text prompt, using only the regular sound effects and VO from each clip. For example, the first one uses the prompt, "A classic 1984 hard rock track with a ton of attitude, this band went out on top! CD remaster"... and from this, the model shapes all the SFX, even the motorcycle engine, into parts of the song I described.

I'm using Riffusion to do style transfers in general, and I wrote up some notes here: http://github.com/virtjk/neurochip -- it's pretty much the same concept as turning stick figures into anime whatevers. But for sound.

(Don't worry, I'm still doing my own music the old-fashioned way, WITH NO PLANS TO RETIRE)



Other Videos By Jake Kaufman


2024-02-23[Scooter Jam] Chill Circuit
2023-06-13Tears of the Kingdom - Vehicle Fight Theme
2023-03-23Tamiko - Neural music re-rendering (plus some explanation!)
2023-03-05I used Stable Diffusion to turn all of GTA V's sound effects into music
2022-09-11PIRATE STREET JAMMING (Ballona to Marina Del Rey Scootamathon!)
2022-09-05Scooter Trip 2 (Ride Along) - Santa Monica, Del Rey, Ballona Creek
2022-08-27Scooter Jams - Trip to the Beach
2022-07-14I made my Otamatone sing!!
2022-06-25Oberheim Base
2022-02-15Metro City Course (PC Engine / TurboGrafx-16)
2022-02-11Laser Camp (Game Boy + PC Engine)
2021-12-22Calamari Inkantation (Splatoon) - Bambootracker test (OPNA / YM2608)
2021-09-03Factorio Music System V1
2021-08-31Auto-tamatone (Playing in car.... w/ glitched audio)
2021-08-25NEW OTAMATONE!!! Jazz/funk practice session
2021-08-25Auto-tamatone: Playing in my car!
2021-07-29Otamatone Practice: FF6
2021-07-26Otama Jazz Highlights, Week Infinity
2021-05-27Otamatone Practice: Jazz Time
2021-05-26Otamatone Practice: Playing Plague of Shadows, First Attempt
2021-05-18Sun and the Breeze


Other Statistics

Grand Theft Auto V Statistics For Jake Kaufman

There are 2,850 views in 1 video for Grand Theft Auto V. Less than an hour worth of Grand Theft Auto V videos were uploaded to his channel, less than 0.27% of the total video content that Jake Kaufman has uploaded to YouTube.