Customize Gemma with Hugging Face Transformers

Channel:

Google for Developers

Subscribers:

2,520,000

Published on April 30, 2025 11:00:25 PM ● Video Link: https://www.youtube.com/watch?v=DbwWEt32CJU

Duration: 0:00

4,793 views

175

This guide walks you through how to fine-tune Gemma on a custom text-to-sql dataset using Hugging Face Transformers and TRL.

Chapters:
00:00 - Introduction
00:34- What is Quantized Low-Rank Adaptation (QLoRA)
1:08 - Setup development environment
2:06 - Create and prepare the fine-tuning dataset
4:32 - Fine-tune Gemma using TRL and the SFTTrainer

Resources:
Fine-Tune Gemma using Hugging Face Transformers and QloRA → https://goo.gle/4jVpjjj


Subscribe to Google for Developers → https://goo.gle/developers


Speaker: Philipp Schmid
Products mentioned: Gemma