Fine Tuning Guide
Fine tuning 9 Models in 18 minutes
Last updated
Fine tuning 9 Models in 18 minutes
Last updated
Kiln makes it easy to fine-tune a wide variety of models like GPT-4o, Llama, Mistral, Gemma, and many more.
In this guide we'll be walking through an example where we start from scratch, and build 9 fine-tuned models in just under 18 minutes of active work, not counting time waiting for training and data-gen.
No coding is necessary, and our UI will guide you through the process. Step 6 is optional, and requires some basic python skills. Our open-source python library is available for advanced users.
You can follow this guide to create your own LLM fine-tunes. We'll cover:
A Demo Project:
[2 mins]:
[9 mins]: : create 920 high-quality examples for training
[5 mins]: Dispatch 9 fine tuning jobs: (Llama 3.2 1b/3b/11b, Llama 3.1 8b/70b, Mixtral 8x7b), (GPT 4o, 4o-Mini), and (Llama 3.2 1b/3b). Note: since this guide was written we've added over 60 new models for fine tuning!
[2 mins]:
Analysis:
: evaluation, exporting models, iteration and data strategies
First, we’ll need to define what the models should do. In Kiln we call this a “task definition”. Create a new task in the Kiln UI to get started, including a initial prompt, requirements, and input/output schema.
For this demo we'll make a task that generates news article headlines of various styles, given a summary of a news topic.
To fine tune, you’ll need a dataset to learn from.
Kiln includes topic trees to generate diverse content, a range of models/prompting strategies, interactive guidance and interactive UI for curation/correction.
When generating synthetic data you want to generate the best quality content possible. Don’t worry about cost and performance at this stage. Use large high quality models, detailed prompts with multi-shot prompting, chain of thought, and anything else that improves quality. You’ll be able to address performance and costs in later steps with fine tuning.
Kiln supports over 60 fine-tuneable models using three different service based tuning providers:
Open AI: GPT 4o and 4o-mini
Together AI: Llama 3.1 8b/70b, Llama 3.2 1b/3b, Qwen2.5 14b/72b
For this experiment we choose 9 model to expriment with.
Use the "Fine Tune" tab in the Kiln UI to kick off your fine-tunes. Simply select the models you want to train, select a dataset, and add any training parameters.
We recommend setting aside a test and validation set when creating your dataset split. This will allow you to evaluate your fine-tunes after they are complete.
Kiln will automatically deploy your fine-tunes when they are complete. You can use them from the Kiln UI without any additional configuration. Simply select a fine-tune by name from the model dropdown in the "Run" tab.
Together, Fireworks and OpenAI tunes are deployed "serverless". You only pay by for usage (tokens), with no recurring costs.
You can use your models outside of Kiln by calling Fireworks or OpenAI APIs with the model ID from the "Fine Tune" tab.
Early Results: Our fine-tuned models show some immediate promise. Previously models smaller than Llama 70b failed to produce the correct structured data for our task. After fine tuning even the smallest model, Llama 3.2 1b, consistently works.
Kiln can also export your dataset to common formats for fine tuning on your own infrastructure. Simply select one of the "Download" options when creating your fine tune, and use the exported JSONL file to train with your own tools.
Unsloth Example
Export your dataset using the "Hugging Face chat template (JSONL)" option for compatibility with the demo notebook.
Kiln can generate the training format needed by Google's Vertext AI to fine tune Gemini models.
Our demo use case was quite reasonably priced.
Training Data Generation
OpenRouter
$2.06
Fine-tuning 5x Llama models + Mixtral
Fireworks
$1.47
Fine-tuning GPT-4o Mini
OpenAI
$2.03
Fine-tuning GPT-4o
OpenAI
$16.91
Fine-tuning Llama 3.2 (1b & 3b)
Unsloth on Google Colab T4
$0.00
If it wasn't for GPT-4o, the whole project would have cost less than $6!
Meanwhile our fastest fine-tune (Llama 3.2 1b) is about 10x faster and 150x cheaper than the models we used during synthetic data generation (source:OpenRouter perf stats & prices).
What’s next after fine tuning?
We now have 9 fine-tuned models, but which is best for our task? We should evaluate them for quality/speed/cost tradeoffs.
You can export your models for use on your machine, deployment to the cloud, or embedding in your product.
OpenAI: sadly OpenAI won’t let you download their models.
Models and products are rarely perfect on their first try. When you find bugs or have new goals, Kiln makes it easy to build new models. Some ways to iterate:
Experiment with different base-models
Experiment with fine-tuning hyperparameters (see the "Advanced Options" section of the UI)
Experiment with shorter training prompts, which can reduce costs
Regenerate fine-tunes as your dataset grows and evolves
Try new foundation models (directly and with fine tuning) when new state of the art models are released.
Kiln enables a "Ladder" data strategy: the steps start from from small quantity and high effort, and progress to high quantity and low effort. Each step builds on the prior:
~10 manual high quality examples.
~30 LLM generated examples using the prior examples for multi-shot prompting. Use expensive models, detailed prompts, and token-heavy techniques (chain of thought). Manually review each ensuring low quality examples are not used as samples.
~1000 synthetically generated examples, using the prior content for multi-shot prompting. Again, using expensive models, detailed prompts and chain of thought. Some interactive sanity checking as we go, but less manual review once we have confidence in the prompt and quality.
1M+: after fine-tuning on our 1000 sample set, most inference happens on our fine-tuned model. This model is faster and cheaper than the models we used for building it through zero shot prompting, shorter prompts, and smaller models.
Like a ladder, skipping a step is dangerous. You need to make sure you’re solid before you continue to the next step.
Kiln offers a interactive UI for quickly and easily building synthetic datasets. In the video below we use it to generate 920 training examples in 9 minutes of hands-on work. See our for more details.
Fireworks.ai: over 60 open weight models including Qwen 2.5, Llama 2/3.x, Deepseek V3/R1, QwQ, and more. See the .
Kiln can train a reasoning model. See the guide on .
We currently recommend and Axolotl. These platforms let you train almost any open model, including Gemma, Mistral, Llama, Qwen, Smol, and .
See this example , which has been modified to load a dataset file exported from Kiln. You can use it to fine-tune locally or in Google Colab.
Select the Vertex AI/Gemini option in the dropdown, to download training/validation files in the appriopiate format. Then follow the Google's fine-tuning , using the files from Kiln as you training/validation sets.
Kiln supports tracking training metrics with the tool . Configure your W&B API key in Settings > AI Providers & Models > Weights & Biases before starting your fine-tuning job. Metrics will appear for any training jobs on Fireworks or Together. OpenAI doesn't support W&B, but provides similar metrics in their own dashboard, which is linked from the Kiln Fine Tune page.
Kiln has to help you though this process. Check out the for details.
If your task is deterministic (classification), Kiln AI will provide the validation set to OpenAI or Together during tuning, and they will report val_loss on their dashboard. For non-deterministic tasks (including generative tasks) you can use our to evaluate quality.
Fireworks: you can in Hugging Face PEFT format, and convert as needed.
Together: you can , run locally or convert as needed.
Unsloth: your fine-tunes can be directly export to GGUF or other formats which make these model easy to deploy. A GGUF can be for local use. Once added to Ollama, the models will become available in Kiln UI as well.
For one-off bugs you encounter use Kiln to “” the issues. These get added to your training data for future iterations.
For recurring bugs/patterns, use to generate many samples of common bugs, ensure they have correct responses with , and add the results to the training set to prevent this class of issues in the future.
Rate your dataset using Kiln’s , then build fine-tunes using only highly rated content.
Kiln can be used entirely through the UI and doesn't require coding. However, if you'd like a code-based integration, our open-source is available. You can dispatch fine-tune jobs and call fine-tuned models through our library without the UI if you prefer.
