homelab-configs/litellm-models-update.md

LiteLLM Models Update - Complete Latest API Support

Date: April 25, 2026
Update Type: Configuration expansion
Action Required: Replace /opt/litellm/config/litellm_config.yaml on docker-server

---

📊 Before vs After

Previous Configuration (10 models)

• OpenAI: 3 models
• Claude: 4 models
• Gemini: 3 models

Updated Configuration (16 models) ✨

• OpenAI: 5 models (+2)
• Claude: 6 models (+2)
• Gemini: 5 models (+2)

---

🆕 New Models Added

OpenAI (+2 Models)

• ✨ gpt-4o - Latest omni model (vision + text, multimodal)
• ✨ gpt-4o-mini - Faster, cheaper variant of GPT-4o
• Kept: gpt-4-turbo, gpt-4, gpt-3.5-turbo

Anthropic Claude (+2 Models)

• ✨ claude-3.5-sonnet - Latest Claude, best performance/cost ratio
• ✨ claude-opus-4 - Next-gen flagship model
• Kept: claude-3-opus, claude-3-sonnet, claude-3-haiku, claude-2.1

Google Gemini (+2 Models)

• ✨ gemini-2.0-flash - Latest, ultra-fast with vision
• ✨ gemini-2.0-pro - Latest pro variant
• Kept: gemini-1.5-pro, gemini-1.5-flash, gemini-pro

---

🚀 How to Update

Option 1: Copy File via SCP (Easiest)

# From your local machine:
scp /path/to/litellm_config_updated.yaml jgitta@192.168.88.27:/opt/litellm/config/litellm_config.yaml

# Then restart:
ssh jgitta@192.168.88.27 "cd /opt/litellm && docker-compose restart"

Option 2: SSH and Edit

ssh jgitta@192.168.88.27
cd /opt/litellm/config
nano litellm_config.yaml
# Replace entire contents with the updated config
# Ctrl+X, Y, Enter to save
cd ..
docker-compose restart

Option 3: Copy-Paste the File

1. Open litellm_config_updated.yaml in your editor
2. SSH to docker-server: ssh jgitta@192.168.88.27
3. Edit the config: nano /opt/litellm/config/litellm_config.yaml
4. Select all (Ctrl+A), paste the new content
5. Save (Ctrl+X, Y, Enter)
6. Restart: docker-compose restart

---

✅ Verify the Update

After restarting, all 16 models should be available:

curl http://192.168.88.27:4000/models \
  -H "Authorization: Bearer litellm-local-key-change-in-production" | jq '.data | length'

Should return: 16

List all models:

curl http://192.168.88.27:4000/models \
  -H "Authorization: Bearer litellm-local-key-change-in-production" | jq '.data[].id'

Expected output:

"gpt-4o"
"gpt-4o-mini"
"gpt-4-turbo"
"gpt-4"
"gpt-3.5-turbo"
"claude-3.5-sonnet"
"claude-opus-4"
"claude-3-opus"
"claude-3-sonnet"
"claude-3-haiku"
"claude-2.1"
"gemini-2.0-flash"
"gemini-2.0-pro"
"gemini-1.5-pro"
"gemini-1.5-flash"
"gemini-pro"

---

📝 What Changed in the Config

Model Names (Full Anthropic IDs)

The config now uses the full model identifiers from each provider:

OpenAI Format

model: openai/gpt-4o

Anthropic Format

model: claude/claude-3-5-sonnet-20241022
model: claude/claude-opus-4-1-20250805

Google Format

model: google/gemini-2.0-flash
model: google/gemini-2.0-pro

This ensures LiteLLM routes to the correct model versions.

---

🔑 API Keys Remain the Same

All new models use the same API keys:

• OpenAI: OPENAI_API_KEY (sk-...)
• Claude: ANTHROPIC_API_KEY (sk-ant-...)
• Gemini: GOOGLE_API_KEY (...)

No new credentials needed — same providers, newer models!

---

📋 Model Capability Comparison

Best for Coding

• gpt-4o or claude-3.5-sonnet

Best for Vision/Multimodal

• gpt-4o (native multimodal)
• gemini-2.0-flash (native multimodal)

Best for Cost Efficiency

• gpt-4o-mini (fastest, cheapest)
• gemini-1.5-flash (fast, low cost)
• claude-3.5-sonnet (best balance)

Most Powerful

• claude-opus-4 (most advanced reasoning)
• gpt-4o (best overall)
• gemini-2.0-pro (next-gen pro variant)

Fastest

• gemini-2.0-flash (ultra-fast)
• gpt-4o-mini (fast, cheap)
• gemini-1.5-flash (fast)

---

🔄 Rollback (If Needed)

If something goes wrong, your old config is here:
/opt/litellm/config/litellm_config.yaml.backup (if you made one)

Or simply restore from git if pushed to Gitea.

---

✨ Next Steps

1. Update the config file using one of the methods above
2. Restart LiteLLM: docker-compose restart
3. Verify all 16 models load: curl http://192.168.88.27:4000/models ...
4. Test with your real API keys
5. Update any VM scripts to use new models as needed

---

Files Provided:

• litellm_config_updated.yaml - Ready to copy to docker-server