Hugging Face Models with Ishi

Hugging Face hosts thousands of open-source models. Use the Inference API to access them with Ishi.

Why Hugging Face?

• Model Variety — Thousands of fine-tuned models
• Open Source — Transparent, auditable models
• Specialized Models — Domain-specific fine-tunes
• Free Tier — Rate-limited free access

Setup

{
  "provider": "huggingface",
  "model": "meta-llama/Meta-Llama-3.1-70B-Instruct"
}

---

Get started: Download Ishi | HF Docs