ai-gateway

Build AI gateway services for routing and managing LLM requests. Use when implementing API proxies, rate limiting, or multi-provider AI services.

Stars 163

Forks 31

Install this agent skill to your Project

npx add-skill https://github.com/majiayu000/claude-skill-registry/tree/main/skills/development/ai-gateway

SKILL.md

AI Gateway Provider Switching Skill

Multi-provider AI configuration for Cloodle platform.

Trigger

AI provider configuration
Model switching requests
API key setup

Supported Providers

Local (Ollama/LM Studio)

env

AI_PROVIDER=ollama
OLLAMA_BASE_URL=http://localhost:11434
OLLAMA_MODEL=llama3.2

Anthropic (Sonnet/Haiku)

env

AI_PROVIDER=anthropic
ANTHROPIC_API_KEY=sk-ant-...
ANTHROPIC_MODEL=claude-sonnet-4-20250514

HuggingFace (GPT-OSS)

env

AI_PROVIDER=huggingface
HF_API_KEY=hf_...
HF_MODEL=gpt-oss-20b

Provider Switching Logic

python

def get_llm():
    provider = os.getenv("AI_PROVIDER", "ollama")

    if provider == "ollama":
        from langchain_ollama import ChatOllama
        return ChatOllama(
            base_url=os.getenv("OLLAMA_BASE_URL"),
            model=os.getenv("OLLAMA_MODEL", "llama3.2")
        )
    elif provider == "anthropic":
        from langchain_anthropic import ChatAnthropic
        return ChatAnthropic(
            model=os.getenv("ANTHROPIC_MODEL")
        )
    elif provider == "huggingface":
        from langchain_huggingface import HuggingFaceEndpoint
        return HuggingFaceEndpoint(
            repo_id=os.getenv("HF_MODEL")
        )

Model Recommendations

Use Case	Provider	Model
Development	Ollama	llama3.2
Production Chat	Anthropic	claude-sonnet
Cost Sensitive	HuggingFace	gpt-oss-20b
High Quality	Anthropic	claude-opus

Environment File Location

/opt/cloodle/tools/ai/multi_agent_rag_system/.env

Test Provider

bash

curl http://localhost:11434/api/tags  # Ollama