LLM API integration platform - AI tools

LiteLLM is a comprehensive LLM gateway solution that provides unified API management, authentication, load balancing, and spend tracking across multiple LLM providers including Azure OpenAI, Vertex AI, Bedrock, and OpenAI.

• Freemium

Astra Platform is a universal API designed to enhance Large Language Models (LLMs) with function calling capabilities, enabling seamless integration with over 2,200 applications.

• Contact for Pricing

Interlify seamlessly connects your existing APIs to Large Language Models (LLMs), enabling rapid integration and development of AI-powered features without complex coding.

• Freemium
• From 25$

Laminar is an open-source platform that enables developers to trace, evaluate, label, and analyze Large Language Model (LLM) applications with minimal code integration.

• Freemium
• From 25$

LiteLLM provides a simplified and standardized way to interact with over 100 large language models (LLMs) using a consistent OpenAI-compatible input/output format.

• Free

Candle is an SDK that provides programmatic read and write access to consumer internet services, enabling seamless integration with LLMs.

• Freemium
• From 84$

OpenTools provides a unified API enabling developers to connect Large Language Models (LLMs) with a diverse ecosystem of tools, simplifying integration and management.

• Usage Based

Kalavai offers a platform for deploying Large Language Models (LLMs) across various devices, scaling from personal laptops to full production environments. It simplifies LLM deployment and experimentation.

• Paid
• From 29$

Flowise is an open-source low-code platform that enables developers to build customized LLM orchestration flows and AI agents through a drag-and-drop interface.

• Freemium
• From 35$

Unify provides tools to build, test, and optimize LLM pipelines with custom interfaces and a unified API for accessing all models across providers.

• Freemium
• From 40$

Open Source AI Gateway provides developers with a robust, production-ready solution to manage multiple LLM providers like OpenAI, Anthropic, and Gemini. It offers features like smart failover, caching, rate limiting, and monitoring for enhanced reliability and cost savings.

• Free

Lora provides an SDK for integrating a fine-tuned, mobile-optimized local Large Language Model (LLM) into applications with minimal setup, offering GPT-4o-mini level performance.

• Freemium

LLMStack is an open-source development platform that enables users to build AI agents, workflows, and applications by integrating various model providers and custom data sources.

• Other

Missing Studio is an open-source AI platform designed for developers to build and deploy generative AI applications. It offers tools for managing LLMs, optimizing performance, and ensuring reliability.

• Free

WebLLM enables running large language models (LLMs) directly within a web browser using WebGPU for hardware acceleration, reducing server costs and enhancing privacy.

• Free

Keywords AI is a comprehensive developer platform for LLM applications, offering monitoring, debugging, and deployment tools. It serves as a Datadog-like solution specifically designed for LLM applications.

• Freemium
• From 7$