AI monitoring tools - AI tools

Arize is a comprehensive platform designed to accelerate the development and improve the production of AI applications and agents.

• Freemium
• From 50$

Flowtest.ai uses an AI Agent to continuously monitor your website like a real user, providing instant alerts and detailed reports for any issues.

• Free Trial
• From 20$

Keywords AI is a comprehensive developer platform for LLM applications, offering monitoring, debugging, and deployment tools. It serves as a Datadog-like solution specifically designed for LLM applications.

• Freemium
• From 7$

Evidently AI is a comprehensive AI observability platform that helps teams evaluate, test, and monitor LLM and ML models in production, offering data drift detection, quality assessment, and performance monitoring capabilities.

• Freemium
• From 50$

HoneyHive is a comprehensive platform that provides AI observability, evaluation, and prompt management tools to help teams build and monitor reliable AI applications.

• Freemium

Mona provides a Model Performance Insights Platform™ for proactive monitoring of AI, ML, and other data-driven systems in high-stakes environments.

• Contact for Pricing

Langtrace is an open-source observability and evaluations platform designed to help developers monitor, evaluate, and enhance AI agents for enterprise deployment.

• Freemium
• From 31$

Censius is an AI observability platform that provides automated monitoring, proactive troubleshooting, and model explainability tools to help organizations build and maintain reliable machine learning models throughout their lifecycle.

• Free Trial

OpenLIT is an open-source observability platform designed to streamline AI development workflows, particularly for Generative AI and LLMs, offering features like prompt management, performance tracking, and secure secrets management.

• Other

WhyLabs provides AI Control Center for observing, securing, and optimizing AI applications, offering tools for LLM security, ML monitoring, and AI observability.

• Freemium
• From 125$
• API

Velatir provides a platform for managing AI-driven tasks, ensuring responsible AI operation with human oversight, compliance, and real-time monitoring.

• Contact for Pricing

AI Studio is a comprehensive MLOps platform that provides enterprise-level tools for machine learning governance, monitoring, and deployment. It enables companies to streamline their ML operations with real-time insights and automated workflows.

• Freemium

Graphsignal monitors, profiles, and accelerates hosted LLM inference and model APIs, providing full visibility and deep insights for AI optimization.

• Freemium
• From 375$

HawkFlow.ai is a monitoring tool designed for engineers, product owners, and CTOs, integrating seamlessly with machine learning infrastructure to provide valuable insights and facilitate efficient decision-making.

• Freemium
• API

Passed.AI is an educational tool that helps educators guide students in responsible AI usage through comprehensive document auditing, AI detection, and plagiarism checking capabilities.

• Free Trial
• From 10$

Freeplay provides comprehensive tools for AI teams to run experiments, evaluate model performance, and monitor production, streamlining the development process.

• Paid
• From 500$

ChatRank.ai helps businesses track and enhance their brand's ranking and visibility within AI-powered chat interfaces like ChatGPT and Google Gemini. It offers performance tracking, alerting, and cohort selection to optimize your brand's presence in AI responses.

• Contact for Pricing

Palzin Monitor is a comprehensive infrastructure monitoring platform that combines uptime monitoring, incident management, and AI assistance to help teams detect and resolve issues before they impact users.

• Freemium
• From 8$

PerfAgents is an AI-powered synthetic monitoring platform that leverages existing web automation scripts to monitor application availability and response time metrics globally. It supports multiple frameworks and offers AI-powered script creation for continuous testing.

• Paid

Zupervise is a unified AI-risk intelligence platform that provides comprehensive monitoring and governance solutions for developers, end-users, and regulators to manage AI-related risks effectively.

• Contact for Pricing

llm.report is an open-source analytics and logging platform for OpenAI API usage, providing real-time monitoring, cost tracking, and usage optimization for AI applications.

• Freemium
• From 20$

UsageGuard is an enterprise-ready AI development observability platform that provides a unified API for multiple AI models, comprehensive security controls, and real-time monitoring capabilities with 99.9% uptime and sub-150ms latency.

• Contact for Pricing

Otterly.AI is a comprehensive AI search monitoring platform that tracks brand mentions, content visibility, and link citations across major AI search platforms including Google AI Overviews, ChatGPT, and Perplexity.AI.

• Freemium

Maihem empowers technology leaders and engineering teams to test, troubleshoot, and monitor any (agentic) AI workflow at scale. It offers industry-leading AI testing and red-teaming capabilities.

• Contact for Pricing

AgentOps is a comprehensive developer platform that enables testing, debugging, and deployment of AI agents with support for 400+ LLMs, Crews, and AI agent frameworks.

• Freemium
• From 40$

MyMod.AI is an innovative Twitch chat bot established to enhance chat moderation through the power of Artificial Intelligence.

• Freemium
• From 10$

VESSL AI provides a full-stack cloud infrastructure for AI, enabling users to train, deploy, and manage AI models and workflows with ease and efficiency.

• Usage Based

LogicMonitor is a SaaS-based automated monitoring platform that provides comprehensive observability for hybrid infrastructure, applications, and business services with AI-powered insights and analytics.

• Contact for Pricing
• From 22$

Eyer is an AI-powered IT observability platform that integrates with your existing technology stack. It offers a scalable, sustainable, and affordable solution for monitoring IT infrastructure.

• Free Trial

Phoenix accelerates AI development with powerful insights, allowing seamless evaluation, experimentation, and optimization of AI applications in real time.

• Freemium