What is Not Diamond?
Not Diamond provides an end-to-end multi-model AI framework, enabling developers to leverage the best model for every query. This intelligent routing system analyzes input and selects the optimal large language model (LLM) based on evaluation data, achieving significant improvements in accuracy while reducing operational costs.
The system features automatic prompt adaptation across LLMs and offers the ability to train custom routers, providing hyper-personalized model routing. Designed with privacy in mind, all requests are made client-side, ensuring data security.
Features
- Intelligent Routing: Selects the optimal LLM for each query based on evaluation data.
- Automatic Prompt Adaptation: Adapts prompts across different LLMs to ensure optimal performance.
- Custom Router Training: Allows training of custom routers with existing evaluation data for personalized model routing.
- Joint Prompt Optimization: Provides the ability to define the most effective prompt per LLM.
- Privacy Focused: All requests are made client-side, avoiding proxy usage and enhancing data security.
Use Cases
- Developing services on top of LLMs
- Optimizing LLM usage in applications
- Improving accuracy in AI-driven tasks
- Reducing costs associated with LLM usage
- Implementing RAG and agent workflows
- Handling diverse and unseen prompts in workflows
FAQs
-
Is Not Diamond a proxy?
Not Diamond is not a proxy. It simply recommends which model to use and then all requests to LLMs are made client-side. -
How does Not Diamond determine which model to call?
Not Diamond is a highly specialized predictive model optimized for model routing. Trained on a large, cross-domain evaluation dataset, it accurately predicts which LLM will perform best for any input. -
Does Not Diamond integrate with my data?
Not Diamond is designed to work seamlessly with your existing data and evaluation pipelines. You can upload any LLM evaluation dataset and within minutes you’ll get back a router optimized to your use case. -
Can I optimize prompts across different models?
Not Diamond makes it easy to leverage automatic prompt optimization frameworks like DSPy and SAMMO, or to use your own manually developed prompts for each LLM. Not Diamond will learn the best model and prompt combination for each query. -
Does Not Diamond support RAG and agent use cases?
Yes, Not Diamond is especially powerful for RAG and agent workflows. As highly diverse and unseen prompts propagate through the workflow, Not Diamond's routing improves quality, reliability, speed, and efficiency.
Related Queries
Helpful for people in the following professions
Not Diamond Uptime Monitor
Average Uptime
99.74%
Average Response Time
274.03 ms
Featured Tools
Join Our Newsletter
Stay updated with the latest AI tools, news, and offers by subscribing to our weekly newsletter.
