Diffbot - Access the Web as a Structured Database

Diffbot Access the Web as a Structured Database

What is Diffbot?

Diffbot addresses the challenge of unstructured web data by utilizing AI to read and interpret public websites, transforming them into structured, usable information. It processes various data types, including news articles, organizational details, retail products, online discussions, and event information, making the web accessible as a structured database.

The platform offers several key capabilities. The Knowledge Graph allows users to find and build accurate data feeds or enrich existing datasets. Its Natural Language Processing features infer entities, relationships, and sentiment from raw text. The Extract API analyzes specific page types like articles or products without manual rule creation, while the Crawl function enables users to turn entire websites into structured databases efficiently.

Features

Knowledge Graph Search: Find and build data feeds of news, organizations, people, products, discussions, and events.
Knowledge Graph Enhance: Enrich existing datasets of people and accounts.
Natural Language Processing: Infer entities, relationships, and sentiment from raw text.
Extract API: Analyze and structure data from articles, products, discussions, and more without predefined rules.
Crawl: Turn entire websites into structured databases of products, articles, and discussions.
Multi-Data Type Support: Processes organizations, news/articles, retail products, discussions, and events.

Use Cases

Market Intelligence Gathering
News Monitoring and Analysis
Machine Learning Data Sourcing
E-commerce Product Data Extraction
Lead Generation and Enrichment
Competitive Analysis
Financial Data Aggregation
Risk Assessment Data Collection

FAQs

What are Diffbot credits and how are they calculated?

Credits are units of processing value used for API executions like extracting pages or downloading Knowledge Graph records. For example, extracting one page costs 1 credit, while exporting one Knowledge Graph entity record costs 25 credits. Credit needs depend on monthly volume requirements.
What occurs if I use more credits than my plan includes?

On paid plans, additional credits are billed pro rata at your plan's per-credit rate. On the free plan, exceeding the limit results in a 'Quota Exceeded' error until the next billing cycle.
Is a long-term contract required for Diffbot?

No, Diffbot operates on flexible monthly subscriptions which can be cancelled at any time without being billed for subsequent months.
Does Diffbot offer plans for students or academic users?

Yes, the Diffbot for Students program provides free Startup tier access to qualifying students and academic researchers.
How does the cost of enhancing a Knowledge Graph record compare to exporting one?

Enhancing one Knowledge Graph entity record costs 25 credits, the same as exporting one. Enhancing with a refresh (re-crawling sources) costs 100 credits.