Your AI team, working in Diffbot

Diffbot provides AI-powered tools to extract and structure data from web pages, transforming unstructured web content into structured, linked data.

Start your company

What your team can do in Diffbot

35 tools to work with, connected with an API key.

Combine Entity ProfilesReads only

Combine entity information into an enhanced view using the Diffbot Knowledge Graph, matching identifying attributes such as name, email, employer, or URL. The explicit entity type parameter supports Person.

Create Bulk Enhance Job

Submit an asynchronous bulk enhance job for Person or Organization records using entity descriptions or Knowledge Graph IDs. Returns a job ID for tracking the job and retrieving its enriched results.

Create Bulk Extract Job

Tool to submit a bulk extract job to process multiple URLs with Extract APIs. Use when you need to process many URLs asynchronously using any Extract API. The job will process URLs in the background and provide downloadable results.

Create or Update Custom API

Tool to create or update the parameters and ruleset of a Custom API. Use this when you need to define custom extraction rules for specific websites that require tailored parsing logic beyond standard Diffbot APIs. Allows defining URL patterns, CSS selectors, extraction rules, and preprocessing filters to extract structured data from websites with unique layouts.

Delete Custom API

Delete a Custom API definition and its extraction rules for a specified base API and URL pattern.

Delete KG Enhance Bulkjob

Tool to delete an Enhance Bulkjob. Removes the bulk job and its results from the system. Use when cleaning up completed or failed jobs.

Diffbot AnalyzeReads only

Automatically analyze a web page to determine its type and extract structured data. When the response contains extracted objects, returns the first object; useful for URLs whose page type is unknown.

Diffbot Extract JobReads only

Tool to extract structured job posting data from job listing pages. Returns job title, company, location, salary, requirements, skills, and other job-related information. Use when you need to parse and structure data from job postings.

Diffbot Extract ListReads only

Tool to extract structured data from list-style pages like news indexes, product listings, and directory pages. Returns an array of items with their titles, links, and descriptions. Use when you need to extract multiple items from a page organized as a list or index.

Diffbot Get EventReads only

Tool to extract event details from web pages. Use when you need structured event data such as venue, date, and description.

Diffbot Get ImageReads only

Tool to extract detailed information about images, including dimensions and recognition data. Use after confirming the image URL is publicly accessible.

Diffbot Get ProductReads only

Tool to extract product information such as specifications, prices, availability, and reviews. Use when you need structured product data including specs, pricing, and reviews.

Diffbot Knowledge Graph SearchReads only

Search the Diffbot Knowledge Graph using DQL (Diffbot Query Language). Query billions of entities including organizations, people, articles, products, and more. Use structured queries to filter by type, fields, and relationships.

Download Bulk Job ResultsReads only

Download bulk enhance job results via POST, with filtering and export options for JSON, JSONL, CSV, XLS and XLSX. An HTTP 201 response is reported as executing but may also indicate a stopped job.

Enhance Entity with Knowledge GraphReads only

Enrich a person or organization with comprehensive data from the Diffbot Knowledge Graph. Provide identifiers like name, email, employer, or URL and receive detailed entity information including employment history, education, location, skills, and more. Use when you need to gather all publicly available knowledge about a specific person or organization from billions of web pages.

Get Article DataReads only

Tool to extract information from articles, including authors, publication dates, and images. Use when you need structured metadata from a web article URL.

Get Bulk Job DataReads only

Tool to download extracted results from a completed bulk job. Use after a bulk job has finished processing to retrieve the data. Supports JSON and CSV formats.

Get Bulk Job ResultsReads only

Tool to download the results of a completed Enhance Bulkjob. Returns enriched records from the bulk job. Use after a bulk enhance job has completed processing.

Get Bulk Job StatusReads only

Tool to poll the status of a specific Diffbot Knowledge Graph Enhance bulk job. Use when you need to check the progress, completion status, or details of a bulk enhancement job.

Get Bulk Single ResultReads only

Tool to download the result of a single job within a Diffbot bulk enhance job. Returns enriched entity data for a specific input record by its index. Use after a bulk enhance job has completed to retrieve individual results without downloading the entire dataset.

Get Crawl DataReads only

Download extracted results from a completed crawl job, optionally limiting the number of results. JSON results are returned as objects; CSV content is returned as text in a single object.

Get Diffbot Account DetailsReads only

Retrieve Diffbot account details, including subscription plan credits, account status, account holder information, and daily usage history. Use this to monitor API usage or review account metadata.

Get Discussion ThreadReads only

Extract structured discussion threads from web pages, including forums, comment sections and product reviews. Results may include posts, authors, timestamps and parent relationships; by default the request uses one page, with an option to concatenate more pages.

Get KG Coverage Report by IDReads only

Download Knowledge Graph coverage report by report ID. Returns detailed CSV coverage statistics showing field presence across query results. Use this after generating a coverage report from a DQL query to retrieve the statistical breakdown of field coverage.

Get Video DataReads only

Tool to extract information from videos, including titles, descriptions, and embedded HTML. Use when you need structured video metadata from any web page.

List Bulk JobsReads only

Tool to list all Bulk jobs associated with a specific token. Use after authenticating to retrieve statuses of all jobs for the account.

List Bulk Jobs Status For TokenReads only

Tool to get the status of all bulk enhance jobs for a token. Returns list of all bulk jobs associated with your API token. Use when you need to monitor or retrieve the status of multiple bulk jobs at once.

List Custom APIsReads only

Tool to retrieve all Custom APIs and their extraction rules currently defined on your Diffbot token. Use when you need to list, review, or audit custom API configurations for your account.

Manage Crawl Job

Manages Diffbot crawl jobs: pause, restart, delete, or view status. Returns list of all active crawl jobs when called without parameters. Use 'name' parameter with action flags (pause=1, restart=1, delete=1) to control specific jobs.

Resolve Lost IDReads only

Tool to resolve lost IDs in the Knowledge Graph. Use when you need to map a lost identifier to its canonical counterpart for data consistency.

Search Crawl Job DataReads only

Tool to query crawl job collections using DQL (Diffbot Query Language). Use when you need to search extracted data from completed crawl or bulk jobs by collection name.

Start Bulk Job

Start an asynchronous Bulk Extract job for a list of URLs using a specified Extract API. The response identifies the matching job by name, or the most recently created job if no name match is found.

Start Crawl Job

Initiates a Diffbot crawl job that spiders a website starting from seed URLs and processes discovered pages with a specified Extract API. The crawler follows links within the domain, collects structured data (articles, products, etc.), and stores results for download. Use this to systematically extract data from entire websites or sections. Requires Diffbot Plus plan or higher.

Stop Bulk Job

Tool to pause (stop) a running Bulk job. Pausing halts further processing of URLs while preserving existing progress. To resume, use the appropriate resume action. Specify the exact job name (case-sensitive) as provided when the job was created.

Stop KG Bulk Job By ID

Tool to stop an active Knowledge Graph Enhance bulk job by its ID. Halts processing of a running KG bulk job immediately. Use when you need to stop a specific KG bulk job using its bulkjobId.

More in Web scraping & browser

See them all β†’

Your company, run by an AI team

Start your company

BRAINER

Continue to B.R.A.I.N.E.R.

Continue with Google or your email.

or