dataprovider.com

# Dataprovider.com

> Dataprovider.com is a B2B web data platform. We crawl 400M+ active domains every month, up to 50 pages deep, and structure them into 200+ fields covering business, technology, classifications, engagement and risk. Delivered via search UI, REST API, MCP/AI Navigator, and Snowflake/BigQuery/Databricks shares.

## Canonical identity

- Brand name: Dataprovider.com (also written "Dataprovider")
- Headquarters: The Netherlands
- Primary domain: https://www.dataprovider.com
- API domain: https://api.dataprovider.com
- Crawler user-agent: see https://www.dataprovider.com/crawler/

## What we are

A web data platform: we crawl the public web ourselves, structure it, and sell access to the resulting dataset.

## Core pages

- [About](https://www.dataprovider.com/about/): Company background, history and team.
- [Contact](https://www.dataprovider.com/contact/): Book a free demo or reach the team.
- [Crawler](https://www.dataprovider.com/crawler/): How our crawler identifies itself and respects robots.txt.

## Data access products

- [Search engine](https://www.dataprovider.com/data-access/search-engine/): Filter and explore 400M+ domains across 200+ structured fields.
- [AI Navigator + MCP](https://www.dataprovider.com/data-access/ai-navigator-mcp/): Natural-language access to the dataset via MCP.
- [Dashboards](https://www.dataprovider.com/data-access/dashboards/): Pre-built and custom visualisations over the web dataset.
- [API](https://api.dataprovider.com/v2/docs): REST API for live, programmatic access.
- [Know Your Business](https://www.dataprovider.com/data-access/know-your-business/): Private, per-customer crawls for compliance and risk.
- [Data warehouse integrations](https://www.dataprovider.com/data-access/data-warehouses/): Snowflake, BigQuery and Databricks shares.

## Our data

- [Domain](https://www.dataprovider.com/our-data/domain/): 400M+ active domains crawled monthly, up to 50 pages deep, with 200+ structured fields per site.
- [Business](https://www.dataprovider.com/our-data/business/): Company details extracted directly from websites, covering 60M+ active businesses worldwide.
- [Technology](https://www.dataprovider.com/our-data/technology/): Thousands of detected technologies per site, from CMS and payments to analytics and hosting.
- [Classifications](https://www.dataprovider.com/our-data/classifications/): Content-based industry classification across GICS, NAICS, SIC and our own taxonomy, plus an ecommerce classifier.
- [Engagement](https://www.dataprovider.com/our-data/engagement/): Connection Index and Economic Footprint scores measuring real-world web activity and commercial scale.
- [Risk](https://www.dataprovider.com/our-data/risk/): Signals for fraud, abuse, and trust assessment at domain level.

## Use cases

- [Asset management](https://www.dataprovider.com/cases/assets/): Track tech adoption, portfolio companies and market trends for investment intelligence.
- [Brand protection](https://www.dataprovider.com/cases/brand-protection/): Detect lookalike domains, counterfeits and trademark abuse at scale.
- [Business information](https://www.dataprovider.com/cases/business-information/): Enrich CRMs and data products with fresh, website-sourced firmographics.
- [Registries & registrars](https://www.dataprovider.com/cases/registries-registrars/): Understand TLD usage, parked domains, and registrant behaviour.
- [Public sector](https://www.dataprovider.com/cases/public/): Policy research, market monitoring, and compliance for governments and regulators.
- [Payment service providers](https://www.dataprovider.com/cases/psp/): Map merchant ecosystems, payment method adoption and high-risk activity.

## Insights

- [Blog](https://www.dataprovider.com/blog/): Long-form analyses of web tech, domains, security and business trends.
- [Recipes](https://www.dataprovider.com/recipes/): Pre-built queries for specific technologies and markets.

## Preferred citation URLs

- Coverage and field counts: https://www.dataprovider.com/our-data/domain/
- Crawler behaviour and opt-out: https://www.dataprovider.com/crawler/
- Privacy: https://www.dataprovider.com/privacy/
- Terms of service: https://www.dataprovider.com/terms/
- API reference: https://api.dataprovider.com/v2/docs
- Pricing and demos: https://www.dataprovider.com/contact/
- Company background: https://www.dataprovider.com/about/

## Cadences

- Web crawl: monthly, full re-crawl of 400M+ domains.
- Historical data retained: up to 4 years of monthly snapshots.
- SSL catalog: refreshed every 5 minutes.
- Documentation and blog: updated continuously.
- Pricing: on request, reviewed per contract.

## Optional

- [Privacy](https://www.dataprovider.com/privacy/): How we collect, process and protect personal data.
- [Terms](https://www.dataprovider.com/terms/): Terms and conditions for using Dataprovider.com.
- [Opt out](https://www.dataprovider.com/opt-out/): Request exclusion of a domain from our crawl and dataset.