Docs / Guide

Introduction

Turn public pages, sites, search results, and documents into data ready for applications and AI.

Core workflowsScrape · Crawl · Search · Map · Parse · Extract
Common outputsMarkdown · JSON · Links · Images · HTML
Base URLhttps://api.datablue.dev/v1

Choose a Workflow

NeedUse
Content from one known URLScrape
Content from connected pagesCrawl
Sources for a querySearch
A site's URL inventoryMap
Content from an uploaded fileParse
Fields matching a schemaExtract
Structured records from a supported sourceData API

First Request

curl -X POST "https://api.datablue.dev/v1/scrape" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","formats":["markdown","links"]}'
Example response
{
  "success": true,
  "data": {
    "url": "https://example.com",
    "markdown": "# Example Domain",
    "links": [
      "https://www.iana.org/domains/example"
    ]
  },
  "error": null
}

Next Steps