firecrawl.dev valid
Firecrawl
Firecrawl is the open-source web data API for AI agents and LLM applications — it searches, scrapes, and interacts with the web at scale, one API family covering Search (live web queries returning full page content), Scrape (HTML/JS pages to clean Markdown or structured JSON), Crawl (depth-first site traversal), Map (site structure discovery), Parse (document extraction from PDFs, DOCX, and more), Interact (managed browser automation for dynamic pages and authenticated flows), and Monitor (recur
- Authority
- 60 reach 15 · trust 5 · quality 25 · freshness 15
- Tier
- listed
- llms.txt
- https://www.firecrawl.dev/llms.txt
- llms-full.txt
- https://www.firecrawl.dev/llms.txt
- Sections
- 17
- Links
- 44
- Size
- 10555 bytes
- Popularity rank
- #28614
- Country
- US
- First seen
- 2026-10-18T15:08:53.286Z
- Last checked
- 2026-10-18T16:16:19.827Z
- Badge
Own this site? Verify it
Verified listings rank first, reach the featured tier (do-follow links) at 60 authority instead of 70, get a link in our llms.txt, a badge, breakage alerts, an editable profile, lookup analytics, and instant re-crawls. Prove ownership with any one of these, then call the verify endpoint (or your agent can do all of it, also over MCP).
- llms.txt link (recommended) — add this line to your llms.txt:
- [Agent Web Map](https://agentwebmap.com/domain/firecrawl.dev?verify=awm_c63ab2ac6ee410fda42e74b1ff716c92) - DNS — add a TXT record:
_agentwebmap.firecrawl.dev. TXT "awm-verify=awm_c63ab2ac6ee410fda42e74b1ff716c92" - Meta tag — in your homepage <head>:
<meta name="agentwebmap-verify" content="awm_c63ab2ac6ee410fda42e74b1ff716c92"> - Well-known file — serve the token at:
https://firecrawl.dev/.well-known/agentwebmap-verify.txt -> awm_c63ab2ac6ee410fda42e74b1ff716c92
Then: curl -X POST https://agentwebmap.com/v1/sites/firecrawl.dev/verify — the response contains your API key. Full docs.
Machine-readable: GET /v1/domain/firecrawl.dev · this page as Accept: application/json or text/markdown · MCP lookup_domain