~/ domain/mcpscraper.dev.mdTHE AGENT-READABLE WEB

mcpscraper.dev valid

MCP Scraper

Web intelligence, shared memory, connected accounts, and manual workflows for the AI tools people already use.

Visit publisher ↗
Authority
45 reach 0 · trust 5 · quality 25 · freshness 15
Tier
listed
llms.txt
https://mcpscraper.dev/llms.txt
llms-full.txt
https://mcpscraper.dev/llms-full.txt
Sections
5
Links
26
Size
7626 bytes
Country
United States Hosting inference
Hosting country
United States Hosting inference
Country evidence
No published address evidence collected yet
Categories
AI and machine learning
For agents
Documentation: developer or product docs worth reading, nothing to call
First seen
2026-10-27T09:56:22.368Z
Last checked
2026-10-27T09:56:24.124Z
Badge
Agent Web Map badge for mcpscraper.dev

Their llms.txt

The beginning of the file, from our validated copy saved 2026-10-27T09:56:22.463Z. Cached copy · Source on mcpscraper.dev

# MCP Scraper
> Web intelligence, shared memory, connected accounts, and manual workflows for the AI tools people already use.
Canonical site: https://mcpscraper.dev
Language: en-US

## Queryable API

This file is a curated static overview. For targeted retrieval, use:

- Plain text: https://mcpscraper.dev/llms?query=your+question
- JSON: https://mcpscraper.dev/llms/json?query=your+question
- Examples: https://mcpscraper.dev/llms?query=web+scraping+for+AI+agents, https://mcpscraper.dev/llms?query=searchable+shared+memory, https://mcpscraper.dev/llms?query=connected+business+accounts, https://mcpscraper.dev/llms?query=People+Also+Ask+research, https://mcpscraper.dev/llms?query=Claude+Code+evaluation, https://mcpscraper.dev/llms?query=when+not+to+use+MCP
- No query returns the complete curated overview in both formats.
- Limits: 256 query characters, 8 results, 1 per source, 900 excerpt characters and 12000 response characters.
- Every result includes its canonical source URL and corpus receipt.

## What MCP Scraper is

MCP Scraper gives AI agents shared web data, Memory, integrations, and manual workflows. It can collect public evidence, keep approved information searchable across tools, and connect authorized business accounts.

Sources: <https://mcpscraper.dev/>

## Agent surfaces

The product is available through a hosted MCP endpoint, an npm stdio server, a Claude Desktop extension, and a REST API. The same account can be used from Claude, ChatGPT, Cursor, and other compatible agent surfaces.

Sources: <https://mcpscraper.dev/docs>, <https://mcpscraper.dev/use-cases/web-scraping-mcp-server>

## Operating boundary

Public-web collection, private Memory, and connected-account access remain distinct permission lanes. Connected writes require explicit enablement and grants; retrieval results preserve canonical sources and corpus receipts.

Sources: <https://mcpscraper.dev/integrations>, <https://mcpscraper.dev/memory>
## Pages
- [MCP Scraper — One brain for every AI you use](https://mcpscraper.dev/): Get any data and give every AI a shared memory. One account connects Claude, ChatGPT, Cursor, and the rest of your AI stack.
- [What You Can Actually Do With MCP Scraper](https://mcpscraper.dev/aug-webinar): A live, practical MCP Scraper workshop covering web research, Memory, connected accounts, reusable skills, and real workflows.
- [MCP Scraper Blog](https://mcpscraper.dev/blog/): Field guides on AI development, SEO, and developer tools. Every post answers 20–50 real search questions with sourced, practitioner-grade answers.
- [AI Development Workflows: A Complete Guide](https://mcpscraper.dev/blog/ai-development-workflows/): What they are, how they
- [Claude Code: The Evaluation Guide Every Tutorial Skips](https://mcpscraper.dev/blog/claude-code/): The cost math, head-to-head comparisons, and trust answers that every Claude Code tutorial skips — so you can decide before you adopt.
- [People Also Ask SEO: The Complete 2026 Guide](https://mcpscraper
…

Related sites

Explore similar publishers →

Similar publisher descriptions and documentation. Similarity does not imply affiliation or equivalent capabilities.

DomainTitleCategoryCountryAuthorityllms.txtllms-full.txtSave
awesomeclaude.ai Awesome Claude (awesomeclaude.ai) documentation AI agents and MCP Developer tools +1 — 49 ✓
mcp.so MCP.so documentation AI and machine learning AI agents and MCP +1 — 50 ✓ ✓
webreference.com Web Reference documentation Developer tools Documentation and reference +1 — 62 ✓
scriptbyai.com ScriptByAI interface AI and machine learning Documentation and reference — 55 ✓ ✓
mcpservers.org Awesome MCP Servers documentation AI and machine learning Developer tools +2 — 50 ✓
agentscamp.com AgentsCamp documentation AI and machine learning AI agents and MCP +1 US 48 ✓ ✓
memoryplugin.com MemoryPlugin interface AI and machine learning AI agents and MCP US 50 ✓ ✓
aiagentskit.com AI Agents Kit interface AI and machine learning Developer tools +1 — 48 ✓ ✓

Machine-readable: GET /v1/resolve?q=mcpscraper.dev · GET /v1/domain/mcpscraper.dev · this page as Accept: application/json or text/markdown · MCP lookup_domain

Automatically discovered from public files. Inclusion does not imply endorsement or publisher participation.

Own or manage this website?

If you own or manage mcpscraper.dev, you can update its listing and review file health, discovery activity and score history.

Manage this listing — optional

What verification unlocks

See how your site is discovered—and control what agents see.

  • See your website in the map

    Review your indexed topics, nearby publishers sharing headings, measured listing exposure and map snapshots in a private report for your website.

  • Control what agents see

    Edit your listing description, tags, public contact details and additional llms.txt paths. Publish your terms for automated access, attribution and pricing.

  • Make your profile eligible for search

    A valid, listed, unblocked, verified profile can appear in our publisher sitemap and become eligible for search-engine visibility. Search engines decide what to index and rank.

  • Appear in our llms-full.txt

    Eligible verified publishers are listed by name, with their file links and summaries, in the service overview agents can read.

Free. No account registration, backlink or payment required. Public discovery remains available without verification.

Verify your website—free

Preview the owner dashboard · All verification benefits

Let your coding agent verify it

If your coding agent is authorized to manage this website, paste these instructions into it.

Claim my listing on Agent Web Map for mcpscraper.dev:
1. POST https://agentwebmap.com/v1/sites/mcpscraper.dev/claims and keep claim_id and claim_secret private.
2. Publish the verification line "AgentWebMap verification: <token>" (token from step 1) in https://mcpscraper.dev/llms.txt, or use the DNS, meta-tag or well-known method the response describes. This only verifies the listing; your website and domain remain yours.
3. POST https://agentwebmap.com/v1/sites/mcpscraper.dev/verify with {"claim_id": "...", "claim_secret": "..."}.
4. Save the api_key from the answer; it manages the listing (PATCH https://agentwebmap.com/v1/sites/mcpscraper.dev).
MCP equivalent: tools begin_ownership_claim, then verify_domain, at https://agentwebmap.com/mcp. Docs: https://agentwebmap.com/docs#verify

Corrections or removal requests: contact the directory.

agent web map / a clearer way in.API & MCP · Contact