mcp server

A web search and scraping MCP server for Claude, Cursor and ChatGPT

ScrapeNest hosts a Model Context Protocol server. Point an MCP client at it and your assistant can search the live web, read web pages, write cited answers, pull Google Maps reviews and transcribe audio, billed to your ScrapeNest credits.

Server URLhttps://scrapenest.dev/mcp

Connection details

URL
https://scrapenest.dev/mcp
Transport
Streamable HTTP. The server is stateless and answers with JSON.
API key
Send any API key from your dashboard as Authorization: Bearer sn_.... There is no separate MCP key.
OAuth
ChatGPT signs in with OAuth: you log in to ScrapeNest and approve access, and no key is pasted anywhere.
Key in the URL
For a client that can only take a URL, the server also accepts ?apiKey=sn_.... A key in a URL can leak through config files, screenshots and logs, so use the header wherever your client allows it.
Profiles
The default URL exposes 9 tools. https://scrapenest.dev/mcp?profile=chatgpt exposes search and fetch only.
Registry
Listed in the MCP Registry as dev.scrapenest/scrapenest.

Email signups need to verify their address before the key works; until then, tool calls fail with email_not_verified. The free plan includes 1,000 credits a month.

Set up your client

Each snippet adds the server under the name scrapenest. Replace sn_your_key_here with your key, or keep the key in the SCRAPENEST_API_KEY environment variable where the client supports it. The MCP section of the docs has the full steps for each client.

Claude Code

claude mcp add --transport http scrapenest https://scrapenest.dev/mcp \
  --header "Authorization: Bearer $SCRAPENEST_API_KEY"

Run claude mcp list to check the connection.

Cursor

In ~/.cursor/mcp.json, or .cursor/mcp.json in a project:

{
  "mcpServers": {
    "scrapenest": {
      "url": "https://scrapenest.dev/mcp",
      "headers": { "Authorization": "Bearer sn_your_key_here" }
    }
  }
}

VS Code

In .vscode/mcp.json. VS Code asks for the key the first time the server starts and stores it for you:

{
  "inputs": [
    { "type": "promptString", "id": "scrapenest-key", "description": "ScrapeNest API key", "password": true }
  ],
  "servers": {
    "scrapenest": {
      "type": "http",
      "url": "https://scrapenest.dev/mcp",
      "headers": { "Authorization": "Bearer ${input:scrapenest-key}" }
    }
  }
}

LM Studio

In LM Studio's mcp.json:

{
  "mcpServers": {
    "scrapenest": {
      "url": "https://scrapenest.dev/mcp",
      "headers": { "Authorization": "Bearer sn_your_key_here" }
    }
  }
}

ChatGPT

Add https://scrapenest.dev/mcp as an MCP server in ChatGPT, then sign in to ScrapeNest and approve access when ChatGPT asks. ChatGPT's menus change from time to time, so the docs keep the current steps.

Other clients

Any client that supports remote MCP servers over streamable HTTP can use the same URL and header.

The 9 tools

Each tool calls one ScrapeNest REST endpoint and bills the same credits as that endpoint. Completed results end with the credits the call charged.

ToolWhat it doesEndpointCredits
web_search Live web search across several engines, merged into one ranked list /v1/search 5
ask_web A written answer with numbered citations from freshly fetched pages /v1/search/answer 20 + 5 per source fetched
deep_search Search plus the full text of the top results in one call /v1/search/deep 5 + 5 per page fetched
scrape_url Read one URL as clean text or Markdown, JavaScript pages included /v1/scrape/url 1 to 40, +5 with ai_query
translate_text Translate text, with the source language detected /v1/translate 1
maps_reviews Google Maps reviews for one place, newest first /v1/scrape/google-maps/reviews/async 100 per 50 reviews (40 when 50 or fewer)
audio_transcript Transcribe a podcast episode, YouTube video or audio file /v1/audio/transcript/async 20 per 2 minutes
poll_run Collect the result of a background job /v1/scrape/runs/{run_id} Free
scrapenest_account Key status, credit balance and rate limits /v1/me Free

Background jobs

maps_reviews and audio_transcript often take longer than one tool call should. They submit to the async endpoints and wait about a minute. Short jobs come back in that first call; longer ones return a run_id, and the assistant calls poll_run with it until the result is ready. Polling is free, and the job is billed once, when it completes.

Limits

  • A tool call has a time budget of about 90 seconds, so it returns before the connection times out. For slow, heavily protected pages, call the REST API with a larger timeout_seconds.
  • scrape_url returns long pages one window at a time: focus picks the passages that match, and offset reads on.
  • maps_reviews asks for up to 2,000 reviews per call; the REST endpoint goes up to 10,000.
  • audio_transcript does not take cookies. Sources that need a signed-in session go through the REST API.
  • Tool calls share your account's credits and rate limits with your REST traffic.

The ChatGPT profile

Some ChatGPT features expect a server with exactly two tools, search and fetch. Add ?profile=chatgpt to the URL to get that profile:

ToolWhat it doesEndpointCredits
search Web search results with an id, title and URL for each document /v1/search 5
fetch The full text of a document returned by search /v1/scrape/url 1 to 40

questions

MCP server FAQ

What is the ScrapeNest MCP server URL?

https://scrapenest.dev/mcp. It uses MCP's streamable HTTP transport, so any client that supports remote MCP servers can connect to it.

Do I need a separate key for MCP?

No. Any API key from your dashboard works. Send it as Authorization: Bearer sn_... ChatGPT signs in with OAuth instead.

What does it cost?

Each tool bills the same credits as the REST endpoint it calls: 5 for a web search, 1 to 40 for a page, 100 per 50 Maps reviews. poll_run and scrapenest_account are free, and the free plan includes 1,000 credits a month.

Why did a tool return a run_id instead of a result?

maps_reviews and audio_transcript run as background jobs. Each call waits about a minute; if the job is still running, the assistant passes the run_id to poll_run to collect the result. Polling is free.

Which tools does ChatGPT get?

The default URL exposes all nine tools. https://scrapenest.dev/mcp?profile=chatgpt exposes a smaller profile with search and fetch.

Can I use the server without OAuth?

Yes. Claude Code, Cursor, VS Code and LM Studio send the API key in a header. OAuth is for ChatGPT.

1,000 free credits a month

Give your assistant live web access

Sign up, verify your email, mint a key on the dashboard, then paste one of the snippets above. No card required.