mcp server
A web search and scraping MCP server for Claude, Cursor and ChatGPT
ScrapeNest hosts a Model Context Protocol server. Point an MCP client at it and your assistant can search the live web, read web pages, write cited answers, pull Google Maps reviews and transcribe audio, billed to your ScrapeNest credits.
Server URLhttps://scrapenest.dev/mcp
Connection details
- URL
https://scrapenest.dev/mcp- Transport
- Streamable HTTP. The server is stateless and answers with JSON.
- API key
- Send any API key from your dashboard as
Authorization: Bearer sn_.... There is no separate MCP key. - OAuth
- ChatGPT signs in with OAuth: you log in to ScrapeNest and approve access, and no key is pasted anywhere.
- Key in the URL
- For a client that can only take a URL, the server also accepts
?apiKey=sn_.... A key in a URL can leak through config files, screenshots and logs, so use the header wherever your client allows it. - Profiles
- The default URL exposes 9 tools.
https://scrapenest.dev/mcp?profile=chatgptexposessearchandfetchonly. - Registry
- Listed in the MCP Registry as
dev.scrapenest/scrapenest.
Email signups need to verify their address before the key works; until then, tool calls fail with email_not_verified. The free plan includes 1,000 credits a month.
Set up your client
Each snippet adds the server under the name scrapenest. Replace sn_your_key_here with your key, or keep the key in the SCRAPENEST_API_KEY environment variable where the client supports it. The MCP section of the docs has the full steps for each client.
Claude Code
claude mcp add --transport http scrapenest https://scrapenest.dev/mcp \
--header "Authorization: Bearer $SCRAPENEST_API_KEY"
Run claude mcp list to check the connection.
Cursor
In ~/.cursor/mcp.json, or .cursor/mcp.json in a project:
{
"mcpServers": {
"scrapenest": {
"url": "https://scrapenest.dev/mcp",
"headers": { "Authorization": "Bearer sn_your_key_here" }
}
}
}
VS Code
In .vscode/mcp.json. VS Code asks for the key the first time the server starts and stores it for you:
{
"inputs": [
{ "type": "promptString", "id": "scrapenest-key", "description": "ScrapeNest API key", "password": true }
],
"servers": {
"scrapenest": {
"type": "http",
"url": "https://scrapenest.dev/mcp",
"headers": { "Authorization": "Bearer ${input:scrapenest-key}" }
}
}
}
LM Studio
In LM Studio's mcp.json:
{
"mcpServers": {
"scrapenest": {
"url": "https://scrapenest.dev/mcp",
"headers": { "Authorization": "Bearer sn_your_key_here" }
}
}
}
ChatGPT
Add https://scrapenest.dev/mcp as an MCP server in ChatGPT, then sign in to ScrapeNest and approve access when ChatGPT asks. ChatGPT's menus change from time to time, so the docs keep the current steps.
Other clients
Any client that supports remote MCP servers over streamable HTTP can use the same URL and header.
The 9 tools
Each tool calls one ScrapeNest REST endpoint and bills the same credits as that endpoint. Completed results end with the credits the call charged.
| Tool | What it does | Endpoint | Credits |
|---|---|---|---|
web_search |
Live web search across several engines, merged into one ranked list | /v1/search |
5 |
ask_web |
A written answer with numbered citations from freshly fetched pages | /v1/search/answer |
20 + 5 per source fetched |
deep_search |
Search plus the full text of the top results in one call | /v1/search/deep |
5 + 5 per page fetched |
scrape_url |
Read one URL as clean text or Markdown, JavaScript pages included | /v1/scrape/url |
1 to 40, +5 with ai_query |
translate_text |
Translate text, with the source language detected | /v1/translate |
1 |
maps_reviews |
Google Maps reviews for one place, newest first | /v1/scrape/google-maps/reviews/async |
100 per 50 reviews (40 when 50 or fewer) |
audio_transcript |
Transcribe a podcast episode, YouTube video or audio file | /v1/audio/transcript/async |
20 per 2 minutes |
poll_run |
Collect the result of a background job | /v1/scrape/runs/{run_id} |
Free |
scrapenest_account |
Key status, credit balance and rate limits | /v1/me |
Free |
Background jobs
maps_reviews and audio_transcript often take longer than one tool call should. They submit to the async endpoints and wait about a minute. Short jobs come back in that first call; longer ones return a run_id, and the assistant calls poll_run with it until the result is ready. Polling is free, and the job is billed once, when it completes.
Limits
- A tool call has a time budget of about 90 seconds, so it returns before the connection times out. For slow, heavily protected pages, call the REST API with a larger
timeout_seconds. scrape_urlreturns long pages one window at a time:focuspicks the passages that match, andoffsetreads on.maps_reviewsasks for up to 2,000 reviews per call; the REST endpoint goes up to 10,000.audio_transcriptdoes not take cookies. Sources that need a signed-in session go through the REST API.- Tool calls share your account's credits and rate limits with your REST traffic.
The ChatGPT profile
Some ChatGPT features expect a server with exactly two tools, search and fetch. Add ?profile=chatgpt to the URL to get that profile:
| Tool | What it does | Endpoint | Credits |
|---|---|---|---|
search |
Web search results with an id, title and URL for each document | /v1/search |
5 |
fetch |
The full text of a document returned by search | /v1/scrape/url |
1 to 40 |
Read more in the guide Add live web search and scraping to Claude, Cursor and ChatGPT with MCP.
questions
MCP server FAQ
What is the ScrapeNest MCP server URL?
https://scrapenest.dev/mcp. It uses MCP's streamable HTTP transport, so any client that supports remote MCP servers can connect to it.
Do I need a separate key for MCP?
No. Any API key from your dashboard works. Send it as Authorization: Bearer sn_... ChatGPT signs in with OAuth instead.
What does it cost?
Each tool bills the same credits as the REST endpoint it calls: 5 for a web search, 1 to 40 for a page, 100 per 50 Maps reviews. poll_run and scrapenest_account are free, and the free plan includes 1,000 credits a month.
Why did a tool return a run_id instead of a result?
maps_reviews and audio_transcript run as background jobs. Each call waits about a minute; if the job is still running, the assistant passes the run_id to poll_run to collect the result. Polling is free.
Which tools does ChatGPT get?
The default URL exposes all nine tools. https://scrapenest.dev/mcp?profile=chatgpt exposes a smaller profile with search and fetch.
Can I use the server without OAuth?
Yes. Claude Code, Cursor, VS Code and LM Studio send the API key in a header. OAuth is for ChatGPT.
Give your assistant live web access
Sign up, verify your email, mint a key on the dashboard, then paste one of the snippets above. No card required.