1. Docs
2. /
3. Tool reference
4. /
5. Studio Apps
6. /
7. crawlSiteToContent

Studio Apps

crawlSiteToContent

Crawl Site to Content

Crawl a public website into a Studio content pack.

writeexternal

Ask Claude, ChatGPT, Cursor or any AI connected to The Cloud "crawl this client site into content", and it calls crawlSiteToContent.

Example call

The MCP tools/call params, with the required arguments only.

{
  "arguments": {
    "appId": "<appId>",
    "siteUrl": "<siteUrl>"
  },
  "name": "crawlSiteToContent"
}

Arguments

• appIdstringrequiredThe Studio app ID
• dryRunbooleanoptionalWhen true, return the diff summary without writing files.
• excludestring[]optionalOptional same-origin path prefixes to skip, e.g. ['/blog'].
• includestring[]optionalOptional same-origin path prefixes to include. Omit to include all discovered paths.
• maxPagesintegeroptionalMaximum pages to crawl. Defaults to 60.
• siteUrlstringrequiredThe public http/https site origin or URL to crawl.

Returns

Pass dryRun: true to return the diff without writing.

Declared limits

• maxPages: greater than 0
• maxPages: maximum 60

Ask for it

The Cloud routes these requests to this verb.

• crawl this client site into content
• make a copy pack from this website
• import website copy into Studio

Pair it with

The verbs that finish the job.

• listStudioAppFiles
• readStudioAppFile

Questions

• What does crawlSiteToContent do?

  Crawl a public website into a Studio content pack. It is one of the tools The Cloud MCP server gives every connected AI.

• How do I use crawlSiteToContent from Claude or ChatGPT?

  Connect your AI to The Cloud at https://mcp.thecloud.so/mcp and sign in once. Then ask Claude, ChatGPT, Cursor or any AI connected to The Cloud "crawl this client site into content", and it calls crawlSiteToContent.

• Is crawlSiteToContent safe to let an AI call?

  crawlSiteToContent changes your workspace. What an AI creates is Private until you share it. It reaches a system outside The Cloud on your behalf.

Connect

One endpoint gives your AI this tool and every other one: connect Claude, ChatGPT, Cursor or Gemini, read what The Cloud is, or see pricing.