Create Crawl
Start a metered asynchronous crawl over a site and return its job ID. The crawl may visit and charge for up to items_limit pages; use GET_CRAWL_JOB to monitor it.
ActionTry it
Integrate WebCrawlerAPI
with your AI CRM
WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API.
Explore Triggers and Actions
Create Feed
Create a recurring website-change feed. Creation immediately schedules an initial crawl that may consume metered credits, and future scheduled runs may also consume credits; delete the feed when it is no longer needed.
ActionTry it
Delete Feed
Permanently cancel a feed so it cannot be resumed. The feed is removed from feed listings, but retained history may remain directly readable for 30 days.
ActionTry it
Get Crawl Job
Get a crawl job's status, configuration, per-page results, content URLs, errors, and observed costs. Respect recommended_pull_delay_ms when polling.
ActionTry it
Get Feed
Get one feed's configuration, lifecycle status, and recent run history, including per-run crawl counts and cost. Canceled feeds remain directly readable while retained by the provider.
ActionTry it
Get Organization Costs
Return current spendable balance plus request count and USD usage for a date range. The connected API key is used for both organization routes.
ActionTry it
List Feed Changes
Return one page of detected feed changes as structured JSON, with an opaque continuation cursor for older pages.
ActionTry it
List Feeds
List active and paused feeds for the connected organization, newest first. Logically canceled feeds are omitted.
ActionTry it
Scrape Page
Scrape one web page synchronously and return requested content or structured extraction. This consumes metered credits; supplying a prompt adds $0.002 per request.
ActionTry it
Set Feed State
Pause an active feed's future scheduled runs or resume a paused feed. Pausing does not stop a run that has already started, and resuming schedules future crawls that may consume metered credits.
ActionTry it
How the WebCrawlerAPI integration works
The WebCrawlerAPI integration connects your Dench AI CRM directly to WebCrawlerAPI, so agents can read and act on your WebCrawlerAPI data as part of everyday work — answering questions in chat, keeping your CRM in sync, and running automations without anyone copying data between tools.
10 actions are available for agents to invoke on your behalf. Every call runs through WebCrawlerAPI's own authorization, scoped to the account you connect.
Set up WebCrawlerAPI in Dench
- 1
Sign in to your Dench workspace and open Integrations.
- 2
Find WebCrawlerAPI and click Connect — you'll authorize access through WebCrawlerAPI's own sign-in flow. No API keys or code required.
- 3
Ask an agent to use WebCrawlerAPI in chat, or call it from an automation.
- 4
Manage or disconnect the connection any time from workspace settings.
Frequently asked questions
How does the WebCrawlerAPI integration work with Dench?
The Dench WebCrawlerAPI integration connects your AI CRM to WebCrawlerAPI, so AI agents can work with your WebCrawlerAPI data as part of chats, automations, and CRM workflows. You connect your account once, and every agent in your workspace can use it — governed by your workspace permissions.
What actions can AI agents perform with WebCrawlerAPI via Dench?
The WebCrawlerAPI integration currently exposes 10 actions, including Create Crawl, Create Feed, Delete Feed, Get Crawl Job, Get Feed, and Get Organization Costs. Agents invoke them on your behalf from chat or from automations.
Do I need to write code to connect WebCrawlerAPI to Dench?
No. You connect WebCrawlerAPI from your Dench workspace using WebCrawlerAPI's own sign-in and authorization flow — no API keys to copy, no glue code to maintain.
Is the WebCrawlerAPI integration secure?
Connections are authorized through WebCrawlerAPI's own authentication flow, and Dench stores only the authorization needed to act on your behalf. You can review and disconnect the WebCrawlerAPI connection from your workspace settings at any time.