Skip to main content

Firecrawl

The Firecrawl connection allows you to connect the Firecrawl API to Siesta AI and use web crawling as a data source in agents, workflows, and data collections.

1. Obtaining an API Key in Firecrawl​

First, you need to obtain an API key in your Firecrawl account:

  • open the Firecrawl dashboard,
  • in the API Key and Code Snippets section, copy your API key,
  • prepare your API endpoint (typically https://api.firecrawl.dev).

Firecrawl API key and code snippets

Example of filling in the API URL and API token:

Firecrawl API credential setup example

2. Adding Firecrawl Connection in Siesta AI​

  1. In the Connections section, click on Add Connection.
  2. In the dialog, select the Firecrawl tile.
  3. Proceed to the configuration details.

3. Configuring the Connection​

In the form, fill in:

  • Name: internal name of the connection.
  • Provide your ApiKey: API key from your Firecrawl account.
  • Provide your Firecrawl api url: API URL (e.g., https://api.firecrawl.dev).
  • Visibility: Private or Shared.

After saving, the connection is available for use on the platform.

Firecrawl connection form in Siesta AI

4. Using as a Data Source​

Firecrawl can also be used as a data source in data collections. The user adds Firecrawl when creating a source in the collection and sets up synchronization and source parameters.

Summary​

The Firecrawl connection in Siesta AI provides a simple connection to the Firecrawl API via API key and API URL. After configuration, it can be used in automations as well as a data source.

Technical Notes​

  • Implementation: The connection wraps Firecrawl web extraction APIs.
  • Authentication/scopes: uses a Firecrawl API key. Access is limited by the Firecrawl plan, crawl limits, and target-site policies.
  • Functions: scrape a single page, crawl a site, map a site, and run web search through Firecrawl.
  • Write behavior: functions do not write to the target site, but they can fetch external content. Respect robots, customer data rules, and internal URL policies.