Learn how to use the Spider Crawler integration with Julep
Configure Your API Key
Create Task Definition
Basic Configuration
spider_tool
is defined as an integration tool.Tool Configuration
integration
in this context.spider
for Spider.crawl
, links
, screenshot
, or search
. Defaults to crawl
if not specified.spider_api_key
) required for authentication.Workflow Configuration
spider_tool
).SPIDER_API_KEY
with your actual API key. Customize the url
, params
, and content_type
parameters to suit your specific needs.