Connect Dust and WebCrawler API to Build Intelligent Automations
Choose a Trigger
When this happens...
New Document
Choose an Action
Automatically do this!
Scrape Webpage
Start Crawl Job
Search Crawl Job URL
Get Crawl Job
Cancel Crawl Job
Use the Built-in Integrations
Actions and Triggers
When this happensTriggers
A trigger is an event that starts a workflow.
New Document
Triggers when a new document is created / upserted.
Do thisActions
Action is the task that follows automatically within your Dust integrations.
Talk to an Agent
Send a message to a Dust a gent and retrieve the answer.
Upload Document
Upload a document to a Dust Data Source / Folder.
Search Agent
Search for agent configurations by name in the workspace.
Scrape Webpage
Scrape content from any webpage.
Start Crawl Job
Start Crawl Job for any Website.
Search Crawl Job URL
Get url from Crawl Job ID.
Know More About Dust and Webcrawlerapi Integrations
How viaSocket Works | A Complete Guide
Gain insights into how viaSocket functions through our detailed guide. Understand its key features and benefits to maximize your experience and efficiency.
5 Simple Automation Hacks to Make Your Team Free
Unlock your team's potential with 5 straightforward automation hacks designed to streamline processes and free up valuable time for more important work.
What is Workflow Automation - Definition, Importance & Benefits | A Complete Guide
Workflow automation is the process of using technology to execute repetitive tasks with minimal human intervention, creating a seamless flow of activities.
Frequently Asked Questions
To start, connect both your Dust and WebCrawler API accounts to viaSocket. Once connected, you can set up a workflow where an event in Dust triggers actions in WebCrawler API (or vice versa).
Absolutely. You can customize how Dust data is recorded in WebCrawler API. This includes choosing which data fields go into which fields of WebCrawler API, setting up custom formats, and filtering out unwanted information.
The data sync between Dust and WebCrawler API typically happens in real-time through instant triggers. And a maximum of 15 minutes in case of a scheduled trigger.
Yes, viaSocket allows you to add custom logic or use built-in filters to modify data according to your needs.
Yes, you can set conditional logic to control the flow of data between Dust and WebCrawler API. For instance, you can specify that data should only be sent if certain conditions are met, or you can create if/else statements to manage different outcomes.
About Dust
Dust.tt is a comprehensive workflow automation platform designed to seamlessly integrate and manage data across various sources. It provides robust tools for automating document workflows, data management, and API integrations, helping businesses streamline their operations. Whether it's cloud storage, document handling, or real-time data syncing, Dust.tt allows users to efficiently manage data sources and automate processes to boost productivity.
Learn MoreAbout WebCrawler API
WebCrawler API provides a powerful and efficient way to extract data from websites. It is designed to help developers and businesses automate the process of web scraping, enabling them to gather information from various online sources quickly and accurately. With features like customizable crawling rules, data extraction, and integration capabilities, WebCrawler API is an essential tool for anyone looking to harness the power of web data.
Learn MoreviaSocket
For SaaS
For AI Agent Builders
Support
Automation Experts
Plans, Pricing and Offer
AI & Automation
© 2025 viaSocket |Privacy,TermsandData Retention & Deletion Policy
Walkover Web Solutions Pvt Ltd. | All rights reserved.