Outbound Link Discovery Help
Crawl a seed URL and ingest discovered links into monitored URLs. You can also save recurring crawl seeds.
Crawl Page Guide
- Manual Crawl: Runs immediately using the values in the first form.
- Scope Controls: Allowed domains is a whitelist, Denied domains is a blacklist.
- Schedule A Crawl Seed: Saves a recurring crawl profile that runs automatically.
- Configured Crawl Seeds: Review status and run/enable/disable saved seeds.
- Recent Discoveries: Latest links found and whether they were added as monitored URLs.
Open a modal to configure and run either workflow.
Configured Crawl Seeds
| ID | Seed URL | Enabled | Interval | Last Run | Next Run | Scope | Actions |
|---|
Recent Discoveries
| When | Seed ID | Seed Domain | Source Page | Discovered URL | Domain | Added URL ID |
|---|