OrbiCrawl AI

User manual

How OrbiCrawl AI works

No jargon, no magic — just a clear tour of what happens between “here's a list of websites” and “here's a clean, verified lead database,” and what every part of the product does for you.

The pipeline

Five stages, fully automatic

  1. Add websites

    Paste one URL or thousands, upload a CSV (any column named url, website or domain works), or type a search like “dental clinics in Austin” and let Discover find candidate sites for you. Everything is normalized and deduplicated before the crawl starts. Crawl options →

  2. Crawl in parallel

    Distributed workers fan out across your list. Each site is fetched politely — robots.txt honored, one request per second per host, bounded retries — and JavaScript-heavy pages are rendered in a real headless browser so nothing hidden behind scripts is missed. Progress streams live to your dashboard.

  3. Extract & validate

    From every page we pull emails, phone numbers, social profiles, company details and technology fingerprints. Then the noise is removed: emails are MX-verified so they actually receive mail, and phone numbers must pass strict plausibility rules before they're kept and normalized to international format.

  4. Enrich & score

    Each lead is layered with intelligence: domain and hosting analysis, security posture, on-page SEO score, a 0–100 website-quality grade, firmographics from structured data — and, on demand, AI enrichment that writes a company summary, assigns an industry, scores the lead and matches it against your Ideal Customer Profile.

  5. Export & automate

    Finished leads land in your workspace, ready to download as CSV, Excel or JSON, pull via the REST API, or push automatically to HubSpot, Airtable, or any Zapier/Make/n8n webhook the moment a job completes. Schedules re-crawl on an interval so your data never goes stale.

Guided tour

What every part of the dashboard does

Overview

Your command center — credits, recent jobs, activity and quick actions in one glance.

Why it helps: Land here each morning and know in seconds what ran overnight and what needs attention.

Jobs

Create and monitor crawl jobs: URL lists, CSV uploads, crawl depth, browser rendering, retries and live per-site progress.

Why it helps: One job can process thousands of sites while you do something else — credits for failed sites are refunded automatically.

Discover

Turn a plain-English search query into a list of candidate websites, then crawl the ones you pick.

Why it helps: Prospect in markets where you don't have a list yet — no scraping tools or bought databases needed.

Leads

Every extracted contact across all crawls — searchable, filterable, expandable to the full enrichment detail, and exportable.

Why it helps: This is the payoff: verified emails, real phone numbers and company intelligence, ready for outreach.

Schedules

Re-crawl a fixed set of sites on an interval, with a monitor mode that flags sites whose content changed.

Why it helps: Watch competitors, track portfolio companies, or keep lead data fresh without lifting a finger.

Workflows

Automations that run when a job completes — today's step pushes new leads straight into a connected integration.

Why it helps: Set it once and every finished crawl syncs itself to your CRM. No polling, no manual exports.

Analytics

Usage trends, credit burn, forecasts of when you'll run out, and the shape of your lead database.

Why it helps: Budget with confidence — see exactly what you're consuming and what you're getting back.

Assistant

A chat assistant grounded in your workspace's own data — ask “how many leads have a phone?” or “how do I export?”.

Why it helps: Answers about your data without writing a filter or opening the docs.

Billing

Plans, credit packs, multi-currency pricing, invoices and payment history.

Why it helps: Credit-based pricing means you pay for what you crawl — start free with 100 credits, no card.

Settings

Profile, workspace, branding, Ideal Customer Profile, API keys, integrations, webhooks, referrals, compliance and support.

Why it helps: Define your ICP once and every AI match scores against it; create an API key and the whole platform is scriptable.

Where it fits

How teams use it

Agencies filling client pipelines

Discover local businesses by niche and city, crawl them, and hand clients a spreadsheet of verified contacts with quality grades — the same afternoon.

SaaS outbound teams

Feed in target-account lists, let AI score each against your ICP, and push the strong fits into HubSpot with personalized outreach drafts.

Local-services prospecting

Long-tail and local businesses rarely appear in contact databases. Crawling their live websites is often the only way to reach them — and the freshest.

Market research & monitoring

Schedule recurring crawls over a market segment, watch the change feed, and track technology adoption across thousands of sites.

Credits, simply

  • One credit ≈ one website crawled; AI features cost a few credits per call, shown before you run them.
  • Credits are reserved when a job starts — anything unused (skipped or failed sites) is refunded to your balance when it finishes.
  • Plan credits reset each billing period; top-up packs never expire.
  • Every account starts free with 100 credits and no card.
See pricing

Built to crawl responsibly

OrbiCrawl only visits public websites, honors robots.txt, rate-limits itself to stay polite, and extracts information businesses publish on purpose. What you may do with the data is spelled out plainly in our Acceptable Use Policy — and how we protect it in the Privacy Policy.

Building on top of the platform instead? The developer documentation covers the API, SDKs, webhooks and integrations end to end.

See it work on your own list

Paste ten websites and watch them become leads. 100 free credits, no credit card, nothing to install.