cheapCrawler
Complete Feature Suite

Everything you need for technical SEO.
Zero cloud bloat.

Explore CheapCrawler's comprehensive auditing capabilities—from embedded headless JavaScript execution to automated local LLM fixes.

Buy License →
Engine Core

High-Speed Local Crawling with Chromium JS Rendering

CheapCrawler renders modern client-side Single Page Applications (Next.js, Nuxt, React, Vue, Angular) using a lightweight embedded Chromium engine. Crawl thousands of URLs without missing dynamic DOM content.

✓

Custom User-Agent & Concurrency

Switch between Googlebot Mobile, Googlebot Desktop, or custom crawler headers with per-domain rate limits.

✓

Robots.txt & Canonical Handling

Full compliance with robots.txt directives, custom user-agent rules, and canonical loop detection.

✓

Regex URL Filters & Parameter Stripping

Easily exclude staging routes, admin panels, or strip tracking parameters (UTM, fbclid) on the fly.

crawl_config.json
● 100% Native
{
  "target": "https://example-shop.com",
  "max_concurrency": 16,
  "render_javascript": true,
  "chromium_headless": true,
  "user_agent": "Googlebot/2.1 (+http://www.google.com/bot.html)",
  "respect_robots_txt": true,
  "extract_schema_jsonld": true,
  "strip_url_query_params": ["utm_*", "gclid"],
  "storage": "sqlite3://./local_crawls/example.db"
}
Crawl Speed: ~180 URLs/sec RAM: < 250MB
Live AI Rewrite Generator Ollama Llama-3.2 Ready
Original Title (Weak, 21 chars):
Buy shoes online store
Suggested AI Title (Optimized, 58 chars):
Premium Running & Trail Shoes | Free Delivery & 30-Day Returns
Original Meta Description:
Missing completely from HTML tag
Generated Meta Description (154 chars):
Shop lightweight running sneakers, trail footwear, and athletic accessories. Designed for comfort, durability, and high performance. Shop now.
Automation

Instant AI Meta & Schema Rewrites

Don't spend hours writing meta descriptions and title tags one by one. CheapCrawler passes page headings and body text to your local or API model to generate compliant, high-converting metadata.

✓

Zero-Markup BYOK Architecture

Connect Google Gemini, OpenAI GPT-4o, or Anthropic Claude API keys directly with zero third-party surcharge.

✓

100% Free Offline Local AI via Ollama

Run Llama 3 or Mistral offline on your Mac or PC with zero network calls and complete confidentiality.

✓

1-Click Bulk Export

Export ready-to-import CSVs for WordPress (Yoast/RankMath), Shopify, Webflow, or custom CMSs.

Comprehensive Technical SEO Checklist

Every technical vulnerability is flagged with clear root causes and recommended fixes.

404

Broken Links & Redirect Loops

Pinpoint exact source anchor tags pointing to 4xx dead ends, 5xx server errors, or multi-hop redirect chains.

H1

Heading Structure & Content

Detect missing H1 tags, duplicate headings, skipped H2-H6 levels, and low word-count thin pages.

</>

Canonicals & Directives

Flag non-self-referential canonicals, conflicting noindex directives, and missing hreflang alternates.

IMG

Image Optimization

Detect images missing alt text, oversized graphics (> 250KB), broken image URLs, and non-WebP formats.

MAP

XML Sitemap Generation

Generate valid Google-compliant XML sitemaps filtered to indexable 200 OK pages with one click.

CWV

Core Web Vitals Estimator

Estimate LCP, CLS, and page asset payload sizes directly on your local device during crawls.

What's Next

Product Roadmap (2026)

Our upcoming milestones for the CheapCrawler desktop application.

v2.5 (Q4 2026) In Development

Automated Scheduled Background Audits & Crawl Diffing

Run silent weekly crawls on your Mac/PC and receive an alert showing newly introduced 404s and meta drops.

ETA: Nov 2026
v2.6 (Q1 2027) Planned

Google Search Console Direct API Link

Correlate desktop technical crawl diagnostics with real impression clicks and indexing coverage directly.

ETA: Jan 2027

Ready to test these features on your website?

Download CheapCrawler for free. No credit card, no sign-up wall.

Compare License Tiers