Smart crawling your website...
0
Unique Pages
0
Crawled
0
In Queue
0
Skipped
Current: -
đ¯ Smart Crawler - Balanced Filtering
This intelligent crawler automatically filters out:
- â Feed URLs (/feed/, /rss/, /atom/)
- â WordPress duplicate parameters (?p=123, ?page_id=, etc.)
- â API endpoints (wp-json, xmlrpc.php)
- â Tracking parameters (utm_, fbclid, gclid)
- â System files and admin pages
đ Manual URL Import
Add additional URLs manually (one per line):
â Discovered URLs
0 URLs found