interCrawlerfrom interPost.net
interCrawler is a simple web crawler and search engine from interPost.net.
Results are designed to be quailty-first, and filter out SEO-abusive webpages and low quality content. This research project was spurred after years of degrading search results from larger search engines.
interCrawler follows robots.txt, noindex and snippet restrictions. It also uses request limits and does not attempt to bypass bot restrictions on websites.
Bot identity: interCrawlerBot.
Use the removal form below to contact the operator about crawling or indexed pages.
Add this group to your site’s /robots.txt:
User-agent: interCrawlerBot
Disallow: /
Use noindex to exclude individual pages. The crawler must be
allowed to fetch a page to read that directive. Indexed content is removed
when interCrawler detects a robots block or noindex directive.
Requests are manually reviewed to prevent malicious removal requests. Please include ownership details or explain any issues caused by interCrawler to help improvements and development!
Contact details and reasons are used for review, and manually deleted. Requests expire under the policy below. Requester IP addresses are not stored. Email alerts contain the request ID and target, but not your contact details or reason. Email copies are separate from the retention limits below.
Defaults: requests expire after 30 days.
interCrawler stores extracted text, metadata and links from webpages for search. Results will link to the original page and show a short content preview where permitted.
Removal deletes indexed content and blocks reindexing. Older copies will remain in system backups until cleanup. Restoring a backup will preserve your removal request.