Web Crawler used for Geographical Mapping
The Geo crawler is focused in establishing relations from an origin website (sent by the user) to a number of domain urls present on the origin website as href links.
The content on the websites visited is irrelevant for the process, as visited sites are threaten as a single domain.
The present demo does not make any difference on subdomains, which means, that a single request is done to each domain.
The geographical information is collected and then displayed in a world-wide map, with websites represented as markers in the map, linked each other in nodes graph shape.. Only properly formatted links referring to external domains to that website are considered then collected to generate results on the map.
Acting as a very nice bot
The web crawler does not follow redirects and does not hit twice the same url. This means no bandwith or server overload caused on the visited domains' hosts.
This website can be freely used under a reasonable usage. Any abuse or improper use of the application will force the ban of the request origin ip address during an indeterminate perior of time, being non possible the whitelisting of any ip address causing abuse.