Ranking bot type 1


These bots are retrieving information for the domain ranking. They perform simplistic backlink-counting actions and only store the following information:This bot only visits URLs which aren't forbidden by the corresponding robots.txt file.As usual, I am the sole author of these bots and developed them completely from scratch (PHP + MySQL/MariaDB).