Spiders robots are usually search engines that search within your website and link to the contents of it, but of course, they have their negative aspect, and they can consume much of the bandwidth you have for that website. The reason that there is a program like Robots txt generator is to control and restrict the spiders that can access your website.
First of all, Robots txt generator is a web utility, totally free, very small and simple to use (it does not even require installation), which will allow you to limit the number of queries that each of the robots can do, per hour or per minute, within your website The program database is equipped by default with a list of 300 bots, but allows the user to add new ones, if desired, as well as specify different restrictions for each of the bots.
For example, in Robots txt generator you can allow access to Google Bot but not to Google Image Bot.
You can free download Robots txt generator and safe install the latest trial or new full version for Windows 10 (x32, 64 bit, 86) from the official site.
Devices: Desktop PC, Laptop (ASUS, HP, DELL, Acer, Lenovo, MSI), Ultrabook
OS: Professional, Enterprise, Education, Home Edition, versions: 1507, 1511, 1607, 1703, 1709, 1803, 1809