Publisher review:Use this module when you are running multiple Drupal sites from a single code base (multisite) and you need a different robots.txt file for each one. This module generates the robots.txt file dynamically and gives you the chance to edit it, on a per-site basis, from the web UI.
Installation
- Unpack to your Drupal site modules directory (usually /sites/all/modules/)
- Enable from Administer > Site Building > Modules
Requirements: ยท Drupal 5.x/6.x
RobotsTxt is a PHP script for Drupal Modules scripts design by David Strauss.
It runs on following operating system: Windows / Linux / Mac OS / BSD / Solaris.
Operating system:Windows / Linux / Mac OS / BSD / Solaris