Scribd Logo
Upload

Welcome to Scribd!

  • Robots

    Uploaded by

    Arunachalam Nagarajan
    16 views1 page
    This document disallows several paths from being accessed by web crawlers including those related to updates, installations, administration and configuration like /update/, /install/, /admin.php, /admin/, /config.php, and information files like /license.html and /readme.md.

    Original Description:

    Original Title

    robots.txt

    Copyright

    © © All Rights Reserved

    Available Formats

    TXT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document disallows several paths from being accessed by web crawlers including those related to updates, installations, administration and configuration like /update/, /install/, /admin.php, /admin/, /config.php, and information files like /license.html and /readme.md.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as txt, pdf, or txt
    16 views1 page

    Robots

    Uploaded by

    Arunachalam Nagarajan
    This document disallows several paths from being accessed by web crawlers including those related to updates, installations, administration and configuration like /update/, /install/, /admin.php, /admin/, /config.php, and information files like /license.html and /readme.md.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as txt, pdf, or txt
    of 1

    User-agent: *

    Disallow: /update/
    Disallow: /install/
    Disallow: /admin.php
    Disallow: /admin/
    Disallow: /config.php
    Disallow: /license.html
    Disallow: /readme.md

    You might also like