# This file is used to notify crawlers/spiders what files to avoid User-agent: * Disallow: /admin/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /bin/ Disallow: /flash/ Disallow: /GALLERY/ Disallow: /js/ Disallow: /NetControls/ Disallow: /xml/