############################### # # User-agent: * # # list folders robots are not allowed to index # Disallow: /admin/ Disallow: /articles_max/ Disallow: /articlews_min/ Disallow: /bg/ Disallow: /bg_max/ Disallow: /bg_min/ Disallow: /classes/ Disallow: /css/ Disallow: /demo/ Disallow: /im_max/ Disallow: /im_min/ Disallow: /images/ Disallow: /inc/ Disallow: /js/ Disallow: /links/ Disallow: /logos_max/ Disallow: /logos_min/ Disallow: /modules/ Disallow: /mov/ Disallow: /publicity_materials/ Disallow: /red_stats/ Disallow: /templates/ Disallow: /titles_max/ Disallow: /titles_min/ Disallow: /worldpay/ # list specific files robots are not allowed to index # # ###############################