Details
Improvement
Closed
Major
Description
Need to update the robots.txt file available at web root and add the two following lines :
User-agent: *
Disallow: /
without those information, performances can really collapse as robots go through all links.
Need to update the robots.txt file available at web root and add the two following lines :
User-agent: *
Disallow: /
without those information, performances can really collapse as robots go through all links.