Excluding Site Files from Search Index
Permalink
Hello,
I am trying to exclude specific PDF's and other files from being indexed. Unlike pages, files within the file manager do not have custom attributes to exclude from search. Any recommendations on how I can accomplish this so I can add files to my website that are not indexed by google?
I am trying to exclude specific PDF's and other files from being indexed. Unlike pages, files within the file manager do not have custom attributes to exclude from search. Any recommendations on how I can accomplish this so I can add files to my website that are not indexed by google?
Search engine indexing is handled with the robots.txt file. Here are some links I found on the topic that I think might be helpful to you.
http://www.robotstxt.org/robotstxt.html...
http://www.concrete5.org/documentation/how-tos/editors/basic-.htacc...
http://searchenginewatch.com/article/2356447/Managing-Your-Robots.t...
http://www.techrobo.org/disallow-pdf-files-using-robots-txt-google-...
https://productforums.google.com/forum/#!topic/webmasters/Fv8kDUYC6U...