Prevent topic-list and other urls from being listed on search engine

Permalink
Hi,
I realized that I have some things listed in googe that could damagem my seo as they all return error pages. I can see the following comint out on google and would like to prevent this to happen or understand why this happens or if this is something I should be taking advantage of
.
Many thanks.

What gets lilsted on google :

concrete/blocks/topic_list/
/concrete/tools/conversations/
concrete/blocks/rss_displayer/
concrete/controllers/dialog/
concrete/authentication/concrete/db.xml
/concrete/blocks/core_stack_display/db.xml

 
Gondwana replied on at Permalink Reply
Gondwana
By default, c5 puts something in robots.txt that stops google from exploring those folders (I think). You might need to check whether that file is writeable by c5.