Hello,

I wonder can anyone shed any light on this for me. My robots.txt and sitemap.xml have been uploaded to the root folder and are no longer showing even though they are there? I have recently changed to SEO friendly URL's would that have something to do with it?

Many thanks in advance

Cheb

Hi Cheb
When you say, "no longer showing" how do you mean? How were they showing before?

Vince

Click Here for Shopping Cart Software
Click Here to sign up for our newsletter
Click Here for the latest updater

As it happens, this may have something to do with the issue. I had a look at the instructions and there are a couple of rules missing to exempt the robots.txt and xml files...

<rule name="Product Detail Page Match" stopProcessing="true">
<match url="^([^/]+)/?$" />
<conditions>
<add input="{URL}" pattern="\.asp" negate="true" />
<add input="{URL}" pattern="\.css" negate="true" />
<add input="{URL}" pattern="\.gif" negate="true" />
<add input="{URL}" pattern="\.jpg" negate="true" />
<add input="{URL}" pattern="\.js" negate="true" />
<add input="{URL}" pattern="\.png" negate="true" />
<add input="{URL}" pattern="\.xml" negate="true" />
<add input="{URL}" pattern="robots\.txt" negate="true" />
<add input="{UNENCODED_URL}" pattern="[^/]+" />
</conditions>
<action type="Rewrite" url="proddetail.asp?prod={UrlEncode:{R:1}}" />
</rule>

Vince

Click Here for Shopping Cart Software
Click Here to sign up for our newsletter
Click Here for the latest updater

Hi Vince,

Thank you for getting back to me, I added that into our web.config file but it took the website down (config error)?


Cheb

Hi Cheb
Ok, that's not good but really all you are doing is adding these two rules to the existing ones...

<add input="{URL}" pattern="\.xml" negate="true" />
<add input="{URL}" pattern="robots\.txt" negate="true" />

Can you make sure they go in the right place, with the rest of the rules of this type. And add them one by one to see which is causing the problem if necessary.

Vince

Click Here for Shopping Cart Software
Click Here to sign up for our newsletter
Click Here for the latest updater

Thanks Vince,

Both those worked :-)