Hi Dynamicweb,
It's our first website with swift, and we don't know if anything has changed regarding robots.txt
We have a problem about robots.txt. We want to "disallow" the website until we launch it.
So our configuration is:
User-agent:*
Disallow:/
But something is wrong because the url show nothing inside robots.txt:
And according to this plugin, there seems to be an error:
Any idea?
Thank you!!
It is because Swift in some databases has a hidden robots.txt file that overrides the default:
Just delete that page and the one from website settings will be available.
Thank you Nicolai!
I have just deleted:
I have deleted cookies in my browser and delted parsed...but robots,txt still not working.
Do i need to do anything else?
You must be logged in to post in the forum