PDA

View Full Version : Uploading a robots.txt file



Biggles LLB
04-16-2006, 03:55 AM
Here's a question for the experts from a newbie:

Having created a robots.txt file (on Notepad), to precisely where does one upload that file?

I tried uploading it in a folder named public_html via FTP but that does not seem to have worked. Perhaps I read the instructions provided here (in a 'speed up your vB site' post) wrongly. All other advice in that post taken and working just great, thank you.

I looked for a public_html file. Couldn't find one so I created one containing the Notepad file and then uploaded that. It seems I have informed only myself so far. Still have spiders searching where they should not. Seems a pity to see them running into error or no permission dead-ends. BTW, anyone know anything about a spider called 'become'?

Any help greatly appreciated. :)

You know, I just have to say this again: the assistance we newbies get here on this amazing site is simply fantastic. Jelsoft should be PAYING you guys as their support experts. My site is so much improved by the little tweaks and very bright ideas I've been helped with here. And the stats are beginning to show the benefit of that help (50% up on last month). Hats off to the vB-FAQ team (extended applause to standing ovation).

Regards

Biggles LLB :D

Noppid
04-16-2006, 05:20 AM
It should be in the web root folder. The web root folder on cpanel managed hosting accounts is a folder called public_html. If you use another hosting account manager, put the robots.txt in the folder that represents the web root. Where http://www.example.com/index.html would be for instance.