Home page logo
/

fulldisclosure logo Full Disclosure mailing list archives

Re: Google's robots.txt handling
From: Mario Vilas <mvilas () gmail com>
Date: Thu, 13 Dec 2012 12:40:02 +0100

That paragraph says pretty much the exact opposite of what you understood.

Also, could we please stop refuting points nobody even made in the first
place? OP never claimed this to be a vulnerability, nor ever said
robots.txt is a proper security mechanism to hide files in public web
directories.

All OP said was the way robots.txt is indexed allows for some Google dorks
to be made, and it may be a good idea to avoid that. Clearly it's not the
discovery of the century, but it seems fairly reasonable to me... I don't
get what all this fuzz is about.

On Wed, Dec 12, 2012 at 12:18 PM, Christoph Gruber <list () guru at> wrote:

On 12.12.2012 at 00:23 "Lehman, Jim" <jim.lehman () interactivedata com>
wrote:

It is possible to use white listing for robots.txt. Allow what you want
google to index and deny everything else. That way google doesn't make you
a goole dork target and someone browsing to your robots.txt file doesn't
glean any sensitive files or folders. But this will not stop directory
bruting to discover your publicly exposed sensitive data, that probably
should not be exposed to the web in the first place.

Maybe I misunderstood something, but do you really think that "sensitive"
can be hidden in "secret" directories on publicly reachable web servers?
--
Christoph Gruber
By not reading this email you don't agree you're not in any way affiliated
with any government, police, ANTI- Piracy Group, RIAA, MPAA, or any other
related group, and that means that you CANNOT read this email.
By reading you are not agreeing to these terms and you are violating code
431.322.12 of the Internet Privacy Act signed by Bill Clinton in 1995.
(which doesn't exist)

_______________________________________________
Full-Disclosure - We believe in it.
Charter: http://lists.grok.org.uk/full-disclosure-charter.html
Hosted and sponsored by Secunia - http://secunia.com/




-- 
“There's a reason we separate military and the police: one fights the enemy
of the state, the other serves and protects the people. When the military
becomes both, then the enemies of the state tend to become the people.”
_______________________________________________
Full-Disclosure - We believe in it.
Charter: http://lists.grok.org.uk/full-disclosure-charter.html
Hosted and sponsored by Secunia - http://secunia.com/

  By Date           By Thread  

Current thread:
[ Nmap | Sec Tools | Mailing Lists | Site News | About/Contact | Advertising | Privacy ]