Home page logo

nmap-dev logo Nmap Development mailing list archives

Re: [NSE] http-useragent-tester.nse
From: George Chatzisofroniou <sophron () latthi com>
Date: Sat, 10 Aug 2013 22:36:47 +0300

On Thu, Jul 25, 2013 at 09:10:56PM +0300, George Chatzisofroniou wrote:
The attached script sets various User-Agent headers that are used by different
ultities and crawling libraries (for example CURL or wget). If a request is
redirected to a page different than a (valid) browser request would, that
means that this ultity is banned.

I sorted the results by "allowed" and "forbidden" so now the output looks like this:

 | http-useragent-tester:
 |     Allowed User Agents:
 |     lwp-trivial
 |     PHP/
 |     Python-urllib/2.5
 |     GT::WWW
 |     Snoopy
 |     MFC_Tear_Sample
 |     HTTP::Lite
 |     PHPCrawl
 |     URI::Fetch
 |     Zend_Http_Client
 |     http client
 |     PECL::HTTP
 |     WWW-Mechanize/1.34
 |     Forbidden User Agents:
 |     libwww redirected to: https://www.facebook.com/unsupportedbrowser (different host)
 |     libcurl-agent/1.0 redirected to: https://www.facebook.com/unsupportedbrowser (different host)
 |_    Wget/1.13.4 (linux-gnu) redirected to: https://www.facebook.com/unsupportedbrowser (different host)

I commited the script to the trunk as revision 31730. I may come back and do
further improvements on the script later based on the research i'm doing.

George Chatzisofroniou
Sent through the dev mailing list
Archived at http://seclists.org/nmap-dev/

  By Date           By Thread  

Current thread:
[ Nmap | Sec Tools | Mailing Lists | Site News | About/Contact | Advertising | Privacy ]