Home page logo

nmap-dev logo Nmap Development mailing list archives

Re: Fwd: hadoop and hbase information gathering
From: John Bond <john.r.bond () gmail com>
Date: Fri, 14 Oct 2011 00:14:31 +0200

On 13 October 2011 23:47, Patrick Donnelly <batrick () batbytes com> wrote:
On Thu, Oct 13, 2011 at 5:04 PM, Patrick Donnelly <batrick () batbytes com> wrote:
On Thu, Oct 13, 2011 at 4:17 PM, David Fifield <david () bamsoftware com> wrote:
On Thu, Oct 13, 2011 at 12:32:01AM +0200, John Bond wrote:
Can you recommend an easy way to set up Hadoop and Hbase to test?

how much capacity do you have 1-4 machines? let me know and i can give
you guidelines.  if you are familiar with cfengine 3 i can send you my

Um, I can set up some VMs I guess? I've never used Hadoop nor Hbase, and
"apt-get install hadoop" didn't work. I don't know what cfengine is. Is
there a way to set up a minimal "cluster" of one machine?

I have a Hadoop cluster here to play with at my University. I'll give
the scripts a go.

Attached is the output I get from running:

./nmap --datadir $PWD --script $HOME/hadoop-nse -p 8020,8030,8033,8023
-vv -dd -n -PN namenode-hostname > OUTPUT 2>&1

I had to modify the scripts (inside $HOME/hadoop-nse) to work on those
ports. The ports we use are not the default ones. I think there should
be service probes added so that this isn't necessary.

There are script errors in the output because I changed the scripts to
run the action against every port.

The output from some scripts is empty. I don't know why. For example:

| hadoop-namenode-info:
|   Datanodes (Live):
|_  Datanodes (Dead):

Let me know if you want me to do additional tests...

- Patrick Donnelly

can you send me the output of the script with nmap -ddd (this will
produce a lot of output, some of which you may want to scrub)

@david it is no a simple task to set up hadoop, not sure if you can
even run everything on the same box.  ill try to build a vm or some
guidlines this weekend. in the mean time the cloudera docs are good
Sent through the nmap-dev mailing list
Archived at http://seclists.org/nmap-dev/

  By Date           By Thread  

Current thread:
[ Nmap | Sec Tools | Mailing Lists | Site News | About/Contact | Advertising | Privacy ]