mailing list archives
Re: Fwd: hadoop and hbase information gathering
From: John Bond <john.r.bond () gmail com>
Date: Fri, 14 Oct 2011 00:14:31 +0200
On 13 October 2011 23:47, Patrick Donnelly <batrick () batbytes com> wrote:
On Thu, Oct 13, 2011 at 5:04 PM, Patrick Donnelly <batrick () batbytes com> wrote:
On Thu, Oct 13, 2011 at 4:17 PM, David Fifield <david () bamsoftware com> wrote:
On Thu, Oct 13, 2011 at 12:32:01AM +0200, John Bond wrote:
Can you recommend an easy way to set up Hadoop and Hbase to test?
how much capacity do you have 1-4 machines? let me know and i can give
you guidelines. if you are familiar with cfengine 3 i can send you my
Um, I can set up some VMs I guess? I've never used Hadoop nor Hbase, and
"apt-get install hadoop" didn't work. I don't know what cfengine is. Is
there a way to set up a minimal "cluster" of one machine?
I have a Hadoop cluster here to play with at my University. I'll give
the scripts a go.
Attached is the output I get from running:
./nmap --datadir $PWD --script $HOME/hadoop-nse -p 8020,8030,8033,8023
-vv -dd -n -PN namenode-hostname > OUTPUT 2>&1
I had to modify the scripts (inside $HOME/hadoop-nse) to work on those
ports. The ports we use are not the default ones. I think there should
be service probes added so that this isn't necessary.
There are script errors in the output because I changed the scripts to
run the action against every port.
The output from some scripts is empty. I don't know why. For example:
| Datanodes (Live):
|_ Datanodes (Dead):
Let me know if you want me to do additional tests...
- Patrick Donnelly
can you send me the output of the script with nmap -ddd (this will
produce a lot of output, some of which you may want to scrub)
@david it is no a simple task to set up hadoop, not sure if you can
even run everything on the same box. ill try to build a vm or some
guidlines this weekend. in the mean time the cloudera docs are good
Sent through the nmap-dev mailing list
Archived at http://seclists.org/nmap-dev/