How to setup you own secure single node hadoop cluster
Last modified : 1 October, 2011
These are the steps I followed to setup a single node secure 0.20 cluster. I’m sure there are other ways, but this is how I did it.
- Follow all the steps outlined under the “Kerberos” section at http://yahoo.github.com/hadoop-common/installing.html to set up a KDC.
- You can refer to my /var/kerberos/krb5kdc/kdc.conf and /etc/krb5.conf
- To clean up everything : http://mailman.mit.edu/pipermail/kerberos/2003-June/003312.html
- Create Kerberos database
$ sudo kdb5_util create -s
- Start Kerberos
$ sudo /etc/rc.d/init.d/kadmin start $ sudo /etc/rc.d/init.d/krb5kdc start
- Create principal raviprak/localhost.localdomain@localdomain http://web.mit.edu/kerberos/krb5-1.5/krb5-1.5.4/doc/krb5-admin/Adding-or-Modifying-Principals.html
- Create keytab file using
xst -k /home/raviprak/raviprak.keytab raviprak/localhost.localdomain@localdomain
- Setup hdfs-site.xml and core-site.xml
sudo hostname localhost.localdomain# If that is not already your hostname
hadoop-daemon.sh start namenode
sudo bash. Then
export HADOOP_SECURE_DN_USER=raviprak. Then
hadoop-daemon.sh start datanode
Please add comments here:
All content on this website is licensed as Creative Commons-Attribution-ShareAlike 4.0 License. Opinions expressed are solely my own.