top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

multiusers in hadoop through LDAP

+3 votes
362 views

In my cluster ,I want to have multiusers for different purpose. The usual method is to add a user through the OS on Hadoop NameNode.

I notice the hadoop also support to LDAP, could I add user through LDAP instead through OS? So that if a user is authenticated by the LDAP ,who will also access the HDFS directory?

posted Dec 10, 2013 by Deepankar Dubey

Share this question
Facebook Share Button Twitter Share Button LinkedIn Share Button
have you looked at hadoop.security.group.mapping.ldap.* in  hadoop-common/core-default.xml
additional resource may help

1 Answer

+1 vote

Please have a look at hadoop.security.group.mapping.ldap.* settings as per Garima's suggestion.

In advance, just want to share our story related to LDAP + hadoop.security.group.mapping.ldap.*, if you run into the same limitation as we did:

In many cases hadoop.security.group.mapping.ldap.* should solve your problem. Unfortunately, they did now work for us. The problematic setting relates to an additional filter to use when searching for LDAP groups. We wanted to use posixGroups filter, but it is currently not supported by Hadoop. Finally, we found a workaround using name service switch configuration where we specified that the LDAP should the primary source of information about groups of our users. This means that we solved this problem on the operating system level, not on Hadoop level.

Check the following link http://www.slideshare.net/AdamKawa/hadoop-adventures-at-spotify-strata-conference-hadoop-world-2013 (slides 18-26) should be helpful.

answer Dec 10, 2013 by Deepak Dasgupta
Similar Questions
+1 vote

I want to set up a multinode hadoop cluser on vmware. Can anybody suggest some good material to do so.

I have tried these https://www.dropbox.com/s/05aurcp42asuktp/Chiu%20Hadoop%20Pig%20Install%20Instructions.docx instruction to setup single node hadoop cluster on vmware. N

ow can anybody help me in creating a multinode hadoop cluster ( 3 nodes) on vmware?

+1 vote

I am trying to set up a hadoop cluster, I would like to know how many physical VMs are needed for this. . My main interest to measure the shuffle phase network traffic.

What is the basic requirement like namenode and data node .

+1 vote

I have Hadoop cluster set up on Amazon EC2. When I am trying to access the application logs through Web UI I am getting page cant be displayed.

Configuration of Cluster: My Namenode is mapped with elastic IP(static) of EC2. Other datanodes public IP changing everyday as we are stopping the clustering during non working hours.

Observation :When I try to view the logs ,Its picking one of the datanode private IP and I am getting Page cant be displayed.

...