Tuesday, February 2, 2016

HDFS Issues

HDFS client failed to install due to bad symlink:
----------------------------------------------------------------
Error Message:
 File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 87, in action_create  raise Fail("Applying %s failed, parent directory %s doesn't exist" % (self.resource, dirname)) resource_management.core.exceptions.Fail: Applying File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml'] failed, parent directory /usr/hdp/current/hadoop-client/conf doesn't exist
Sol: might be you have multiple versions of the rpms in our local yum repo so ambari was confused and pulling older rpms, causing this error AND also check:
1) might BE your previous Ambari clean up didn't happen properly.
2) Is hdfs-client installed on that host?
3) As always, verify correct permissions exist on the directories.
    EX:
    lrwxrwxrwx 1 root root 30 Oct 13 00:24 hadoop-client -> /usr/hdp/2.4.0.0-2042/hadoop