Friday, 15 June 2012

java - Namenode throwing EPERM: Operation not permitted on startup -



java - Namenode throwing EPERM: Operation not permitted on startup -

what should file permissions yarn.nodemanager.local-dirs folders? have messed file permissions these , not able solve it. have set folder permissions 755 yarn:hadoop. whenever seek run nodemanager, run eperm: operation not permitted error. details -

2014-06-19 22:15:17,954 info org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice: usercache path : file://opt1/yarn/nm2/usercache_del_1403241103430 2014-06-19 22:15:17,954 info org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice: usercache path : file://opt1/yarn/nm2/usercache_del_1403241317919 2014-06-19 22:15:17,954 info org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice: usercache path : file://opt1/yarn/nm2/usercache_del_1403241109852 2014-06-19 22:15:17,954 info org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice: usercache path : file://opt1/yarn/nm2/usercache_del_1403241098628 2014-06-19 22:15:17,992 info org.apache.hadoop.service.abstractservice: service org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice failed in state inited; cause: org.apache.hadoop.yarn.exceptions.yarnruntimeexception: failed initialize localizationservice org.apache.hadoop.yarn.exceptions.yarnruntimeexception: failed initialize localizationservice @ org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice.serviceinit(resourcelocalizationservice.java:233) @ org.apache.hadoop.service.abstractservice.init(abstractservice.java:163) @ org.apache.hadoop.service.compositeservice.serviceinit(compositeservice.java:108) @ org.apache.hadoop.yarn.server.nodemanager.containermanager.containermanagerimpl.serviceinit(containermanagerimpl.java:220) @ org.apache.hadoop.service.abstractservice.init(abstractservice.java:163) @ org.apache.hadoop.service.compositeservice.serviceinit(compositeservice.java:108) @ org.apache.hadoop.yarn.server.nodemanager.nodemanager.serviceinit(nodemanager.java:188) @ org.apache.hadoop.service.abstractservice.init(abstractservice.java:163) @ org.apache.hadoop.yarn.server.nodemanager.nodemanager.initandstartnodemanager(nodemanager.java:353) @ org.apache.hadoop.yarn.server.nodemanager.nodemanager.main(nodemanager.java:401) caused by: eperm: operation not permitted @ org.apache.hadoop.io.nativeio.nativeio$posix.chmodimpl(native method) @ org.apache.hadoop.io.nativeio.nativeio$posix.chmod(nativeio.java:226) @ org.apache.hadoop.fs.rawlocalfilesystem.setpermission(rawlocalfilesystem.java:629) @ org.apache.hadoop.fs.rawlocalfilesystem.mkdirs(rawlocalfilesystem.java:421) @ org.apache.hadoop.fs.filesystem.primitivemkdir(filesystem.java:1061) @ org.apache.hadoop.fs.delegatetofilesystem.mkdir(delegatetofilesystem.java:157) @ org.apache.hadoop.fs.filterfs.mkdir(filterfs.java:187) @ org.apache.hadoop.fs.filecontext$4.next(filecontext.java:720) @ org.apache.hadoop.fs.filecontext$4.next(filecontext.java:716) @ org.apache.hadoop.fs.fslinkresolver.resolve(fslinkresolver.java:90) @ org.apache.hadoop.fs.filecontext.mkdir(filecontext.java:716) @ org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.resourcelocalizationservice.serviceinit(resourcelocalizationservice.java:230) ... 9 more

the local-dirs folder has next folders after failed start effort - filecache, nmprivate, 3 usercache_del_timestamp. based on location of error(resourcelocalizationservice.java, line 233), 3 possible actions raise error - a) cleaning old files - works, reflected in log output b) creating new files - after failed start attempt, see 3 kinds of files in local-dirs - 3 usercache_del_*, filecache, nmprivate files. c) making log paths - have checked log folders have permission 775 yarn:hadoop.

what perchance going wrong? i'm using cloudera manager cluster.

you should allow nodemanager dir have executive power, chmod 700 ..(nodemanager dir)

java hadoop yarn cloudera-manager cloudera-cdh

No comments:

Post a Comment