ERROR [org.apache.hadoop.util.Shell] - Failed to locate the winutils binary in the hadoop binary path
2024-10-20 11:46:40
错误日志如下:
-- ::, DEBUG [org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginSuccess with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[Rate of successful kerberos logins and latency (milliseconds)], valueName=Time)
-- ::, DEBUG [org.apache.hadoop.metrics2.lib.MutableMetricsFactory] - field org.apache.hadoop.metrics2.lib.MutableRate org.apache.hadoop.security.UserGroupInformation$UgiMetrics.loginFailure with annotation @org.apache.hadoop.metrics2.annotation.Metric(about=, sampleName=Ops, always=false, type=DEFAULT, value=[Rate of failed kerberos logins and latency (milliseconds)], valueName=Time)
-- ::, DEBUG [org.apache.hadoop.metrics2.impl.MetricsSystemImpl] - UgiMetrics, User and group related metrics
-- ::, DEBUG [org.apache.hadoop.security.authentication.util.KerberosName] - Kerberos krb5 configuration not found, setting default realm to empty
-- ::, DEBUG [org.apache.hadoop.security.Groups] - Creating new Groups object
-- ::, DEBUG [org.apache.hadoop.util.NativeCodeLoader] - Trying to load the custom-built native-hadoop library...
-- ::, DEBUG [org.apache.hadoop.util.NativeCodeLoader] - Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: no hadoop in java.library.path
-- ::, DEBUG [org.apache.hadoop.util.NativeCodeLoader] - java.library.path=D:\Software\Java\jdk1..0_66\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;D:/Software/Java/jdk1..0_66/bin/../jre/bin/server;D:/Software/Java/jdk1..0_66/bin/../jre/bin;D:/Software/Java/jdk1..0_66/bin/../jre/lib/amd64;D:\Software\Anaconda;D:\Software\Anaconda\Library\mingw-w64\bin;D:\Software\Anaconda\Library\usr\bin;D:\Software\Anaconda\Library\bin;D:\Software\Anaconda\Scripts;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.\;D:\Software\MySQL Server\bin;D:\Software\CodeBlocks\share\CodeBlocks\MinGW\bin;D:\Software\hadoop2.6.0\hadoop-2.6.\bin;D:\Software\CTEX\UserData\miktex\bin;D:\Software\CTEX\MiKTeX\miktex\bin;D:\Software\CTEX\CTeX\ctex\bin;D:\Software\CTEX\CTeX\cct\bin;D:\Software\CTEX\CTeX\ty\bin;D:\Software\CTEX\Ghostscript\gs9.\bin;D:\Software\CTEX\GSview\gsview;D:\Software\CTEX\WinEdt;D:\Software\Java\jdk1..0_66\bin;D:\Software\Java\jdk1..0_66\jre\bin;C:\Users\Zimo\AppData\Local\Microsoft\WindowsApps;HADOOP_HOME\bin;D:\Software\搜狐影音\5.2.3.15;D:\Software\Java\eclipse;;.
-- ::, WARN [org.apache.hadoop.util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
-- ::, DEBUG [org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback] - Falling back to shell based
-- ::, DEBUG [org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback] - Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping
-- ::, DEBUG [org.apache.hadoop.security.Groups] - Group mapping impl=org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback; cacheTimeout=
-- ::, DEBUG [org.apache.hadoop.security.UserGroupInformation] - hadoop login
-- ::, DEBUG [org.apache.hadoop.security.UserGroupInformation] - hadoop login commit
-- ::, DEBUG [org.apache.hadoop.security.UserGroupInformation] - using local user:NTUserPrincipal: Zimo
-- ::, DEBUG [org.apache.hadoop.security.UserGroupInformation] - UGI loginUser:Zimo (auth:SIMPLE)
-- ::, DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.client.use.legacy.blockreader.local = false
-- ::, DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.client.read.shortcircuit = false
-- ::, DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.client.domain.socket.data.traffic = false
-- ::, DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - dfs.domain.socket.path =
-- ::, DEBUG [org.apache.hadoop.metrics2.impl.MetricsSystemImpl] - StartupProgress, NameNode startup progress
-- ::, DEBUG [org.apache.hadoop.io.retry.RetryUtils] - multipleLinearRandomRetry = null
-- ::, DEBUG [org.apache.hadoop.ipc.Server] - rpcKind=RPC_PROTOCOL_BUFFER, rpcRequestWrapperClass=class org.apache.hadoop.ipc.ProtobufRpcEngine$RpcRequestWrapper, rpcInvoker=org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker@543788f3
-- ::, DEBUG [org.apache.hadoop.hdfs.BlockReaderLocal] - Both short-circuit local reads and UNIX domain socket are disabled.
-- ::, ERROR [org.apache.hadoop.util.Shell] - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable D:\Software\hadoop2.6.0\hadoop-2.6.0\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:)
at org.apache.hadoop.conf.Configuration.getTrimmedStrings(Configuration.java:)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:)
at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:)
at org.apache.hadoop.fs.FileSystem.access$(FileSystem.java:)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:)
at com.hadoop.phoneStatistics.ExcelPhoneStatistics.run(ExcelPhoneStatistics.java:)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:)
at com.hadoop.phoneStatistics.ExcelPhoneStatistics.main(ExcelPhoneStatistics.java:)
-- ::, DEBUG [org.apache.hadoop.ipc.Client] - The ping interval is ms.
-- ::, DEBUG [org.apache.hadoop.ipc.Client] - Connecting to master/192.168.86.131:
解决方法:
1.未配置环境变量-->配置环境变量HADOOP_HOME,然后重启电脑。或者代码中设置System.setProperty("hadoop.home.dir", "hadoop安装路径")。
2.还有一种可能HADOOP_HOME的bin目录下根本没有winutils.exe,下载地址https://github.com/srccodes/hadoop-common-2.2.0-bin然后解压到该目录。
以上就是博主为大家介绍的这一板块的主要内容,这都是博主自己的学习过程,希望能给大家带来一定的指导作用,有用的还望大家点个支持,如果对你没用也望包涵,有错误烦请指出。如有期待可关注博主以第一时间获取更新哦,谢谢!
版权声明:本文为博主原创文章,未经博主允许不得转载。
最新文章
- JS组件系列——表格组件神器:bootstrap table(三:终结篇,最后的干货福利)
- php利用smtp发送邮件
- struts2 标签字体大小
- IOS的变量前加extern和static字段
- Matlab中Rand()函数用法
- dedecms 织梦显示时间格式
- linux命令之查看字符集
- Angular组件——父组件调用子组件方法
- uestc 1703一道更简单的字符串题目
- Ruby学习笔记之升级ruby的版本
- python与java的猜拳游戏
- 【Dubbo 源码解析】07_Dubbo 重试机制
- Android Intent Service
- SURF算法的一篇翻译与论证
- Java 异常模型综述
- 上传图片Security Error
- springcloud15---zuul-fallback
- Java之JVM调优案例分析与实战(4) - 外部命令导致系统缓慢
- Happy Swifting!
- mysql数据库导入到oracle数据库