异常-java.util.concurrent.TimeoutException: Futures timed out after [100000 milliseconds]
2024-08-27 04:13:39
1 详细异常
java.util.concurrent.TimeoutException: Futures timed out after [100000 milliseconds]
at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:223)
at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:227)
at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:220)
at org.apache.spark.deploy.yarn.ApplicationMaster.runDriver(ApplicationMaster.scala:468)
at org.apache.spark.deploy.yarn.ApplicationMaster.org$apache$spark$deploy$yarn$ApplicationMaster$runImpl(ApplicationMaster.scala:305)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$run$1.apply$mcV$sp(ApplicationMaster.scala:245)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$run$1.apply(ApplicationMaster.scala:245)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$run$1.apply(ApplicationMaster.scala:245)
at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$3.run(ApplicationMaster.scala:773)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1924)
at org.apache.spark.deploy.yarn.ApplicationMaster.doAsUser(ApplicationMaster.scala:772)
at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:244)
at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:797)
at org.apache.spark.deploy.yarn.ApplicationMaster.main(ApplicationMaster.scala)
2 解决方案
提交到yarn 但是配置文件 应该改成yarn
spark.master=local
最新文章
- angular2系列教程(五)Structural directives、再谈组件生命周期
- 设置datagridview中button按钮的背景颜色
- 一个通用的Makefile (转)
- Java中的文件操作
- java中的单例模式与doublecheck
- css重置
- C++第二天学习
- Sublime Text 关闭自动更新的办法
- AngularJS 全局scope与指令 scope通信
- jQuery.Ajax IE8,9 无效(CORS跨域)
- servlet中如何实现通过Spring实现对象的注入
- js forEach跳出循环
- MobX响应式编程库
- python运行过程
- Git - 必知必会
- JavaOne 2016主旨演讲畅谈Java近期及远期规划
- 20155321 《网络对抗》 Exp6 信息搜集与漏洞扫描
- 汇编 REPE/REPZ 指令,CMPSB指令
- 支持向量机:Numerical Optimization,SMO算法
- H5页面开发笔记(react技术栈)