IDEA kafka producer数据输出缓慢 和 kafka consumer 报错的处理
问题1.
IDEA 中Kafa_Producer程序数据输出缓慢 但不报错
问题2.
Kafa_Consumer程序报错：
17/11/10 11:31:11 ERROR ReceiverTracker: Deregistered receiver for stream 0: Error starting receiver 0 - org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to zookeeper server 'localhost:2181' with timeout of 10000 ms
at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1233)
at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:157)
at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:131)
at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:103)
at kafka.utils.ZkUtils$.apply(ZkUtils.scala:85)
at kafka.consumer.ZookeeperConsumerConnector.connectZk(ZookeeperConsumerConnector.scala:194)
at kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:142)
at kafka.consumer.ZookeeperConsumerConnector.<init>(ZookeeperConsumerConnector.scala:159)
at kafka.consumer.Consumer$.create(ConsumerConnector.scala:112)
at org.apache.spark.streaming.kafka.KafkaReceiver.onStart(KafkaInputDStream.scala:100)
at org.apache.spark.streaming.receiver.ReceiverSupervisor.startReceiver(ReceiverSupervisor.scala:149)
at org.apache.spark.streaming.receiver.ReceiverSupervisor.start(ReceiverSupervisor.scala:131)
at org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverTrackerEndpoint$$anonfun$9.apply(ReceiverTracker.scala:607)
at org.apache.spark.streaming.scheduler.ReceiverTracker$ReceiverTrackerEndpoint$$anonfun$9.apply(ReceiverTracker.scala:597)
at org.apache.spark.SparkContext$$anonfun$34.apply(SparkContext.scala:2173)
at org.apache.spark.SparkContext$$anonfun$34.apply(SparkContext.scala:2173)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:335)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
解决：
.需要启动Zookeeper服务:./bin/zookeeper-server-start.sh config/zookeeper.properties .启动Kafka服务：./bin/kafka-server-start.sh config/server.properties
最新文章
- python logging colorlog
- Python网络数据采集系列-------概述
- Android之线程池深度剖析
- 为input输入框添加圆角并去除阴影
- Easy Tag Write(3.2)
- Deep Learning 深度学习 学习教程网站集锦（转）
- PHPCMS V9 学习总结
- cocos2d-js取不到cocostudio里面控件问题
- STL学习系列七：优先级队列priority_queue容器
- ABAP OO与ALV结合方式探索(1)
- Qt5-控件-QMenu,QMenuBar-菜单栏详解-菜单热键-菜单校验功能
- Activity的onSaveInstanceState()和onRestoreInstanceState()方法
- 关于 iOS 基础动画
- java中怎么判断一个字符串中包含某个字符或字符串
- 基于REM的移动端响应式适配方案
- Python 爬虫练习(三) 利用百度进行子域名收集
- 96、python version 3.6 required,which was not fount in the registry（python3.6安装scrapy）
- 黏包现象之udp
- Oracle 11g 概述 chaper1
- Vue+Webpack常见问题（持续更新）