〇、概述

1、常见资料

（1）confluent

https://docs.confluent.io/5.4.0/connect/kafka-connect-jdbc/sink-connector/sink_config_options.html

一、可用的sink/source配置

（一）source connector

1、根据自增id的source

（1）订单表
{
    "name": "source_connect_Oracle_Test_T_Order_0905",
    "config": {
        "connector.class": "com.ecer.kafka.connect.oracle.OracleSourceConnector",
        "reset.offset": "true",
        "incrementing.column.name": "AUUID_0",
        "db.hostname": "192.168.0.100",
        "tasks.max": "1",
        "db.user.password": "system",
        "table.blacklist": "",
        "table.whitelist": "TEST.T_Order",
        "mode": "incrementing",
        "db.user": "system",
        "db.port": "1521",
        "db.fetch.size": "1",
        "multitenant": "false",
        "name": "source_connect_Oracle_Test_T_Order_0905",
        "topic": "connect_topic_Test_T_Order_0905",
        "parse.dml.data": "true",
        "db.name": "helowin",
        "db.name.alias": "helowin"
    },
    "tasks": [
        {
            "connector": "source_connect_Oracle_Test_T_Order_0905",
            "task": 0
        }
    ],
    "type": "source"
}

（2）用户表

1、Oracle的source
{
    "name": "ORACLE_TEST_ID_TIMESTAMP_INC",
    "config": {
        "connector.class": "com.ecer.kafka.connect.oracle.OracleSourceConnector",
        "reset.offset": "true",
        "incrementing.column.name": "ID",
        "db.hostname": "192.168.0.100",
        "tasks.max": "1",
        "db.user.password": "system",
        "table.blacklist": "",
        "table.whitelist": "TEST.T_USER",
        "mode": "incrementing",
        "db.user": "system",
        "db.port": "1521",
        "db.fetch.size": "1",
        "multitenant": "false",
        "name": "ORACLE_TEST_ID_TIMESTAMP_INC",
        "topic": "ORACLE_TEST_TOPIC",
        "parse.dml.data": "true",
        "db.name": "helowin",
        "db.name.alias": "helowin"
    },
    "tasks": [
        {
            "connector": "ORACLE_TEST_ID_TIMESTAMP_INC",
            "task": 0
        }
    ],
    "type": "source"
}
2、根据time自增的source
{
    "name": "source_connect_Oracle_Test_T_Order_timestamp_0905",
    "config": {
        "connector.class": "com.ecer.kafka.connect.oracle.OracleSourceConnector",
        "reset.offset": "true",
        "timestamp.column.name": "UPDDATTIM_0",
        "db.hostname": "192.168.0.100",
        "tasks.max": "1",
        "db.user.password": "system",
        "table.blacklist": "",
        "table.whitelist": "TEST.T_Order",
        "mode": "timestamp incrementing",
        "db.user": "system",
        "db.port": "1521",
        "db.fetch.size": "1",
        "multitenant": "false",
        "name": "source_connect_Oracle_Test_T_Order_timestamp_0905",
        "topic": "topic_Test_T_Order_timestamp_0905",
        "parse.dml.data": "true",
        "db.name": "helowin",
        "db.name.alias": "helowin"
    },
    "tasks": [
        {
            "connector": "source_connect_Oracle_Test_T_Order_timestamp_0905",
            "task": 0
        }
    ],
    "type": "source"
}

3、基于confluent的JDBC source

最新文章

1. mysql-拼接字段concat，concat_ws函数
2. 捕获异常try：except
3. UML从需求到实现----用例
4. Thread和Runnable差别
5. POJ 2010 Moo University - Financial Aid 优先队列
6. Kaggle—Digit Recognizer竞赛
7. jfinal使用配置文件注意事情
8. lynｘ---CentOS终端访问IP
9. C#高级编程学习一-----------------第五章泛型
10. directX--关于CSource和CSourceStream (谁调用了fillbuffer)
11. Python-socket网络编程-Day8
12. Docker: 创建带数据的MySql container
13. SSLTLS 服务器瞬时 Diffie-Hellman 公共密钥过弱【原理扫描】解决说明
14. scikit-learn全局图
15. 1.4 Chrome浏览器
16. js判断数组是否包含某个字符串变量
17. flume-ng-elasticsearch 索引时间命名问题（时区和时间格式）
18. python基础教程:包的创建及导入
19. vlc框架流程解析(转)
20. 查看 page页面某一个属性在 web ui 中的位置。

热门文章

1. 关于使用kubeoperator搭建k8s集群使用containerd作为容器运行时，从自己搭建的habor仓库拉取镜像的有关说明
2. Elastic App Search 入门
3. Logstash: 启动监控及集中管理-总结
4. 在 CentOS8/RHEL8 中配置 Rsyslog 服务器
5. gin项目部署到服务器并后台启动
6. 洛谷P1656 炸铁路 （求割边）
7. 前端图形:SVG与Canvas
8. 齐博x1标签动态调用数据
9. 齐博x1更新了 提供一个部分用户期待已久的功能，修改主题后变为待审
10. AT24C02