canal快速启动
2024-09-02 16:02:07
准备
对于自建 MySQL , 需要先开启 Binlog 写入功能,配置 binlog-format 为 ROW 模式,my.cnf 中配置如下
[mysqld]
log-bin=mysql-bin # 开启 binlog
binlog-format=ROW # 选择 ROW 模式
server_id=1 # 配置 MySQL replaction 需要定义,不要和 canal 的 slaveId 重复
- 注意:针对阿里云 RDS for MySQL , 默认打开了 binlog , 并且账号默认具有 binlog dump 权限 , 不需要任何权限或者 binlog 设置,可以直接跳过这一步
授权 canal 链接 MySQL 账号具有作为 MySQL slave 的权限, 如果已有账户可直接 grant
CREATE USER canal IDENTIFIED BY 'canal';
GRANT SELECT, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'canal'@'%';
-- GRANT ALL PRIVILEGES ON *.* TO 'canal'@'%' ;
FLUSH PRIVILEGES;
启动
下载 canal, 访问 release 页面 , 选择需要的包下载, 如以 1.0.17 版本为例
wget https://github.com/alibaba/canal/releases/download/canal-1.0.17/canal.deployer-1.0.17.tar.gz
解压缩
mkdir /tmp/canal
tar zxvf canal.deployer-$version.tar.gz -C /tmp/canal
- 解压完成后,进入 /tmp/canal 目录,可以看到如下结构
drwxr-xr-x 2 jianghang jianghang 136 2013-02-05 21:51 bin
drwxr-xr-x 4 jianghang jianghang 160 2013-02-05 21:51 conf
drwxr-xr-x 2 jianghang jianghang 1.3K 2013-02-05 21:51 lib
drwxr-xr-x 2 jianghang jianghang 48 2013-02-05 21:29 logs
- 解压完成后,进入 /tmp/canal 目录,可以看到如下结构
配置修改
vi conf/example/instance.properties
## mysql serverId
canal.instance.mysql.slaveId = 1234
#position info,需要改成自己的数据库信息
canal.instance.master.address = 127.0.0.1:3306
canal.instance.master.journal.name =
canal.instance.master.position =
canal.instance.master.timestamp =
#canal.instance.standby.address =
#canal.instance.standby.journal.name =
#canal.instance.standby.position =
#canal.instance.standby.timestamp =
#username/password,需要改成自己的数据库信息
canal.instance.dbUsername = canal
canal.instance.dbPassword = canal
canal.instance.defaultDatabaseName =
canal.instance.connectionCharset = UTF-8
#table regex
canal.instance.filter.regex = .\*\\\\..\*- canal.instance.connectionCharset 代表数据库的编码方式对应到 java 中的编码类型,比如 UTF-8,GBK , ISO-8859-1
- 如果系统是1个 cpu,需要将 canal.instance.parser.parallel 设置为 false
启动
sh bin/startup.sh
查看 server 日志
vi logs/canal/canal.log</pre>
2013-02-05 22:45:27.967 [main] INFO com.alibaba.otter.canal.deployer.CanalLauncher - ## start the canal server.
2013-02-05 22:45:28.113 [main] INFO com.alibaba.otter.canal.deployer.CanalController - ## start the canal server[10.1.29.120:11111]
2013-02-05 22:45:28.210 [main] INFO com.alibaba.otter.canal.deployer.CanalLauncher - ## the canal server is running now ......
查看 instance 的日志
vi logs/example/example.log
2013-02-05 22:50:45.636 [main] INFO c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [canal.properties]
2013-02-05 22:50:45.641 [main] INFO c.a.o.c.i.spring.support.PropertyPlaceholderConfigurer - Loading properties file from class path resource [example/instance.properties]
2013-02-05 22:50:45.803 [main] INFO c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start CannalInstance for 1-example
2013-02-05 22:50:45.810 [main] INFO c.a.otter.canal.instance.spring.CanalInstanceWithSpring - start successful....
关闭
sh bin/stop.sh
php操作
composer require xingwenge/canal_php
https://github.com/xingwenge/canal-php
<?php use xingwenge\canal_php\CanalClient;
use xingwenge\canal_php\CanalConnectorFactory;
use xingwenge\canal_php\Fmt; require "./vendor/autoload.php";
try {
//$client = CanalConnectorFactory::createClient(CanalClient::TYPE_SOCKET_CLUE);
$client = CanalConnectorFactory::createClient(CanalClient::TYPE_SWOOLE); $client->connect("192.168.33.10", 11111);
$client->checkValid();
$client->subscribe("1001", "example", ".*\\..*");
//$client->subscribe("1001", "example", "test.*"); # 设置过滤 while (true) {
$message = $client->get(100);
if ($entries = $message->getEntries()) {
foreach ($entries as $key=>$entry) {
Fmt::println($entry);
}
}
} $client->disConnect();
} catch (\Exception $e) {
echo $e->getMessage(), PHP_EOL;
}
[root@localhost wang]# php index.php ================> binlog[mysql-bin.000015 : 242],name[test,user], eventType: 1 id : 56 update= true
name : d update= true
================> binlog[mysql-bin.000015 : 438],name[test,user], eventType: 1 id : 57 update= true
name : d update= true
================> binlog[mysql-bin.000015 : 634],name[test,user], eventType: 1 id : 58 update= true
name : d update= true
================> binlog[mysql-bin.000015 : 830],name[test,user], eventType: 1 id : 59 update= true
name : d update= true
最新文章
- Oracle创建表空间、创建用户以及授权、查看权限
- Android之SDK、NDK、JNI和so文件
- HDU 1052 Tian Ji -- The Horse Racing(贪心)(2004 Asia Regional Shanghai)
- 为什么Redis内存不宜过大
- java reflect 初始学习 动态加载类
- Sublime Text2 多行编辑快捷键
- WPF与DevExpress之旅-序言
- maven 的 oracle的Missing artifact com.oracle:******:jar:11.2.0.2.0
- MFC CArchive实现保存到二进制文件
- Ubuntu 12.04环境下配置Postgresql和phppgadmin
- java多线程Future和Callable类的解释与使用
- 微信公众号系列 --- ionic在IOS的键盘弹出问题
- Jenkins 环境搭建
- Eclipse rap 富客户端开发总结(3):rcp/rap目前界面上的一些差异
- dede织梦调取一二三级栏目名及栏目下的内容列表的方法
- windows 7 下安装Oracle 9i 解决方法[转]
- Visual Studio 2013打开项目出现“未安装项目的目标框架”提示
- HashMap源代码解析
- [C++] Solve ";No source available for main()"; error when debugging on Eclipse
- python开发_count()
热门文章
- jenkins打包前端项目报 error: index-pack died of signal 15 问题解决
- xargs命令学习,于阮一峰博客
- [LeetCode]面试题67. 把字符串转换成整数
- Git进阶:常用命令和问题案例整理
- html+css入门基础案例之圣诞那些事
- Java 15 正式发布, 14 个新特性,刷新你的认知!!
- C++万能头文件的秘密
- SpringBoot框架:&#39;url&#39; attribute is not specified and no embedded datasource could be configured问题处理
- Zookeeper集群";脑裂";问题 - 运维总结
- JVM学习(二)JVM加载类