README
¶
#aliyun dts dispatcher ##统一DTS订阅服务介绍
统一DTS订阅服务设计用于高效连接阿里云DTS与用户端，采用多客户接入集中式管理，支持实时接入数据订阅。
特点：
1）屏蔽DTS配置细节，业务只需关系订阅对象
2）实时接入、下线
3）HTTP接口管理
4）支持多种订阅通道（rocketmq[tcp|http],kafka)
5）支持字段分区HASH、消费顺序
6）k8s集群部署、HA保障
Subscriber: etcd config demo
rocketmq-http:
{"name":"test-rocketmq","consumer":"consumer-test","endpoint":"http://888.mqrest.cn-zhangjiakou.aliyuncs.com","access_key":"","secret_key":"","topic":"dts-test","instance_id":"","type":1,"tables":["table1","table2"],"force_update":true}
kafka
{"name":"test-kafka","consumer":"consumer-test","servers":["127.0.0.1:9092","127.0.0.1:9092","127.0.0.17:9092"],"topics":["dts-test"],"consumer_group":"DTS_TEST","type":3,"tables":["table1","table2"],"force_update":true}
./etcdctl --endpoints=127.0.0.1:2379 put subcfg '{"name":"consumer-test-rocketmq","consumer":"consumer-test","endpoint":"http://321.mqrest.cn-zhangjiakou.aliyuncs.com","access_key":"","secret_key":"","topic":"dts-test","instance_id":"","type":1,"tables":["table1","table2"],"force_update":true}'
etcdctl --endpoints=127.0.0.1:2379 put subcfg-test '{"name":"consumer-test-kafka","consumer":"consumer-test","servers":["127.0.0.1:9092","127.0.0.1:9092","127.0.0.1:9092"],"topics":["dts-test"],"consumer_group":"DTS_TEST","type":3,"tables":["table1","table2"],"force_update":true}'
etcd配置
etcdctl --endpoints=localhost:2379 put subcfg-sks-test
'{"name":"dts-sks","consumer":"prod","endpoint":"http://123.mqrest.cn-zhangjiakou.aliyuncs.com","access_key":"","secret_key":"","topic":"dts-topic","instance_id":"","type":1,"tables":["table1"],"force_update":true}'
查看etcd
etcdctl --endpoints=127.0.0.1:2379 get s —prefix
邮箱：7853151@qq.com 微信：185-0008-3308
Documentation
¶
Overview ¶
Copyright © 2020 NAME HERE <EMAIL ADDRESS>
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Source Files
Directories