data_stream/ic/ic_lake_mysql.md

@@ -33,13 +33,26 @@ project-collie-app/app_lake/data_pump/sync_online/ic_spider_update_lake.yml
 ## 更新量大的表写kafka队列然后入库
 
 写kafka队列:
+
 部署地址：192.168.109.45
+
 project-collie-app/app_lake/data_pump/sync_online/ic_spider_update_lake.yml
 
+project-collie-app/app_lake/data_pump/sync_online/ic_ar_update_lake.yml
+
+supervisor配置：(31个进程)
+
+/etc/supervisor/conf.d/ic_spider_sync_lake.conf
+
 读kafka更新mysql并写redis:
+
 部署地址：192.168.109.200
+
 project-collie-app/app_lake/data_pump/ic_lake/collie_ic_spider_update_lake_kafka.yml
 
+supervisor配置：(75个进程)
+
+/etc/supervisor/collie/ic_spider_update_lake_kafka.conf
 
 | data_type | topic | group |
 | ------ | ------ | ------ |
@@ -59,8 +72,20 @@ project-collie-app/app_lake/data_pump/ic_lake/collie_ic_spider_update_lake_kafka
 ## 增量数据根据update_time从mysql获取
 
 部署地址：192.168.109.200
+
 project-collie-app/app_lake/data_pump/lake/lake_ic.yml
 
+supervisor配置：(26个进程)
+
+/etc/supervisor/collie/lake.conf
+
 ## 增量数据读redis查mysql获取
+
 部署地址：192168.109.200
-project-collie-app/app_lake/data_pump/ic_lake/collie_ic_spider_update_lake_redis.yml
+
\ No newline at end of file
+project-collie-app/app_lake/data_pump/ic_lake/collie_ic_spider_update_lake_redis.yml
+
+supervisor配置：(11个进程)
+
+/etc/supervisor/collie/ic_spider_update_lake_redis.conf
+