Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
K
kb
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Operations
    • Operations
    • Incidents
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • granite
  • kb
  • Wiki
    • Data_stream
  • double_publicity

double_publicity · Changes

Page history
add credit china spider authored Oct 25, 2021 by 杨龙斌's avatar 杨龙斌
Hide whitespace changes
Inline Side-by-side
Showing with 774 additions and 251 deletions
+774 -251
  • data_stream/double_publicity.md data_stream/double_publicity.md +774 -251
  • No files found.
data_stream/double_publicity.md
View page @ 8be92826
## 数据来源 # **基本信息**
信用中国 ```buildoutcfg
信用中国双公示
credit_china,通过scrapy部署
项目名称:project-gravel
分支:develop_credit_china
```
[信用中国 (creditchina.gov.cn)](https://www.creditchina.gov.cn/) ## 数据名称(中文)
## 主体类型 <!-- 该项数据的中文标准名称,后续沟通交流使用的规范名称,如:工商公示股东信息、失信被执行人、一般纳税人等-->
company_major_type :1-9 ###
## 爬虫相关 ```buildoutcfg
信用中国双公示信息
```
## 数据英文名称
<!--英文名称,后续流程中所有涉及到英文名称均以此为准,如:partner、shixin、general_taxpayer等-->
```buildoutcfg
credit_china
```
## 采集网站(采集入口)
<!--采集的入口地址,不能只是一个网站域名,具体到该网站的数据入口-->
```buildoutcfg
[信用中国 (creditchina.gov.cn)](https://www.creditchina.gov.cn/)
post https://public.creditchina.gov.cn/private-api/catalogSearchHome
```
## 采集频率及采集策略
<!--说明该项数据更新频率,存量数据的更新频率及策略、新增数据的采集频率及策略-->
### 存量更新策略
<!--无需更新?每天全量更新?逐条轮询更新?多久更新完一轮?或其他-->
```buildoutcfg
company表的在营企业
```
### 增量采集策略
<!--新增数据怎么来?无需单独采集新增数据?-->
```buildoutcfg
base表的新增数据需要更新
```
---
# **爬虫**
```buildoutcfg
信用中国双公示信息 credit_china
```
## 责任人
```buildoutcfg
杨龙斌
```
## 爬虫名称
```buildoutcfg
credit_china
```
<!--spider_name-->
## 代码地址
```buildoutcfg
项目地址:http://tech.pingansec.com/granite/project-gravel/-/blob/develop_credit_china/scrapy_spiders/gravel_spiders/spiders/credit_china.py
```
## 队列名称及队列地址
<!--redis host port db key 优先级说明-->
-
* redis host: redis://:utn@0818@bdp-mq-001.redis.rds.aliyuncs.com:6379/7
* redis port: 6379
* redis db: 7
* redis key:
* credit_china
### 优先级队列说明
* credit_china 不支持队列优先级
## 任务来源
<!--说明爬虫任务的输入。如:来自某个数据库表等。如果来自某个数据库表则应该简要说明该表内的数据是如何维护的。-->
```buildoutcfg
```
## 任务输入参数(样例)
```json
{
"credit_no": "91440400MA52UUKN9D",
"company_name": "珠海鸿驰鑫物流有限公司"
}
```
### 任务样例
<!--注意是爬虫拿到的完整任务,而不仅仅是task_params-->
```buildoutcfg
{
"credit_no": "91440400MA52UUKN9D",
"company_name": "珠海鸿驰鑫物流有限公司"
}
```
### 任务参数说明
<!--特有参数说明,通用参数比如spider_name,task_params,task_src,task_result等不需说明-->
```json
{
"credit_no": "信用号",
"company_name": "公司名称"
}
```
## data_type说明
<!--可能产生的data_type说明-->
```buildoutcfg
detail: 详情信息
```
## 爬虫结果的超级数据
<!--包含所有字段的json数据,每个value都要有样例值-->
```json
{
"data": {
"cf": [
{
"columnList": [
"cf_wsh",
"cf_cflb",
"cf_jdrq",
"cf_nr",
"cf_nr_fk",
"cf_nr_wfff",
"cf_nr_zkdx",
"cf_wfxw",
"cf_sy",
"cf_yj",
"cf_cfjg",
"cf_cfjgdm",
"cf_sjly",
"cf_sjlydm"
],
"sencesMap": {
"flowno": "唯一标识",
"cf_wsh": "行政处罚决定书文号",
"cf_cflb": "处罚类别",
"cf_jdrq": "处罚决定日期",
"cf_nr": "处罚内容",
"cf_nr_fk": "罚款金额(万元)",
"cf_nr_wfff": "没收违法所得、没收非法财物的金额(万元)",
"cf_nr_zkdx": "暂扣或吊销证照名称及编号",
"cf_wfxw": "违法行为类型",
"cf_sy": "违法事实",
"cf_yj": "处罚依据",
"cf_cfjg": "处罚机关",
"cf_cfjgdm": "处罚机关统一社会信用代码",
"cf_sjly": "数据来源",
"cf_sjlydm": "数据来源单位统一社会信用代码"
},
"dataSource": "地方报送",
"data_catalog": "行政处罚(新标准)",
"table_name": "credit_xyzx_fr_xzcf_new",
"entity": {
"flowno": "63258860",
"cf_wsh": "粤珠交罚﹝2020﹞01916号",
"cf_cflb": "罚款",
"cf_jdrq": "2020-07-09",
"cf_nr": "罚款人民币壹仟元整(1000元)",
"cf_nr_fk": "0.1",
"cf_nr_wfff": "0.0",
"cf_nr_zkdx": null,
"cf_wfxw": "《广东省道路运输条例》第四十九条",
"cf_sy": "2020年04月04日,在珠市海南屏收费站,当事人珠海鸿驰鑫物流有限公司实施未按照规定使用卫星定位汽车行驶记录仪实时传送相关数据行为,涉案车船号为粤C34336,以上事实,有询问笔录、GPS轨迹截图、监控照片、营运车辆信息等证据为证。",
"cf_yj": "《广东省道路运输条例》第六十四条第(七)项",
"cf_cfjg": "珠海市交通运输局",
"cf_cfjgdm": "11440400682447327H",
"cf_sjly": "珠海市交通运输局",
"cf_sjlydm": "11440400682447327H",
"uuid": "d637a5f4664605a2a4359da9d597a6ee",
"recid": "EFB3842DCF8A42CC9C1817035E0A1CE1",
"repairState": 1
},
"entity_type": "1"
},
{
"columnList": [
"cf_wsh",
"cf_cflb",
"cf_jdrq",
"cf_nr",
"cf_nr_fk",
"cf_nr_wfff",
"cf_nr_zkdx",
"cf_wfxw",
"cf_sy",
"cf_yj",
"cf_cfjg",
"cf_cfjgdm",
"cf_sjly",
"cf_sjlydm"
],
"sencesMap": {
"flowno": "唯一标识",
"cf_wsh": "行政处罚决定书文号",
"cf_cflb": "处罚类别",
"cf_jdrq": "处罚决定日期",
"cf_nr": "处罚内容",
"cf_nr_fk": "罚款金额(万元)",
"cf_nr_wfff": "没收违法所得、没收非法财物的金额(万元)",
"cf_nr_zkdx": "暂扣或吊销证照名称及编号",
"cf_wfxw": "违法行为类型",
"cf_sy": "违法事实",
"cf_yj": "处罚依据",
"cf_cfjg": "处罚机关",
"cf_cfjgdm": "处罚机关统一社会信用代码",
"cf_sjly": "数据来源",
"cf_sjlydm": "数据来源单位统一社会信用代码"
},
"dataSource": "地方报送",
"data_catalog": "行政处罚(新标准)",
"table_name": "credit_xyzx_fr_xzcf_new",
"entity": {
"flowno": "63258386",
"cf_wsh": "粤珠交罚﹝2020﹞01911号",
"cf_cflb": "罚款",
"cf_jdrq": "2020-07-09",
"cf_nr": "罚款人民币壹仟元整(1000元)",
"cf_nr_fk": "0.1",
"cf_nr_wfff": "0.0",
"cf_nr_zkdx": null,
"cf_wfxw": "《广东省道路运输条例》第四十九条",
"cf_sy": "2020年03月14日,在珠海市珠海南屏收费站,当事人珠海鸿驰鑫物流有限公司实施未按照规定使用卫星定位汽车行驶记录仪实时传送相关数据行为,涉案车船号为粤C34336,以上事实,有询问笔录、监控照片、GPS轨迹截图、营运车辆信息等证据为证。",
"cf_yj": "《广东省道路运输条例》第六十四条第(七)项",
"cf_cfjg": "珠海市交通运输局",
"cf_cfjgdm": "11440400682447327H",
"cf_sjly": "珠海市交通运输局",
"cf_sjlydm": "11440400682447327H",
"uuid": "80c10d89d4ce030e6e6d9485fc72f8ac",
"recid": "484D409CC7F14331AE46ABF378FD7CB6",
"repairState": 1
},
"entity_type": "1"
}
],
"xk": [
{
"columnList": [
"xk_wsh",
"xk_xkws",
"xk_xkzs",
"xk_xklb",
"xk_xkbh",
"xk_jdrq",
"xk_yxqz",
"xk_yxqzi",
"xk_nr",
"xk_xkjg",
"xk_xkjgdm",
"xk_lydw",
"xk_lydwdm"
],
"sencesMap": {
"xk_wsh": "行政许可决定文书号",
"xk_xkws": "行政许可决定文书名称",
"xk_xkzs": "许可证书名称",
"xk_xklb": "许可类别",
"xk_xkbh": "许可编号",
"xk_jdrq": "许可决定日期",
"xk_yxqz": "有效期自",
"xk_yxqzi": "有效期至",
"xk_nr": "许可内容",
"xk_xkjg": "许可机关",
"xk_xkjgdm": "许可机关统一社会信用代码",
"xk_lydw": "数据来源单位",
"xk_lydwdm": "数据来源单位统一社会信用代码"
},
"dataSource": "地方报送",
"data_catalog": "行政许可(新标准)",
"table_name": "credit_xyzx_fr_xzxk_new",
"entity": {
"xk_wsh": "ZH19090600174",
"xk_xkws": "无",
"xk_xkzs": "营业执照",
"xk_xklb": "登记",
"xk_xkbh": "zh19090600174",
"xk_jdrq": "2019-09-06",
"xk_yxqz": "2019-09-06",
"xk_yxqzi": "2099-12-31",
"xk_nr": "货物运输代理、仓储服务、装卸服务、普通货运、货物专用运输(集装箱)、货运代办、机动车零配件、五金交电的批发、零售、汽车租赁、二手车买、卖。",
"xk_xkjg": "珠海市市场监督管理局",
"xk_xkjgdm": "11440400MB2C9104X7",
"xk_lydw": "珠海市市场监督管理局",
"xk_lydwdm": "11440400MB2C9104X7",
"uuid": "99e1006483e2d3132ad90c1034380b4a",
"recid": "F6580E9F0B124E55AC409B57D3841110"
},
"entity_type": "1"
},
{
"columnList": [
"xk_wsh",
"xk_xkws",
"xk_xkzs",
"xk_xklb",
"xk_xkbh",
"xk_jdrq",
"xk_yxqz",
"xk_yxqzi",
"xk_nr",
"xk_xkjg",
"xk_xkjgdm",
"xk_lydw",
"xk_lydwdm"
],
"sencesMap": {
"xk_wsh": "行政许可决定文书号",
"xk_xkws": "行政许可决定文书名称",
"xk_xkzs": "许可证书名称",
"xk_xklb": "许可类别",
"xk_xkbh": "许可编号",
"xk_jdrq": "许可决定日期",
"xk_yxqz": "有效期自",
"xk_yxqzi": "有效期至",
"xk_nr": "许可内容",
"xk_xkjg": "许可机关",
"xk_xkjgdm": "许可机关统一社会信用代码",
"xk_lydw": "数据来源单位",
"xk_lydwdm": "数据来源单位统一社会信用代码"
},
"dataSource": "地方报送",
"data_catalog": "行政许可(新标准)",
"table_name": "credit_xyzx_fr_xzxk_new",
"entity": {
"xk_wsh": "无",
"xk_xkws": "无",
"xk_xkzs": "营业执照",
"xk_xklb": "登记",
"xk_xkbh": "zh19090600174",
"xk_jdrq": "2019-09-06",
"xk_yxqz": "2019-09-06",
"xk_yxqzi": "2099-12-31",
"xk_nr": "变更登记",
"xk_xkjg": "珠海市市场监督管理局",
"xk_xkjgdm": "11440400MB2C9104X7",
"xk_lydw": "珠海市市场监督管理局",
"xk_lydwdm": "11440400MB2C9104X7",
"uuid": "03df0aa5278ba207ecd79a05a7b6ade3",
"recid": "97B3A7DAB89E4F3D90CAFF56DB9E2BBC"
},
"entity_type": "1"
}
]
},
"http_code": 200,
"error_msg": "",
"task_result": 1000,
"data_type": "detail",
"spider_start_time": "2021-10-25 15:04:15.177",
"spider_end_time": "2021-10-25 15:04:15",
"task_params": {
"credit_no": "91440400MA52UUKN9D",
"company_name": "珠海鸿驰鑫物流有限公司"
},
"metadata": {},
"spider_name": "credit_china",
"spider_ip": "192.168.56.1"
}
```
## 实际爬虫结果的数据结构
<!--可能与超级数据一致,可能不同的data_type的爬虫结果结构不同,超级数据是把所有data_type的结果组合在一起-->
```json
同上
```
## 爬虫运行环境
<!--udm模块?scrapy?或其他-->
```buildoutcfg
scrapy
```
## 爬虫部署信息
<!--部署在哪些机器?每个机器多少进程?项目名称是什么?-->
```buildoutcfg
general_taxpayer: 10.8.6.51 1个进程
```
## Taskhub地址
```buildoutcfg
```
## Taskhub调度规则说明
```buildoutcfg
task_result=1000 # 正常获取到详情任务
task_result=1101 # 无结果信息
task_result=9101 # 超时错误,需要进行重试,目前重试5次
task_result=8000 # 参数错误
```
## 爬虫监控指标设计
<!--监控爬虫正常运行的指标是什么?报警规则是什么?-->
```buildoutcfg
(先观察,待补充)
索引:
监控频率:
监控起止时间:
报警条件:
报警群:
报警内容:
```
---
# **数据归集**
## 责任人
```html
范召贤
```
## 数据归集方式
- [ ] 爬虫直接写kafka
- [ ] 爬虫写文件logstash采集
## 爬虫结果目录
```html
/data/gravel_spiders/credit_china
```
## 归集后存放目录
```html
```
## logstash配置文件名称
```html
```
## logstash文件采集type
```html
type=>"general-taxpayer"
```
## 数据归集的topic
```
topic_id => ""
```
## ES日志索引及筛选条件
```html
```
## 监控指标看板
## 数据保留策略
---
# **数据清洗**
## 责任人
## 代码地址
## 部署地址
<!--机器及线上代码地址-->
## 部署方法及说明
<!--运行方法及运行命令、supervisor配置、supervisor的program等-->
- [ ] crontab + data_pump
- [ ] supervisor + data_pump
- [ ] supervisor + consumer
## 数据接收来源
<!--来源于kafka还是归集的文件、topic的group?-->
## 主体类型
company_major_type :1-9
## 爬虫相关
## 主要业务字段 ## 主要业务字段
| 字段名 | 注释 | 样例 | | 字段名 | 注释 | 样例 |
| -------------------------- | ---------------------------------------- | ------------------------------------------------------------ | | -------------------------- | ---------------------------------------- | ------------------------------------------------------------ |
| **行政许可** | | | | **
行政许可** | | |
| company_name | 公司名 | 滴滴出行科技有限公司无锡分公司 | | company_name | 公司名 | 滴滴出行科技有限公司无锡分公司 |
| credit_no | 统一信用代码 | 91320211MA1NY8PN42 | | credit_no | 统一信用代码 | 91320211MA1NY8PN42 |
| allow_code | 行政许可决定文书号 | 锡29012813 | | allow_code | 行政许可决定文书号 | 锡29012813 |
...@@ -36,7 +557,8 @@ ...@@ -36,7 +557,8 @@
| check_type | 审核类型 | 登记 | | check_type | 审核类型 | 登记 |
| data_source | 数据来源 | 广东省 | | data_source | 数据来源 | 广东省 |
| allow_validity | 许可有效期 | -- | | allow_validity | 许可有效期 | -- |
| **行政处罚** | | | | **
行政处罚** | | |
| company_name | 公司名 | 滴滴出行科技有限公司无锡分公司 | | company_name | 公司名 | 滴滴出行科技有限公司无锡分公司 |
| credit_no | 统一信用代码 | 91320211MA1NY8PN42 | | credit_no | 统一信用代码 | 91320211MA1NY8PN42 |
| punish_code | 行政处罚决定书文号 | 锡交运罚﹝2021﹞01524号 | | punish_code | 行政处罚决定书文号 | 锡交运罚﹝2021﹞01524号 |
...@@ -53,7 +575,8 @@ ...@@ -53,7 +575,8 @@
| authority_credit_no | 处罚机关统一社会信用代码 | 12320200466285669R | | authority_credit_no | 处罚机关统一社会信用代码 | 12320200466285669R |
| data_source_unit | 数据来源单位 | 无锡市交通运输管理处 | | data_source_unit | 数据来源单位 | 无锡市交通运输管理处 |
| data_source_unit_credit_no | 数据来源单位统一社会信用代码 | 12320200466285669R | | data_source_unit_credit_no | 数据来源单位统一社会信用代码 | 12320200466285669R |
| **守信激励** | | | | **
守信激励** | | |
| company_name | 公司名(纳税人名称) | 深圳市城建物业管理有限公司广州风神花园管理处 | | company_name | 公司名(纳税人名称) | 深圳市城建物业管理有限公司广州风神花园管理处 |
| credit_no | 统一社会信用代码 | 914401016777820328 | | credit_no | 统一社会信用代码 | 914401016777820328 |
| evaluation_year | 评价年度 | 2018 | | evaluation_year | 评价年度 | 2018 |
...@@ -62,249 +585,249 @@ ...@@ -62,249 +585,249 @@
```json ```json
{ {
"data": { "data": {
"cf": [ "cf": [
{ {
"columnList": [ "columnList": [
"cf_wsh", "cf_wsh",
"cf_cflb", "cf_cflb",
"cf_jdrq", "cf_jdrq",
"cf_nr", "cf_nr",
"cf_nr_fk", "cf_nr_fk",
"cf_nr_wfff", "cf_nr_wfff",
"cf_nr_zkdx", "cf_nr_zkdx",
"cf_wfxw", "cf_wfxw",
"cf_sy", "cf_sy",
"cf_yj", "cf_yj",
"cf_cfjg", "cf_cfjg",
"cf_cfjgdm", "cf_cfjgdm",
"cf_sjly", "cf_sjly",
"cf_sjlydm" "cf_sjlydm"
], ],
"sencesMap": { "sencesMap": {
"flowno": "唯一标识", "flowno": "唯一标识",
"cf_wsh": "行政处罚决定书文号", "cf_wsh": "行政处罚决定书文号",
"cf_cflb": "处罚类别", "cf_cflb": "处罚类别",
"cf_jdrq": "处罚决定日期", "cf_jdrq": "处罚决定日期",
"cf_nr": "处罚内容", "cf_nr": "处罚内容",
"cf_nr_fk": "罚款金额(万元)", "cf_nr_fk": "罚款金额(万元)",
"cf_nr_wfff": "没收违法所得、没收非法财物的金额(万元)", "cf_nr_wfff": "没收违法所得、没收非法财物的金额(万元)",
"cf_nr_zkdx": "暂扣或吊销证照名称及编号", "cf_nr_zkdx": "暂扣或吊销证照名称及编号",
"cf_wfxw": "违法行为类型", "cf_wfxw": "违法行为类型",
"cf_sy": "违法事实", "cf_sy": "违法事实",
"cf_yj": "处罚依据", "cf_yj": "处罚依据",
"cf_cfjg": "处罚机关", "cf_cfjg": "处罚机关",
"cf_cfjgdm": "处罚机关统一社会信用代码", "cf_cfjgdm": "处罚机关统一社会信用代码",
"cf_sjly": "数据来源", "cf_sjly": "数据来源",
"cf_sjlydm": "数据来源单位统一社会信用代码" "cf_sjlydm": "数据来源单位统一社会信用代码"
}, },
"dataSource": "地方报送", "dataSource": "地方报送",
"data_catalog": "行政处罚(新标准)", "data_catalog": "行政处罚(新标准)",
"table_name": "credit_xyzx_fr_xzcf_new", "table_name": "credit_xyzx_fr_xzcf_new",
"entity": { "entity": {
"flowno": "63258860", "flowno": "63258860",
"cf_wsh": "粤珠交罚﹝2020﹞01916号", "cf_wsh": "粤珠交罚﹝2020﹞01916号",
"cf_cflb": "罚款", "cf_cflb": "罚款",
"cf_jdrq": "2020-07-09", "cf_jdrq": "2020-07-09",
"cf_nr": "罚款人民币壹仟元整(1000元)", "cf_nr": "罚款人民币壹仟元整(1000元)",
"cf_nr_fk": "0.1", "cf_nr_fk": "0.1",
"cf_nr_wfff": "0.0", "cf_nr_wfff": "0.0",
"cf_nr_zkdx": null, "cf_nr_zkdx": null,
"cf_wfxw": "《广东省道路运输条例》第四十九条", "cf_wfxw": "《广东省道路运输条例》第四十九条",
"cf_sy": "2020年04月04日,在珠市海南屏收费站,当事人珠海鸿驰鑫物流有限公司实施未按照规定使用卫星定位汽车行驶记录仪实时传送相关数据行为,涉案车船号为粤C34336,以上事实,有询问笔录、GPS轨迹截图、监控照片、营运车辆信息等证据为证。", "cf_sy": "2020年04月04日,在珠市海南屏收费站,当事人珠海鸿驰鑫物流有限公司实施未按照规定使用卫星定位汽车行驶记录仪实时传送相关数据行为,涉案车船号为粤C34336,以上事实,有询问笔录、GPS轨迹截图、监控照片、营运车辆信息等证据为证。",
"cf_yj": "《广东省道路运输条例》第六十四条第(七)项", "cf_yj": "《广东省道路运输条例》第六十四条第(七)项",
"cf_cfjg": "珠海市交通运输局", "cf_cfjg": "珠海市交通运输局",
"cf_cfjgdm": "11440400682447327H", "cf_cfjgdm": "11440400682447327H",
"cf_sjly": "珠海市交通运输局", "cf_sjly": "珠海市交通运输局",
"cf_sjlydm": "11440400682447327H", "cf_sjlydm": "11440400682447327H",
"uuid": "d637a5f4664605a2a4359da9d597a6ee", "uuid": "d637a5f4664605a2a4359da9d597a6ee",
"recid": "EFB3842DCF8A42CC9C1817035E0A1CE1", "recid": "EFB3842DCF8A42CC9C1817035E0A1CE1",
"repairState": 1 "repairState": 1
}, },
"entity_type": "1" "entity_type": "1"
}, },
{ {
"columnList": [ "columnList": [
"cf_wsh", "cf_wsh",
"cf_cflb", "cf_cflb",
"cf_jdrq", "cf_jdrq",
"cf_nr", "cf_nr",
"cf_nr_fk", "cf_nr_fk",
"cf_nr_wfff", "cf_nr_wfff",
"cf_nr_zkdx", "cf_nr_zkdx",
"cf_wfxw", "cf_wfxw",
"cf_sy", "cf_sy",
"cf_yj", "cf_yj",
"cf_cfjg", "cf_cfjg",
"cf_cfjgdm", "cf_cfjgdm",
"cf_sjly", "cf_sjly",
"cf_sjlydm" "cf_sjlydm"
], ],
"sencesMap": { "sencesMap": {
"flowno": "唯一标识", "flowno": "唯一标识",
"cf_wsh": "行政处罚决定书文号", "cf_wsh": "行政处罚决定书文号",
"cf_cflb": "处罚类别", "cf_cflb": "处罚类别",
"cf_jdrq": "处罚决定日期", "cf_jdrq": "处罚决定日期",
"cf_nr": "处罚内容", "cf_nr": "处罚内容",
"cf_nr_fk": "罚款金额(万元)", "cf_nr_fk": "罚款金额(万元)",
"cf_nr_wfff": "没收违法所得、没收非法财物的金额(万元)", "cf_nr_wfff": "没收违法所得、没收非法财物的金额(万元)",
"cf_nr_zkdx": "暂扣或吊销证照名称及编号", "cf_nr_zkdx": "暂扣或吊销证照名称及编号",
"cf_wfxw": "违法行为类型", "cf_wfxw": "违法行为类型",
"cf_sy": "违法事实", "cf_sy": "违法事实",
"cf_yj": "处罚依据", "cf_yj": "处罚依据",
"cf_cfjg": "处罚机关", "cf_cfjg": "处罚机关",
"cf_cfjgdm": "处罚机关统一社会信用代码", "cf_cfjgdm": "处罚机关统一社会信用代码",
"cf_sjly": "数据来源", "cf_sjly": "数据来源",
"cf_sjlydm": "数据来源单位统一社会信用代码" "cf_sjlydm": "数据来源单位统一社会信用代码"
}, },
"dataSource": "地方报送", "dataSource": "地方报送",
"data_catalog": "行政处罚(新标准)", "data_catalog": "行政处罚(新标准)",
"table_name": "credit_xyzx_fr_xzcf_new", "table_name": "credit_xyzx_fr_xzcf_new",
"entity": { "entity": {
"flowno": "63258386", "flowno": "63258386",
"cf_wsh": "粤珠交罚﹝2020﹞01911号", "cf_wsh": "粤珠交罚﹝2020﹞01911号",
"cf_cflb": "罚款", "cf_cflb": "罚款",
"cf_jdrq": "2020-07-09", "cf_jdrq": "2020-07-09",
"cf_nr": "罚款人民币壹仟元整(1000元)", "cf_nr": "罚款人民币壹仟元整(1000元)",
"cf_nr_fk": "0.1", "cf_nr_fk": "0.1",
"cf_nr_wfff": "0.0", "cf_nr_wfff": "0.0",
"cf_nr_zkdx": null, "cf_nr_zkdx": null,
"cf_wfxw": "《广东省道路运输条例》第四十九条", "cf_wfxw": "《广东省道路运输条例》第四十九条",
"cf_sy": "2020年03月14日,在珠海市珠海南屏收费站,当事人珠海鸿驰鑫物流有限公司实施未按照规定使用卫星定位汽车行驶记录仪实时传送相关数据行为,涉案车船号为粤C34336,以上事实,有询问笔录、监控照片、GPS轨迹截图、营运车辆信息等证据为证。", "cf_sy": "2020年03月14日,在珠海市珠海南屏收费站,当事人珠海鸿驰鑫物流有限公司实施未按照规定使用卫星定位汽车行驶记录仪实时传送相关数据行为,涉案车船号为粤C34336,以上事实,有询问笔录、监控照片、GPS轨迹截图、营运车辆信息等证据为证。",
"cf_yj": "《广东省道路运输条例》第六十四条第(七)项", "cf_yj": "《广东省道路运输条例》第六十四条第(七)项",
"cf_cfjg": "珠海市交通运输局", "cf_cfjg": "珠海市交通运输局",
"cf_cfjgdm": "11440400682447327H", "cf_cfjgdm": "11440400682447327H",
"cf_sjly": "珠海市交通运输局", "cf_sjly": "珠海市交通运输局",
"cf_sjlydm": "11440400682447327H", "cf_sjlydm": "11440400682447327H",
"uuid": "80c10d89d4ce030e6e6d9485fc72f8ac", "uuid": "80c10d89d4ce030e6e6d9485fc72f8ac",
"recid": "484D409CC7F14331AE46ABF378FD7CB6", "recid": "484D409CC7F14331AE46ABF378FD7CB6",
"repairState": 1 "repairState": 1
}, },
"entity_type": "1" "entity_type": "1"
} }
],
"xk": [
{
"columnList": [
"xk_wsh",
"xk_xkws",
"xk_xkzs",
"xk_xklb",
"xk_xkbh",
"xk_jdrq",
"xk_yxqz",
"xk_yxqzi",
"xk_nr",
"xk_xkjg",
"xk_xkjgdm",
"xk_lydw",
"xk_lydwdm"
],
"sencesMap": {
"xk_wsh": "行政许可决定文书号",
"xk_xkws": "行政许可决定文书名称",
"xk_xkzs": "许可证书名称",
"xk_xklb": "许可类别",
"xk_xkbh": "许可编号",
"xk_jdrq": "许可决定日期",
"xk_yxqz": "有效期自",
"xk_yxqzi": "有效期至",
"xk_nr": "许可内容",
"xk_xkjg": "许可机关",
"xk_xkjgdm": "许可机关统一社会信用代码",
"xk_lydw": "数据来源单位",
"xk_lydwdm": "数据来源单位统一社会信用代码"
},
"dataSource": "地方报送",
"data_catalog": "行政许可(新标准)",
"table_name": "credit_xyzx_fr_xzxk_new",
"entity": {
"xk_wsh": "ZH19090600174",
"xk_xkws": "无",
"xk_xkzs": "营业执照",
"xk_xklb": "登记",
"xk_xkbh": "zh19090600174",
"xk_jdrq": "2019-09-06",
"xk_yxqz": "2019-09-06",
"xk_yxqzi": "2099-12-31",
"xk_nr": "货物运输代理、仓储服务、装卸服务、普通货运、货物专用运输(集装箱)、货运代办、机动车零配件、五金交电的批发、零售、汽车租赁、二手车买、卖。",
"xk_xkjg": "珠海市市场监督管理局",
"xk_xkjgdm": "11440400MB2C9104X7",
"xk_lydw": "珠海市市场监督管理局",
"xk_lydwdm": "11440400MB2C9104X7",
"uuid": "99e1006483e2d3132ad90c1034380b4a",
"recid": "F6580E9F0B124E55AC409B57D3841110"
},
"entity_type": "1"
},
{
"columnList": [
"xk_wsh",
"xk_xkws",
"xk_xkzs",
"xk_xklb",
"xk_xkbh",
"xk_jdrq",
"xk_yxqz",
"xk_yxqzi",
"xk_nr",
"xk_xkjg",
"xk_xkjgdm",
"xk_lydw",
"xk_lydwdm"
], ],
"xk": [ "sencesMap": {
{ "xk_wsh": "行政许可决定文书号",
"columnList": [ "xk_xkws": "行政许可决定文书名称",
"xk_wsh", "xk_xkzs": "许可证书名称",
"xk_xkws", "xk_xklb": "许可类别",
"xk_xkzs", "xk_xkbh": "许可编号",
"xk_xklb", "xk_jdrq": "许可决定日期",
"xk_xkbh", "xk_yxqz": "有效期自",
"xk_jdrq", "xk_yxqzi": "有效期至",
"xk_yxqz", "xk_nr": "许可内容",
"xk_yxqzi", "xk_xkjg": "许可机关",
"xk_nr", "xk_xkjgdm": "许可机关统一社会信用代码",
"xk_xkjg", "xk_lydw": "数据来源单位",
"xk_xkjgdm", "xk_lydwdm": "数据来源单位统一社会信用代码"
"xk_lydw", },
"xk_lydwdm" "dataSource": "地方报送",
], "data_catalog": "行政许可(新标准)",
"sencesMap": { "table_name": "credit_xyzx_fr_xzxk_new",
"xk_wsh": "行政许可决定文书号", "entity": {
"xk_xkws": "行政许可决定文书名称", "xk_wsh": "无",
"xk_xkzs": "许可证书名称", "xk_xkws": "无",
"xk_xklb": "许可类别", "xk_xkzs": "营业执照",
"xk_xkbh": "许可编号", "xk_xklb": "登记",
"xk_jdrq": "许可决定日期", "xk_xkbh": "zh19090600174",
"xk_yxqz": "有效期自", "xk_jdrq": "2019-09-06",
"xk_yxqzi": "有效期至", "xk_yxqz": "2019-09-06",
"xk_nr": "许可内容", "xk_yxqzi": "2099-12-31",
"xk_xkjg": "许可机关", "xk_nr": "变更登记",
"xk_xkjgdm": "许可机关统一社会信用代码", "xk_xkjg": "珠海市市场监督管理局",
"xk_lydw": "数据来源单位", "xk_xkjgdm": "11440400MB2C9104X7",
"xk_lydwdm": "数据来源单位统一社会信用代码" "xk_lydw": "珠海市市场监督管理局",
}, "xk_lydwdm": "11440400MB2C9104X7",
"dataSource": "地方报送", "uuid": "03df0aa5278ba207ecd79a05a7b6ade3",
"data_catalog": "行政许可(新标准)", "recid": "97B3A7DAB89E4F3D90CAFF56DB9E2BBC"
"table_name": "credit_xyzx_fr_xzxk_new", },
"entity": { "entity_type": "1"
"xk_wsh": "ZH19090600174", }
"xk_xkws": "无", ]
"xk_xkzs": "营业执照", },
"xk_xklb": "登记", "http_code": 200,
"xk_xkbh": "zh19090600174", "error_msg": "",
"xk_jdrq": "2019-09-06", "task_result": 1000,
"xk_yxqz": "2019-09-06", "data_type": "detail",
"xk_yxqzi": "2099-12-31", "spider_start_time": "2021-10-25 15:04:15.177",
"xk_nr": "货物运输代理、仓储服务、装卸服务、普通货运、货物专用运输(集装箱)、货运代办、机动车零配件、五金交电的批发、零售、汽车租赁、二手车买、卖。", "spider_end_time": "2021-10-25 15:04:15",
"xk_xkjg": "珠海市市场监督管理局", "task_params": {
"xk_xkjgdm": "11440400MB2C9104X7", "credit_no": "91440400MA52UUKN9D",
"xk_lydw": "珠海市市场监督管理局", "company_name": "珠海鸿驰鑫物流有限公司"
"xk_lydwdm": "11440400MB2C9104X7", },
"uuid": "99e1006483e2d3132ad90c1034380b4a", "metadata": {},
"recid": "F6580E9F0B124E55AC409B57D3841110" "spider_name": "credit_china",
}, "spider_ip": "192.168.56.1"
"entity_type": "1"
},
{
"columnList": [
"xk_wsh",
"xk_xkws",
"xk_xkzs",
"xk_xklb",
"xk_xkbh",
"xk_jdrq",
"xk_yxqz",
"xk_yxqzi",
"xk_nr",
"xk_xkjg",
"xk_xkjgdm",
"xk_lydw",
"xk_lydwdm"
],
"sencesMap": {
"xk_wsh": "行政许可决定文书号",
"xk_xkws": "行政许可决定文书名称",
"xk_xkzs": "许可证书名称",
"xk_xklb": "许可类别",
"xk_xkbh": "许可编号",
"xk_jdrq": "许可决定日期",
"xk_yxqz": "有效期自",
"xk_yxqzi": "有效期至",
"xk_nr": "许可内容",
"xk_xkjg": "许可机关",
"xk_xkjgdm": "许可机关统一社会信用代码",
"xk_lydw": "数据来源单位",
"xk_lydwdm": "数据来源单位统一社会信用代码"
},
"dataSource": "地方报送",
"data_catalog": "行政许可(新标准)",
"table_name": "credit_xyzx_fr_xzxk_new",
"entity": {
"xk_wsh": "无",
"xk_xkws": "无",
"xk_xkzs": "营业执照",
"xk_xklb": "登记",
"xk_xkbh": "zh19090600174",
"xk_jdrq": "2019-09-06",
"xk_yxqz": "2019-09-06",
"xk_yxqzi": "2099-12-31",
"xk_nr": "变更登记",
"xk_xkjg": "珠海市市场监督管理局",
"xk_xkjgdm": "11440400MB2C9104X7",
"xk_lydw": "珠海市市场监督管理局",
"xk_lydwdm": "11440400MB2C9104X7",
"uuid": "03df0aa5278ba207ecd79a05a7b6ade3",
"recid": "97B3A7DAB89E4F3D90CAFF56DB9E2BBC"
},
"entity_type": "1"
}
]
},
"http_code": 200,
"error_msg": "",
"task_result": 1000,
"data_type": "detail",
"spider_start_time": "2021-10-25 15:04:15.177",
"spider_end_time": "2021-10-25 15:04:15",
"task_params": {
"credit_no": "91440400MA52UUKN9D",
"company_name": "珠海鸿驰鑫物流有限公司"
},
"metadata": {},
"spider_name": "credit_china",
"spider_ip": "192.168.56.1"
} }
``` ```
......
Clone repository
  • README
  • basic_guidelines
  • basic_guidelines
    • basic_guidelines
    • dev_guide
    • project_build
    • 开发流程
  • best_practice
  • best_practice
    • AlterTable
    • RDS
    • azkaban
    • create_table
    • design
    • elasticsearch
    • elasticsearch
      • ES运维
    • logstash
View All Pages