通过crontab调度任务
前面已经开发完成了用户行为数仓
和商品订单数仓
的所有需求及其执行脚本。
其中有不少是需要通过Linux的定时任务调度crontab
来完成的。
crontab -e
# 用户行为数仓ods层和dwd层
1 0 * * * /home/work/warehouse_user_action/ods_shopmall_add_partition.sh
1 0 * * * /home/work/warehouse_user_action/dwd_shopmall_add_partition.sh
# 用户行为数仓需求一:新增用户相关指标
1 0 * * * /home/work/warehouse_user_action/dws_shopmall_requirement01_add_partition.sh
1 0 * * * /home/work/warehouse_user_action/app_shopmall_requirement01_add_partition.sh
# 用户行为数仓需求二:日活用户相关指标
1 0 * * * /home/work/warehouse_user_action/app_shopmall_requirement02_add_partition.sh
# 用户行为数仓需求三:七日流失用户相关指标
1 0 * * * /home/work/warehouse_user_action/dws_shopmall_requirement03_add_partition.sh
1 0 * * * /home/work/warehouse_user_action/app_shopmall_requirement03_add_partition.sh
# 用户行为数仓需求四:每日应用启动相关指标
1 0 * * * /home/work/warehouse_user_action/app_shopmall_requirement04_add_partition.sh
# 用户行为数仓需求五:设备平台相关指标
1 0 * * * /home/work/warehouse_user_action/dws_shopmall_requirement05_add_partition.sh
1 0 * * * /home/work/warehouse_user_action/app_shopmall_requirement05_add_partition.sh
# 用户行为数仓需求六:应用闪退相关指标
1 0 * * * /home/work/warehouse_user_action/dws_shopmall_requirement06_add_partition.sh
1 0 * * * /home/work/warehouse_user_action/app_shopmall_requirement06_add_partition.sh
# 商品订单数仓数据导入
0 1 * * * /home/work/warehouse_goods_order/data_collect_completed.sh
5 1 * * * /home/work/warehouse_goods_order/data_collect_increment.sh
# 商品订单数仓ods层和dwd层
1 0 * * * /home/work/warehouse_goods_order/ods_shopmall_add_partition.sh
1 0 * * * /home/work/warehouse_goods_order/dwd_shopmall_add_partition.sh
# 商品订单数仓需求一:用户信息宽表
1 0 * * * /home/work/warehouse_goods_order/dws_shopmall_requirement01_add_partition.sh
# 商品订单数仓需求二:电商GMV
1 0 * * * /home/work/warehouse_goods_order/app_shopmall_requirement02_add_partition.sh
# 商品订单数仓需求三:商品相关指标
1 0 * * * /home/work/warehouse_goods_order/dws_shopmall_requirement03_add_partition.sh
1 0 * * * /home/work/warehouse_goods_order/app_shopmall_requirement03_add_partition.sh
# 商品订单数仓需求四:漏斗转化分析
1 0 * * * /home/work/warehouse_goods_order/app_shopmall_requirement04_add_partition.sh
# 商品订单数仓拉链表
1 0 * * * /home/work/warehouse_goods_order/dwd_load_data_to_order_zipper.sh
原创大约 5 分钟