实时计算-多级订单金额，及下级人数
- 2019 年 10 月 3 日
- 筆記
1 ????
????????????????????????????????
???????????????????????TOP100?
????????????
1.1 ??????
- ??????????????????????
- ?????top100?????????????100????????
- ???????????id??????????????????
1.2 ????
????????????????????????????????????????????
1.3 ????
- ?????Flink???????????????????
- ?????????HBase+Phoenix?????????????????????2????tps???RegionServer???????????????????
2 ????
1.1 ???
?????????????????????
1.2 ????
?????hbase RegionServer????????????
1.3 ???
???????????????HBase??????????????????????????tps??????????????????????????
1.4 ???
????????500W,????20??????????????1????????????????????????????tps?2500????????????
1.5 ????
?????????????Phoenix????????split key?
1.6 ???
HBase??????????????????
1.6 ????
HBase??????Hadoop?HDFS????????3?????3???????????????????????????????
3 ????
4 ??????
4.1 ??
4.2 ???
???
- ???USERID,AGENTID
???
- ???ORDERID,ordertime
- ?????USERID?shopid?status?totalFee
???
- ???USERID,PT
- ?????childId
???
- ???userid?pt
- ?????totalfee
5 ??????
5.1 ???
Kafka??2.X???????????????????????????kafka???
5.2 ????
5.2.1 ?????
Flink checkpoint??exactly once????????????????Flink????????????????
5.2.2 ????
Flink??Standalone HA??????????JobManager???Flink???????
5.2.3 ????
- ???????????????????
- ???????????????????
5.3 ??
HBase2.0.5??HA?????????Phoenix5.0???????????????
5.4 RESTful
????Spring Boot 2.x???
6 ????
HBase
- RegionServer?3?32?128G?
- Master?2?8?32G
Flink
- JobManager??HBase Master????
- executor??HBase RegionServer????
??
- ??????4*1T??
??
- ??1G??
