A working project for Pageview Analytics with RFX pattern
Requirements:
- HAProxy: https://www.howtoforge.com/tutorial/ubuntu-load-balancer-haproxy/
- NodeJS: https://www.digitalocean.com/community/tutorials/how-to-install-node-js-on-ubuntu-16-04
- JDK 8: http://tecadmin.net/install-oracle-java-8-jdk-8-ubuntu-via-ppa/
- Gradle http://howtoprogram.xyz/2016/09/06/install-gradle-ubuntu-16-04/
- Kafka http://www.bogotobogo.com/Hadoop/BigData_hadoop_Zookeeper_Kafka.php
- Redis https://www.digitalocean.com/community/tutorials/how-to-install-and-configure-redis-on-ubuntu-16-04
- MySQL http://www.cyberciti.biz/faq/howto-install-mysql-on-ubuntu-linux-16-04/
Project sample code:
track-js
track-server
pageview-stream-processor
pageview-data-api
pageview-reactor
pageview-report
Implement RFX Data Pipeline Pattern
1) Event Data Actor: a user in Data System (Data Consumer or Data Producer)
2) Event Data Agent: RFX-track-js , JavaScript tracking code at client
3) Event Data Collector: RFX-track-server for event log aggregator server
4) Event Message Queue: Apache Kafka
5) Event Data Processor: RFX-stream
6) Event Data Storage: Redis with RDBMS (MySQL / PostgreSQL / ...)
7) Event Data Query: RFX-data-query for data reporting API
8) Event Data Reactor: RFX-data-reactor
9) Event Data Report: RFX-data-report
Comments
Post a Comment