System Architecture

1. System Design

• Design #1 | Overview

---

2. Data Ingestion

• Broker #1 | Kafka
• Workflow #1 | Airflow

---

3. Modeling

• LangGraph #1 | Overview
• Spark #1 | Overview
• Spark #2 | Read
• Spark #3 | Processing
• Spark #4 | Write
• Visualizer #1 | Streamlit

---

CheatSheets

• CheatSheet | Docker
• CheatSheet | Git
• CheatSheet | Github Actions
• CheatSheet | GlusterFS
• CheatSheet | Hadoop
• CheatSheet | Jupyter
• CheatSheet | K8s
• CheatSheet | Linux
• CheatSheet | Pyspark
• CheatSheet | VIM

---