File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -31,7 +31,7 @@ The solution leverages several key Big Data technologies:
31
31
32
32
### Real-time Pipeline
33
33
- ` risk_kafka_producer.py ` : Reads data from HDFS and streams to Kafka topic "risk_data"
34
- - ` risk_kafka_consumer .py` : Consumes data stream, applies ML model, and stores predictions in PostgreSQL
34
+ - ` postgre_consumer .py` : Consumes data stream, applies ML model, and stores predictions in PostgreSQL
35
35
36
36
### Visualization
37
37
- ` streamlit_dashboard.py ` : Interactive web dashboard for data exploration and visualization
@@ -120,7 +120,7 @@ python risk_kafka_producer.py
120
120
121
121
5 . Run the Spark Streaming consumer:
122
122
``` bash
123
- spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.0.1,org.postgresql:postgresql:42.2.27 risk_kafka_consumer .py
123
+ spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.0.1,org.postgresql:postgresql:42.2.27 postgre_consumer .py
124
124
```
125
125
126
126
6 . Launch the Streamlit dashboard:
You can’t perform that action at this time.
0 commit comments