Pinned Loading

1. Apache-Hadoop-Spark-Hive-CyberAnalytics Apache-Hadoop-Spark-Hive-CyberAnalytics Public

   This project utilizes Apache Hadoop, Hive, and PySpark to process and analyze the UNSW-NB15 dataset, enabling advanced query analysis, machine learning modeling, and visualization. The project demo…

   Jupyter Notebook

2. Apache-Flink-Spark-Data-Streaming Apache-Flink-Spark-Data-Streaming Public

   This project showcases a real-time data streaming pipeline using Apache Flink, Apache Spark, and Grafana. It streams data, stores it in Parquet format, and performs aggregations for insights, with …

   Python

3. Deep-Learning-Grid-World-Q-Learning Deep-Learning-Grid-World-Q-Learning Public

   Deep Learning Grid World Q-Learning . Implement Q-learning in a 5x5 grid where an agent navigates obstacles and rewards. Train the agent with varying learning rates, visualize its progress, and see…

   Python

4. FMA-A-Dataset-For-Music-Analysis FMA-A-Dataset-For-Music-Analysis Public

   Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interfac…

   Python 2 1

5. Apache-Kafka-and-Frequent-Item-sets Apache-Kafka-and-Frequent-Item-sets Public

   This Bash script automates the setup and execution of a data processing pipeline using Apache Kafka and Python scripts, ensuring fault tolerance and streamlined management of Kafka-based data pipel…

   Python 3

6. Apache-Spark-Geospatial-Air-Quality-Analysis Apache-Spark-Geospatial-Air-Quality-Analysis Public

   This project analyzes air quality data across regions to identify improvement areas, track trends, and classify similar regions using clustering. Leveraging PySpark, it processes sensor data, calcu…

   Python