Skip to content

About

PySpark-based analytics project exploring U.S. flight delays, cancellations, route performance, and airport trends through data visualization and interactive dashboards.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Latest commit

 

History

11 Commits

Folders and files

Repository files navigation

✈️ Flight Delay Intelligence System

📌 Project Overview

This project analyzes U.S. flight delays and cancellations using PySpark and explores patterns across airlines, airports, routes, months, and departure times.

The project combines Big Data Analytics, Data Visualization, and an Interactive Dashboard to uncover operational insights and identify major factors contributing to flight delays.


🎯 Business Objective

The objective of this project is to:

  • Identify major causes of flight delays and cancellations
  • Analyze delay trends across different time periods
  • Discover the most delayed routes and airports
  • Visualize flight performance through interactive dashboards
  • Generate actionable insights for airline operations

🛠️ Tools & Technologies

Category Technologies
Programming Python
Big Data PySpark
Data Analysis Pandas
Visualization Matplotlib, Seaborn, Plotly
Dashboard Dash
Environment Jupyter Notebook

📂 Dataset Information

The analysis uses the following datasets:

Dataset Description
flights.csv Flight-level operational data
airlines.csv Airline information
airports.csv Airport information

⚠️ Note: The original flights.csv dataset is not included in this repository due to GitHub file size limitations.


🔄 Project Workflow

1️⃣ Data Collection

  • Imported flight, airline, and airport datasets

2️⃣ Data Cleaning

  • Removed missing values
  • Processed delay and cancellation records

3️⃣ Exploratory Data Analysis

  • Delay trends
  • Cancellation analysis
  • Route performance analysis

4️⃣ Visualization

  • Bar charts
  • Pie charts
  • Trend analysis
  • Airport geo-mapping

5️⃣ Dashboard Development

  • Interactive Dash dashboard using Plotly

📊 Analysis Performed

✈️ Flight Operations Analysis

  • Flight cancellation analysis
  • Cancellation reason distribution
  • Airport delay analysis

📈 Delay Trend Analysis

  • Average arrival delay by month
  • Average arrival delay by departure hour
  • Delay cause breakdown

🛣️ Route Analysis

  • Most delayed flight routes
  • Route performance comparison

🌎 Geographic Analysis

  • Airport delay geo-mapping

📊 Dashboard Features

The interactive dashboard provides:

✅ Monthly Delay Trends

✅ Cancellation Reason Analysis

✅ Most Delayed Routes

✅ Airport Delay Insights

✅ Interactive Visual Exploration


📸 Project Visualizations

✈️ Flight Cancellation Count

Flight Cancellation Count

❌ Cancellation Reasons Distribution

Cancellation Reasons

📅 Average Arrival Delay by Month

Average Arrival Delay by Month

🕒 Average Arrival Delay by Departure Hour

Average Arrival Delay by Departure Hour

🛣️ Top 5 Most Delayed Routes

Top Delayed Routes

🚨 Total Delay Minutes by Reason

Delay Causes

🌎 Airport Delay Geo Mapping

Airport Delay Map

🔍 Key Findings

🚨 Major Delay Cause

Late aircraft delays were the largest contributor to overall delays.

🌅 Best Time to Fly

Early morning departures generally experienced fewer delays.

🛣️ High-Risk Routes

Certain routes consistently showed significantly higher delays.

🌎 Delay Hotspots

Airport geo-mapping helped identify major delay-prone regions.


📁 Repository Structure

Flight-Delay-Intelligence-System
│
├── big_data_analysis/
├── images/
│   ├── cancellation_count.png
│   ├── cancellation_reasons.png
│   ├── delay_by_month.png
│   ├── delay_by_hour.png
│   ├── top_delayed_routes.png
│   ├── delay_causes.png
│   └── airport_delay_map.png
│
├── app.py
├── main.py
├── report.ipynb
└── README.md

🚀 Future Improvements

  • Build a real-time flight delay prediction model
  • Integrate weather data
  • Add airline performance scorecards
  • Deploy dashboard online

👩‍💻 Author

Unnati Patil

Aspiring Data Analyst | Business Analyst | Data Science Enthusiast


⭐ Project Highlights

✔ Big Data Analytics using PySpark

✔ Interactive Dashboard Development

✔ Data Visualization & Storytelling

✔ Business Insight Generation

✔ End-to-End Analytics Project


⭐ If you found this project useful, consider giving it a star!

About

PySpark-based analytics project exploring U.S. flight delays, cancellations, route performance, and airport trends through data visualization and interactive dashboards.

Topics

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages