Skip to content

korokmu/malaysia-data-simplifier

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

108 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿ‡ฒ๐Ÿ‡พ Malaysia Data Simplifier

A fully automated daily dashboard that pulls Malaysian public data and presents it in a clean, mobile-friendly website โ€” updated every night at 12:05 AM automatically.

Live site: https://korokmu.github.io/malaysia-data-simplifier/


๐Ÿ“Š What It Shows

Section Data Source
โ›ฝ Fuel Prices RON95, RON97, Diesel weekly prices + trend data.gov.my
๐Ÿ’น Exchange Rates USD, SGD, EUR, GBP, JPY, AUD, CNY vs MYR + trend Bank Negara Malaysia via data.gov.my
๐Ÿงฎ Traveler Calculator Convert any currency to RM instantly BNM live rate
๐ŸŒฆ๏ธ Weather 3-day forecast for all 16 states/territories Open-Meteo

โœจ Features

  • State selector โ€” switch between all 16 Malaysian states/federal territories, grouped by region
  • Persona toggle โ€” Local view (cost of living focus) vs Visitor view (travel essentials)
  • Price change indicators โ€” โ–ฒ/โ–ผ arrows on fuel and exchange rates vs previous week/day
  • Fully automated โ€” runs daily via systemd timer, commits and pushes to GitHub Pages

๐Ÿ› ๏ธ Tech Stack

  • Python 3 + Polars โ€” fast data processing
  • Plotly โ€” interactive HTML charts
  • Parquet โ€” efficient data storage
  • GitHub Pages โ€” free hosting
  • systemd timer โ€” daily automation on Linux

๐Ÿ“ Project Structure

malaysia-data-simplifier/
โ”œโ”€โ”€ src/
โ”‚   โ”œโ”€โ”€ fetch_fuel.py           โ† Downloads weekly fuel price data
โ”‚   โ”œโ”€โ”€ fetch_exchange.py       โ† Downloads daily exchange rates
โ”‚   โ”œโ”€โ”€ fetch_weather.py        โ† Downloads 3-day weather forecasts
โ”‚   โ”œโ”€โ”€ chart_fuel.py           โ† Generates fuel trend chart
โ”‚   โ”œโ”€โ”€ chart_exchange.py       โ† Generates exchange rate chart
โ”‚   โ”œโ”€โ”€ extract_stats.py        โ† Builds latest_stats.json for dashboard
โ”‚   โ”œโ”€โ”€ notify_discord.py       โ† Optional Discord update notification
โ”‚   โ””โ”€โ”€ validate.py             โ† Health checks after each run
โ”œโ”€โ”€ docs/                       โ† GitHub Pages website (auto-generated)
โ”‚   โ”œโ”€โ”€ index.html
โ”‚   โ”œโ”€โ”€ latest_stats.json
โ”‚   โ””โ”€โ”€ *.html (charts)
โ”œโ”€โ”€ update.sh                   โ† Master script โ€” fetch โ†’ chart โ†’ push
โ””โ”€โ”€ requirements.txt

๐Ÿš€ Running Locally

git clone https://github.com/korokmu/malaysia-data-simplifier.git
cd malaysia-data-simplifier
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
bash update.sh

๐Ÿ“ฆ Data Sources

All data is free and publicly available โ€” no API keys required.

  • data.gov.my โ€” Malaysian government open data portal
  • Open-Meteo โ€” Free open-source weather API

About

๐Ÿ‡ฒ๐Ÿ‡พ Automated daily dashboard โ€” fuel prices, exchange rates, grocery prices, weather & RM converter for all 16 Malaysian states

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors