Analyzed 9.6M Medicare records, aggregated into 1.1M provider-level insights to identify physician staffing gaps and recruitment priorities across all 50 states.
π (https://karan-healthcare-analytics.streamlit.app/)
Healthcare organizations and staffing companies spend millions annually trying to identify where physician shortages exist and which specialties need urgent recruitment. This project answers that question using real US government Medicare data.
Key questions answered:
- Which medical specialties are most understaffed relative to patient demand?
- Which US states have the highest physician recruitment priority?
- Which specialties command the highest Medicare reimbursements?
- Where should a healthcare staffing company focus its recruitment efforts?
| Tab | What It Shows | Business Value |
|---|---|---|
| Provider Supply | Top 25 specialties by provider count | Understand market supply |
| Geographic Map | Provider density + recruitment priority by state | Target markets geographically |
| Medicare Payments | Avg reimbursement by specialty | Identify high-value specialties |
| Recruitment Gaps | Patient load per provider β urgency scoring | Prioritize hiring efforts |
| Data Explorer | Search 1.1M providers by specialty + state | Granular market intelligence |
- Nurse Practitioners (174,250) and Physician Assistants (94,708) are the most supplied specialties
- Wyoming, Vermont, and Alaska have the highest recruitment priority scores (97%+)
- Ambulatory Surgical Centers command the highest average Medicare payment at $1,164 per service
- Family Practice and Internal Medicine carry the highest patient loads per provider β signaling critical recruitment gaps
- 822 million patient services analyzed across 104 medical specialties
Python 3.11 β Core analysis
Pandas β Data processing (9.6M records)
Plotly β Interactive visualizations
Streamlit β Dashboard deployment
CMS Medicare API β Real US government data source
healthcare-workforce-analytics/
β
βββ data/
β βββ Medicare_Physician_Other_Practitioners_2023.csv
β
βββ outputs/
β βββ 01_specialty_provider_counts.html
β βββ 02_provider_density_map.html
β βββ 03_specialty_avg_payment.html
β βββ 04_recruitment_priority_map.html
β βββ 05_patient_load_scatter.html
β
βββ analyze.py β Full analysis script
βββ dashboard.py β Streamlit dashboard
βββ requirements.txt
βββ README.md
# Clone the repository
git clone https://github.com/Karant15/Healthcare-Workforce-Analytics.git
cd Healthcare-Workforce-Analytics
# Create virtual environment
python -m venv venv
venv\Scripts\activate # Windows
source venv/bin/activate # Mac/Linux
# Install dependencies
pip install -r requirements.txt
# Download data
# Go to: https://data.cms.gov/provider-summary-by-type-of-service/medicare-physician-other-practitioners
# Download CSV and place in /data folder
# Run dashboard
streamlit run dashboard.pypandas
numpy
plotly
streamlit
scikit-learn
joblib
openpyxl
This project leverages 7 years of healthcare domain expertise including managing data-driven client relationships with 30+ NHS hospitals in the UK. The analytical framework mirrors real-world healthcare staffing workflows used by companies like AMN Healthcare, Aya Healthcare, and ID Medical.
The DMAIC (Six Sigma) framework was applied to structure the analysis:
- Define: Physician shortage is a $100B+ problem in the US
- Measure: Baseline KPIs β providers per state, patients per provider
- Analyze: Identify root causes of staffing gaps by specialty and geography
- Improve: Data-driven recruitment targeting recommendations
- Control: Live dashboard for ongoing monitoring
"By identifying that Wyoming has a 97.7% recruitment priority score and that Family Practice carries the highest patient load per provider, healthcare staffing companies can allocate recruitment resources 3x more efficiently than using intuition alone."
Karan Trivedi | MS Data Analytics, Webster University (Dec 2024)
- 7+ years of experience in healthcare, recruitment, and business analytics
- Lean Six Sigma Black Belt β Benchmark Six Sigma
- Former Senior Accounts Manager managing 30+ NHS hospital accounts
π§ krntrivedi@gmail.com π LinkedIn π GitHub
CMS Medicare Physician & Other Practitioners by Provider and Service (2022)
- Source: data.cms.gov
- Records: 9,660,647 rows across 28 columns
- Coverage: All 50 US states, 104 medical specialties, 1.1M unique providers
- License: Public domain β US Government open data