Data Sources & Data Model

This document describes the selected data sources for the prototype as well as the standardized, relational data model used to normalize external aid and funding data.

1. Data Source Matrix

Source	Link	Region	Type / Description
IATI Datastore Version 3 API	IATI Standard	Global	Covers international development and aid financing: activities, transactions, budgets, donors, recipients, countries, regions, and sectors.
HPC Tools - OCHA FTS Public API	OCHA FTS API	Global	Covers humanitarian funding flows: donors, recipients, amount, date, currency, project or flow description, and partially clusters/sectors.
USAspending.gov API / ForeignAssistance.gov API	USAspending API	USA	Covers US federal spending: grants, awards, contracts, obligations, recipients, agencies, amounts, locations, and programs.
European Commission Financial Transparency System (FTS)	EU FTS	EU	Covers EU budget funding recipients under direct and indirect management: beneficiaries, awarded amounts, funding purpose, location, expenditure type, responsible department, budget source, and accounting year. Latest available dataset identified: 2024. Updated annually, so suitable for annual funding analysis but not real-time donation monitoring.

2. Entity Relationship Diagram (ERD)

erDiagram
    DONOR {
        int id PK "Unique Donor ID"
        string donor_name "Name of the entity (Foundation, Gov, etc.)"
        string country "Country (ISO code or Full Name)"
        string region_city "Specific region, province, or city"
        string donor_type "Type (e.g., Private, Public, Multi-lateral)"
    }

    TRANSACTION {
        int id PK "Unique Transaction ID"
        date donation_date "Date of the funding flow"
        double amount "Normalized amount (EUR/USD)"
        int donor_id FK "Reference to DONOR table"
        int recipient_id FK "Reference to ORGANIZATION_PROJECT table"
    }

    ORGANIZATION_PROJECT {
        int id PK "Unique Recipient ID"
        string organization_name "Name of the NGO/Organization"
        string project_name "Name of the specific project"
        string country "Country (ISO code or Full Name)"
        string region_city "Specific region, province, or city"
        string_array types "List of sectors (e.g. ['Hunger', 'Education'])"
    }

    DONOR ||--o{ TRANSACTION : "originates"
    TRANSACTION }|--|| ORGANIZATION_PROJECT : "flows_to"

Loading