Adding versioning to the database

[Edwardvaneechoud]

This pull request introduces Alembic-based database migrations to the flowfile_core package, establishing a robust and maintainable schema management process. It adds the initial schema definition with all core tables, configures Alembic environment and templates, and ensures migration files are bundled for runtime access (e.g., with PyInstaller). The build process is updated so that Alembic migration files are included in the packaged application.

Database migration infrastructure:

• Adds a complete Alembic migration environment, including alembic.ini configuration, env.py environment script, and a migration script template (script.py.mako) for generating future migration files. [1] [2] [3]
• Introduces the initial Alembic migration (001_initial_schema.py) that creates all the core tables needed for the catalog, user management, secrets, connections, scheduling, and artifacts, along with all necessary constraints and relationships.

Build and packaging updates:

• Implements a function (get_alembic_datas) in main.py to collect Alembic migration files and configuration for inclusion in the build output, ensuring migrations are available at runtime (e.g., when using PyInstaller). The build process now includes these files in the datas parameter of the PyInstaller Analysis. [1] [2]

[netlify]

✅ Deploy Preview for flowfile-wasm canceled.

Name	Link
🔨 Latest commit	cd0ae50
🔍 Latest deploy log	https://app.netlify.com/projects/flowfile-wasm/deploys/69d576a6dfeb860008145029