Skip to content

Run the experiments on your own sessions and report the numbers #4

Description

@sepehrsadri

Every number in docs/EXPERIMENTS.md was measured on a handful of projects on a single machine. This is the single biggest weakness of the research, and it is the easiest one to fix — no Rust, no reverse engineering.

The task

Run the prototypes against your own sessions and report what you get.

python3 experiments/als_semantic_diff.py --chain '/path/to/YourProject/Backup/*.als'
./experiments/storage_bench.sh '/path/to/YourProject/Backup'
python3 experiments/flp_parse.py '/path/to/project.flp'

Ableton keeps timestamped autosaves in your project's Backup/ folder, so you already have a version chain.

Claims most in need of independent checking

  • Consecutive Ableton saves differ by 0.07–0.25% of XML lines
  • Track IDs are stable across the save chain
  • A median of 3 of 28 tracks change per save
  • Delta chains cost ~11 KB per save

Please include the material context — genre, track count, project size, how many versions, DAW version. No file names needed. Context matters enormously: sparse stems and dense masters behave completely differently, and a number without material is close to meaningless.

Results that contradict ours are the most valuable outcome. Use the "Measurement report" issue template.

Everything in experiments/ is read-only and never modifies your projects.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

good first issueGood entry point for new contributorshelp wantedExtra attention is neededmeasurementReproduce or extend a published measurement

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions