Various software engineering correctness tools

[rhaps0dy]

Here's a list of things we might do to reduce PR bickering and improve software correctness. I think they're not worth it now (except black and maybe basic CI) but here's a list anyways:

• Automatic formatting

  • Python (black)
  • C++ (clang-format)

• Coverage reports

  • Especially: compare coverage reports in tests vs. experiments. If significant parts of the experiment coverage aren't covered by tests, we're in trouble

• Continuous integration: Automatically run tests before merging every PR

• Build with clang (faster, more warnings, as a downside IDK if valgrind works)

  • Run python and C++ tests with the Address Sanitizer (the Memory Sanitizer seems too hard to make work) https://stackoverflow.com/questions/47251533/memory-address-sanitizer-vs-valgrind