Engine Tools

This repository aims to make chess engines easier to debug

Requirements

For dependencies, see requirements.txt.

It is expected that all engines support the basic UCI spec, plus several non-standard commands as documented below.

For movegen related tests, the engine should respond to perft/bulk <depth> in the below format

move1: <nodes>
move2: <nodes>
move3: <nodes>
<nodes> nodes <nps> nps

For search speed related tests, the engine should support standard OpenBench benchmarking, as shown below

$ ./Engine bench
<nodes> nodes <nps> nps

Usage

When running tests, this harness uses 2 engines (both supporting the above spec), and compares their results. For CLI syntax, run python3 main.py --help for more information.

Example

python3 main.py \
  --engine ./Lazarus-dev \
  --reference-engine ./Lazarus-main \
  --perft-pos "r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq - 0 1:5"

Notes

Using the bench speedup test, the output format is speed ± standard error