Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
66 changes: 66 additions & 0 deletions results/ablm-eval/1.0.3.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
---
tool: ablm-eval
version: 1.0.3
image: ghcr.io/brineylab/toolshed/ablm-eval@sha256:8c932603546af070394b0747658992b298f6874913d8b43b61233389d64c88a9
digest: sha256:8c932603546af070394b0747658992b298f6874913d8b43b61233389d64c88a9
runner: sbatch --partition=flyloft --gres=gpu:1 --time=00:30:00
host: sunk.6af0ac-eu-south-03b-briney-b200.coreweave.app
started: 2026-11-20T01:44:17Z
exit: 0
---
Job 1089: SUNK job dashboard: https://cks-grafana.coreweave.com/d/slurm-job-metrics/slurm-job-metrics?var-slurm_cluster=slurm&var-job_id=1089
pyxis: importing docker image: ghcr.io#brineylab/toolshed/ablm-eval@sha256:8c932603546af070394b0747658992b298f6874913d8b43b61233389d64c88a9
pyxis: imported docker image: ghcr.io#brineylab/toolshed/ablm-eval@sha256:8c932603546af070394b0747658992b298f6874913d8b43b61233389d64c88a9
node: slurm-b200-204-039
GPU 0: NVIDIA B200 (UUID: GPU-e3ae7af6-08de-017b-aedd-15ab9be767f6)
┏━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━┓
┃ name ┃ repository ┃ revision ┃ separator ┃
┡━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━┩
│ balm-paired │ brineylab/BALM-paired │ 78e6a59276db │ </s> │
│ balm-unpaired │ brineylab/BALM-unpaired │ 8fd18a5b47bf │ single chains only │
│ ft-esm │ brineylab/ft-ESM │ 6594c8b61de1 │ <cls><cls> │
│ balm-moe │ brineylab/BALM-MoE │ 51842e69ca3f │ <cls> │
│ currab │ brineylab/CurrAb │ 92e28534663e │ <cls> │
│ preferential-250k │ brineylab/preferential-250k │ 72ebb7b3e0f1 │ <cls><cls> │
│ uniform-250k │ brineylab/uniform-250k │ bb2fd2338300 │ <cls><cls> │
│ uniform-350k │ brineylab/uniform-350k │ 43a1e4fd35cf │ <cls><cls> │
│ scaling-350m-full │ brineylab/350M_full_checkpoint-500000 │ 9cd9e8af5138 │ <cls><cls> │
└───────────────────┴───────────────────────────────────────┴──────────────┴────────────────────┘
tiny: brineylab/8M_full_checkpoint-500000 @ 01e6532f9091
Fetching 7 files: 0%| | 0/7 [00:00<?, ?it/s]Fetching 7 files: 14%|█▍ | 1/7 [00:00<00:01, 4.20it/s]Fetching 7 files: 100%|██████████| 7/7 [00:01<00:00, 4.37it/s]Fetching 7 files: 100%|██████████| 7/7 [00:01<00:00, 4.36it/s]
Running Task #1: Mini Per Pos Inference
Loading weights: 0%| | 0/107 [00:00<?, ?it/s]Loading weights: 100%|██████████| 107/107 [00:00<00:00, 15969.49it/s]
Generating train split: 0 examples [00:00, ? examples/s]Generating train split: 8 examples [00:00, 3167.31 examples/s]
Map: 0%| | 0/8 [00:00<?, ? examples/s]Map: 100%|██████████| 8/8 [00:00<00:00, 2104.91 examples/s]
Map: 0%| | 0/8 [00:00<?, ? examples/s]Map: 100%|██████████| 8/8 [00:00<00:00, 1246.96 examples/s]
Running inference: 0%| | 0/8 [00:00<?, ?it/s]Running inference: 12%|█▎ | 1/8 [00:00<00:02, 3.09it/s]Running inference: 50%|█████ | 4/8 [00:00<00:00, 10.08it/s]Running inference: 88%|████████▊ | 7/8 [00:00<00:00, 14.26it/s]Running inference: 100%|██████████| 8/8 [00:00<00:00, 12.43it/s]
python 3.12.3
token ids of the first paired input: [ 0 9 7 16 4 7 9 8 6 6 6 4 7 16 14 6 6 8 4 10 4 8 23 5
5 8 6 18 11 18 8 8 19 5 20 8 22 7 10 16 5 14 6 15 6 4 9 22
7 8 5 12 8 6 8 6 6 8 11 19 19 6 13 8 7 15 6 10 18 11 12 8
10 13 17 8 15 17 11 4 19 4 16 20 17 8 4 10 5 9 13 11 5 7 19 19
23 5 15 5 5 20 14 5 10 14 6 12 7 19 19 19 19 19 19 20 13 7 22 6
15 6 11 11 7 11 7 8 8 0 0 13 12 16 20 11 16 8 14 8 8 4 8 5
8 7 6 13 10 7 11 12 11 23 10 5 8 16 6 12 17 17 19 4 5 22 19 16
16 15 14 6 15 7 14 15 4 4 12 19 5 5 8 11 4 16 8 6 7 14 8 10
18 8 6 8 6 8 6 11 13 18 11 4 11 12 8 8 4 16 14 9 13 7 5 11
19 19 23 16 15 19 17 8 5 14 4 11 18 6 6 6 8 15 7 9 12 15 2]
mean per-residue log-probability: -0.311014 (reference -0.311014, tolerance 0.0001)
tiny: brineylab/8M_full_checkpoint-500000 @ 01e6532f9091
Fetching 7 files: 0%| | 0/7 [00:00<?, ?it/s]Fetching 7 files: 100%|██████████| 7/7 [00:00<00:00, 1380.42it/s]
Running Task #1: Mini Per Pos Inference
Loading weights: 0%| | 0/107 [00:00<?, ?it/s]Loading weights: 100%|██████████| 107/107 [00:00<00:00, 15276.94it/s]
Running inference: 0%| | 0/8 [00:00<?, ?it/s]Running inference: 12%|█▎ | 1/8 [00:00<00:02, 3.08it/s]Running inference: 50%|█████ | 4/8 [00:00<00:00, 10.07it/s]Running inference: 88%|████████▊ | 7/8 [00:00<00:00, 14.25it/s]Running inference: 100%|██████████| 8/8 [00:00<00:00, 12.41it/s]
python 3.12.3
token ids of the first paired input: [ 0 9 7 16 4 7 9 8 6 6 6 4 7 16 14 6 6 8 4 10 4 8 23 5
5 8 6 18 11 18 8 8 19 5 20 8 22 7 10 16 5 14 6 15 6 4 9 22
7 8 5 12 8 6 8 6 6 8 11 19 19 6 13 8 7 15 6 10 18 11 12 8
10 13 17 8 15 17 11 4 19 4 16 20 17 8 4 10 5 9 13 11 5 7 19 19
23 5 15 5 5 20 14 5 10 14 6 12 7 19 19 19 19 19 19 20 13 7 22 6
15 6 11 11 7 11 7 8 8 0 0 13 12 16 20 11 16 8 14 8 8 4 8 5
8 7 6 13 10 7 11 12 11 23 10 5 8 16 6 12 17 17 19 4 5 22 19 16
16 15 14 6 15 7 14 15 4 4 12 19 5 5 8 11 4 16 8 6 7 14 8 10
18 8 6 8 6 8 6 11 13 18 11 4 11 12 8 8 4 16 14 9 13 7 5 11
19 19 23 16 15 19 17 8 5 14 4 11 18 6 6 6 8 15 7 9 12 15 2]
mean per-residue log-probability: -0.311014 (reference -0.311014, tolerance 0.0001)
Job 1089: SUNK job dashboard: https://cks-grafana.coreweave.com/d/slurm-job-metrics/slurm-job-metrics?var-slurm_cluster=slurm&var-job_id=1089
Expand Down
Loading