Non-record: FP16 embed + WD20k + seq2048 + doc-isolated sliding window (val_bpb=1.2045)#151

mrdavtan wants to merge 1 commit intoopenai:mainopenai/parameter-golf:mainfrom

mrdavtan:kitchen-sink-9L-prmrdavtan/parameter-golf:kitchen-sink-9L-prCopy head branch name to clipboard