In the current setup, the parameter files_per_task (and potentially also custom_files_per_task) in KingMaker_luigi.cfg can be independently modified between Ntuple and Friends production, resulting in a non-one-to-one relationship. This should be changed so that the parameter is set from the Ntuple setup or not used at all, so that the mapping is maintained.
This happened when I originally had files_per_task = 3 for the Ntuple production and changed it to files_per_task = 10 for Friends. This resulted in 9 Ntuple files being mapped to 3 Friends (in this example), without the Ntuples being recreated. Changing files_per_task the other way around was not tested, but could pose an even bigger issue.
Friends:
gfal-ls root://cmsdcache-kit-disk.gridka.de:1094//store/user/sgiappic/CROWN/ntuples/htt_260520_2022-23/CROWNFriends/fake_factors_260528/2022preEE/DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X/mt
2022preEE_DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_mt_quantities_map.json
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_0.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_1.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_2.root
Ntuples:
gfal-ls root://cmsdcache-kit-disk.gridka.de:1094//store/user/sgiappic/CROWN/ntuples/htt_260520_2022-23/CROWNRun/2022preEE/DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X/mt/
2022preEE_DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_mt_quantities_map.json
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_0.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_1.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_2.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_3.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_4.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_5.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_6.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_7.root
DYto2Tau-2Jets_MLL-50_0J_TuneCP5_13p6TeV_amcatnloFXFX-pythia8_Run3Summer22NanoAODv12-130X_8.root
In the current setup, the parameter
files_per_task(and potentially alsocustom_files_per_task) inKingMaker_luigi.cfgcan be independently modified between Ntuple and Friends production, resulting in a non-one-to-one relationship. This should be changed so that the parameter is set from the Ntuple setup or not used at all, so that the mapping is maintained.This happened when I originally had
files_per_task = 3for the Ntuple production and changed it tofiles_per_task = 10for Friends. This resulted in 9 Ntuple files being mapped to 3 Friends (in this example), without the Ntuples being recreated. Changingfiles_per_taskthe other way around was not tested, but could pose an even bigger issue.Friends:
Ntuples: