Usage of worker-wrap-cmd

[svatosFZU]

Hi,
I would like to ask for an advice about how to use --worker-wrap-cmd (https://it4innovations.github.io/hyperqueue/latest/deployment/allocation/#worker-wrap-command). I have tried to use a bash script for the wrap command but it fails, presumably due to all the double quotes in the worker details and how bash uses them. Example of the submission command from hq-submit.sh:

RUST_LOG=hyperqueue=debug,tako=debug bash wrap_command.sh /home/svatosm/hq-v0.25.0-linux-x64/hq worker start --idle-timeout "5m" --manager "slurm" --server-dir "/home/svatosm/.hq-server/001" --cpus "36" --resource "score=sum(36)" --resource "mem=sum(186000)" --overview-interval "0s" --min-utilization 1 --on-server-lost "finish-running" --time-limit "11h 59m"

So, would it be possible to do something like having single quotes around the double quoted parts, or escape the double quotes, or put the worker command in the separate script, etc. if there is a wrap command?

[Kobzol]

Hi, what does the script do/expect, and what was the failure when you did this?

[svatosFZU]

Hi,
the script I was using contains this:

let acx_time0=`date +%s`

acx_cmd="bash --rcfile /dev/shm/svatosm//cvmfsexec/standaloneRCFile"
if [ $# -gt 0 ]; then
   acx_cmd="$@"
fi

. /home/svatosm/atlas-cvmfsexec/common.sh
. /dev/shm/svatosm//cvmfsexec/mountpoints.sh

acx_fn_getEnv

acx_fn_printMsg $acx_time0 "Copying /dev/shm/svatosm//cvmfsexec/standalone/x86_64/centos8/cvmfsexec to `pwd`/  ..."
\cp /dev/shm/svatosm//cvmfsexec/standalone/x86_64/centos8/cvmfsexec ./

export ATLAS_LOCAL_ROOT_BASE=/cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase
export ATLAS_SW_BASE=/cvmfs
export VO_ATLAS_SW_DIR=$ATLAS_SW_BASE/atlas.cern.ch/repo/sw

acx_fn_printMsg $acx_time0 "Starting cvmfsexec ..." 
eval ./cvmfsexec ${mountPointAr[@]} -- $acx_cmd

acx_fn_printMsg $acx_time0 "Cleanup ..."
\rm -rf .cvmfsexec
if [ "`pwd`" != "/dev/shm/svatosm//cvmfsexec/standalone/x86_64/centos8" ]; then
  \rm -f ./cvmfsexec
fi 

When it runs in that submission command, it fails with

/dev/shm/svatosm/cvmfsexec/standalone.sh: eval: line 21: syntax error near unexpected token `('
/dev/shm/svatosm/cvmfsexec/standalone.sh: eval: line 21: `./cvmfsexec config-osg.opensciencegrid.org atlas.cern.ch atlas-condb.cern.ch atlas-nightlies.cern.ch sft.cern.ch sft-nightlies.cern.ch unpacked.cern.ch -- /home/svatosm/hq-v0.25.0-linux-x64/hq worker start --idle-timeout 5m --manager slurm --server-dir /home/svatosm/.hq-server/001 --cpus 36 --resource score=sum(36) --resource mem=sum(186000) --overview-interval 0s --min-utilization 1 --on-server-lost finish-running --time-limit 11h 59m'