Skip to content

Adding Monitoring Script Option - #28

Open
Layth17 wants to merge 9 commits into
wustl-oncology:mainfrom
Layth17:monitoring
Open

Layth17 wants to merge 9 commits into
wustl-oncology:mainfrom
Layth17:monitoring

Conversation

@Layth17

@Layth17 Layth17 commented Nov 23, 2022

Copy link
Copy Markdown
Member

Steps needed once to reconfigure settings (background info)

  1. Re-run: bash resources.sh init-project --project $GCS_PROJECT --bucket $GCS_BUCKET_NAME --ip-range $IP_RANGE --ms-path <path>/monitor.sh to generate new workflow_options.json & cromwell.conf

  2. New workflow_options.json should contain a new line for the monitoring script

  3. Run: bash start.sh $GCS_INSTANCE_NAME --server-account $GCS_SERVICE_ACCOUNT --project $GCS_PROJECT --boot-disk-size=50GB --boot-disk-type=pd-standard --machine-type=e2-standard-2 to create a VM

  4. Within the VM, check that /shared/cromwell/workflow_options.json reflects the new change

If user provides a path to a monitoring script, every task will generate a monitoring log file

NOTE: if specified, it is the user responsibility to ensure that the monitoring script is in $BUCKET/$MS_PATH, otherwise it breaks

Tasks

  • script works and produces monitoring.log for every task
    |__ - works but breaks estimate-bills script

Tasks beyond the scope of this pull request:

@Layth17 Layth17 linked an issue Nov 23, 2022 that may be closed by this pull request
@Layth17 Layth17 changed the title adding monitor.sh automatically Adding monitoring script option Jan 25, 2023
@Layth17 Layth17 changed the title Adding monitoring script option Adding Monitoring Script Option Jan 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Set up resource monitoring for tasks of cromwell runs

1 participant