Skip to content

Exercise 8a: Simple DAG

In this exercise the way DAGMan creates DAGs will be examined and how it manages them.

In this exercise, a simple DAG file will be scheduled. DAGMan will create a DAG with four nodes.

The scripts A.sub, B.sub, C.sub, D.sub are simple submit files that contain: 

executable              = welcome.sh
arguments               = $(ClusterID)$(ProcId)
output                  = output/welcome.$(ClusterId).$(ProcId).out
error                   = error/welcome.$(ClusterId).$(ProcId).err
log                     = log/welcome.$(ClusterId).log
queue
The script welcome.sh contains the following: 
#!/bin/bash

echo "welcome to HTCondor tutorial"
Create exercise8a.dag by using the following: 
JOB A A.sub
JOB B B.sub
JOB C C.sub
JOB D D.sub
PARENT A CHILD B C
PARENT B CHILD D
PARENT C CHILD D
Execute condor_submit_dag exercise8a.dag to submit the DAG.

The exercise8a.dag.nodes.log file, reports that Node B submitted first and then Node C. 

000 (17096.000.000) 03/16 10:53:46 Job submitted from host: <128.142.194.115:9618?addrs=128.142.194.115-9618+[2001-1458-301-e1--100-6d]-9618&noUDP&sock=2796832_b331_37>
    DAG Node: A
...
001 (17096.000.000) 03/16 10:54:30 Job executing on host: <188.185.57.1:9618?addrs=188.185.57.1-9618+[--1]-9618&noUDP&sock=2760_4dfd_3>
...
005 (17096.000.000) 03/16 10:54:31 Job terminated.
        (1) Normal termination (return value 0)
                Usr 0 00:00:00, Sys 0 00:00:00  -  Run Remote Usage
                Usr 0 00:00:00, Sys 0 00:00:00  -  Run Local Usage
                Usr 0 00:00:00, Sys 0 00:00:00  -  Total Remote Usage
                Usr 0 00:00:00, Sys 0 00:00:00  -  Total Local Usage
        38  -  Run Bytes Sent By Job
        60  -  Run Bytes Received By Job
        38  -  Total Bytes Sent By Job
        60  -  Total Bytes Received By Job
        Partitionable Resources :    Usage  Request Allocated
           Cpus                 :                 1         1
           Disk (KB)            :       16        1   1926354
           Memory (MB)          :        0     2000      2000
...
000 (17097.000.000) 03/16 10:54:36 Job submitted from host: <128.142.194.115:9618?addrs=128.142.194.115-9618+[2001-1458-301-e1--100-6d]-9618&noUDP&sock=2796832_b331_37>
    DAG Node: B
...
000 (17098.000.000) 03/16 10:54:36 Job submitted from host: <128.142.194.115:9618?addrs=128.142.194.115-9618+[2001-1458-301-e1--100-6d]-9618&noUDP&sock=2796832_b331_37>
    DAG Node: C

Last update: November 26, 2019