Datastore is located at /u/abbode2/mysql
To access Start singularity container
singularity instance start --bind ./data:/vt/vtdataroot --bind .:/mysql images/vitess15.sif vitess
Start Mysql Server
singularity run --pwd /mysql instance://vitess /mysql/start
to execute a query from the command line
mysql -h 127.0.0.1 -u root -prootpw jobdata -e "select count(*) from jobs"
If for some reason you want a shell in the container…
singularity shell instance://vitess
to stop the db:
singularity run --pwd /mysql instance://vitess /mysql/stop
to stop the singularity instance:
singularity instance stop vitess
Database description
Database : Jobdata
- Table : jobs
- Table : job_hosts
job_hosts Tables
Field | Type | Description | Use for querying database | Included in Training | Reasoning for Inclusion (or not) |
---|---|---|---|---|---|
jobid | int | Unique id of a submitted job. | x | Needed to join to the jobs table. | |
nid | int | x | Needed to link the torque job to its ovis data. |
Jobs Table
Field | Type | Description | Use for querying database | Include in Exploratory LR | Include in Training | Reasoning for Inclusion (or not) | Possible values or example value |
---|---|---|---|---|---|---|---|
jobid | int | Unique id of a submitted job. | x | Needed to join to the job_hosts table | Ex. 2768866 | ||
status | string | The status that the job exited the moab scheduler with. | x | Possible Label |
| ||
user | string | the username of user who submitted the job | Personal identifiers are unique and would not give any information that can be generalized. | Ex. abbode2 | |||
user_group | string | The allocation group the job was charged to ? | Job status has no dependence on allocation group. Any correlation would be independent. | Ex. bw_staff | |||
account | string | ??? | Personal identifiers are unique and would not give any information that can be generalized. | ||||
jobname | string | ??? | |||||
queue | string | The scheduler queue used for the job. |
| ||||
ctime | Unix epoch timestamp | Unix epoch time of ??? | x? | ||||
qtime | Unix epoch timestamp | Unix epoch time of when job was queued? | x? | ||||
etime | Unix epoch timestamp | Unix epoch time of when job ended? | x? | ||||
start | Unix epoch timestamp | Unix epoch time of when job started? | x | ||||
end | Unix epoch timestamp | Unix epoch time of when job ended? | x | ||||
owner | string | The name of the user who submitted and the host node they submitted from. | Personal identifiers are unique and would not give any information that can be generalized. | abbode2@h2ologin1 | |||
RLNeednodes | string | The number of nodes and type of node requested. | 40:ppn=32:xe | ||||
RLnodect | string | The number of nodes requested same as prefeix of RLNeednodes. | x | x? | 40 | ||
RLnodes | string | Same as RLNeednodes? | 40:ppn=32:xe | ||||
RLwalltime | string | Requested walltime of job? | x | x? | 01:00:00 | ||
RLminwclimit | string | ??? | 18:00:00 | ||||
RLflags | string | ??? | commtolerant:commlocal:preemptee | ||||
login_node | string | ??? | nid25338 | ||||
session | int | ??? | 16528 | ||||
exit_status | int | The int exit status of the jobs root process. | x | Possible Label |
| ||
RUcput | string | ??? | x? | x? | 188 | ||
RUmem | string | ??? | x? | x? | 23988kb | ||
RUvmem | string | ??? | x? | x? | 199644kb | ||
RUwalltime | string | Real walltime of the job? | x | x? | 01:03:39 | ||
tc | int | ??? | 0,1,2,3... | ||||
node_count | int | Number of nodes actually allocated? | x | x? | 40 | ||
res_tasks | int | ??? | 4096 | ||||
priority | int | Likely scheduler priority? | 37594 | ||||
est_start | Unix epoch timestamp | Unix timestamp of estimated start? | |||||
moab_hold_begin | ??? | ??? Null for all entries in table |
| ||||
moab_start | Unix epoch timestamp | Unix timestamp of moab_start??? | x | ||||
moab_end | Unix epoch timestamp | Unix timestamp of moab end??? | x | ||||
moab_queue_time | int | Guessing the time that the job was in queue, Not sure on unit | x | x? | 3780 | ||
moab_run_time | int | Guessing the time that the job was running for, Not sure on unit or cpu time or wall time. | x | x? | 2221 | ||
moab_accuracy | decimal | ??? | 72.82 | ||||
moab_xfactor | decimal | ??? | 0.83 | ||||
moab_wc | int | ??? 0 for all entries in table. |
| ||||
shape_x | int | placement shape x dim? | |||||
shape_y | int | placement shape y dim? | |||||
shape_z | int | placement shape z dim? | |||||
origin_x | int | placement origin x dim? | |||||
origin_y | int | placement origin y dim? | |||||
origin_z | int | placement origin z dim? | |||||
resname | string | ??? | 6037153 | ||||
start_type | enum |
| |||||
preempted_by | int | ??? | 6038323 | ||||
prologue_start | Unix epoch timestamp | Unix timestamp of?? | |||||
prologue_end | Unix epoch timestamp | Unix timestamp of?? | |||||
epilogue_start | Unix epoch timestamp | Unix timestamp of?? | |||||
epilogue_end | Unix epoch timestamp | Unix timestamp of?? |
Add Comment