Torque Datastore on Hydro

Datastore is located at /u/abbode2/mysql

To access Start singularity container

singularity instance start --bind ./data:/vt/vtdataroot --bind .:/mysql images/vitess15.sif vitess

Start Mysql Server

singularity run --pwd /mysql instance://vitess /mysql/start

to execute a query from the command line

mysql -h 127.0.0.1 -u root -prootpw jobdata -e "select count(*) from jobs"

If for some reason you want a shell in the container…

singularity shell instance://vitess

to stop the db:

singularity run --pwd /mysql instance://vitess /mysql/stop

to stop the singularity instance:

singularity instance stop vitess

Database description

Database : Jobdata

Table : jobs
Table : job_hosts

job_hosts Tables

Field	Type	Description	Use for querying database	Included in Training	Reasoning for Inclusion (or not)
jobid	int	Unique id of a submitted job.	x		Needed to join to the jobs table.
nid	int		x		Needed to link the torque job to its ovis data.

Jobs Table

Field	Type	Description	Use for querying database	Include in Training	Reasoning for Inclusion (or not)	Possible values or example value
jobid	int	Unique id of a submitted job.	x		Needed to join to the job_hosts table	Ex. 2768866
status	string	The status that the job exited the moab scheduler with.	x	Possible Label		Aborted Canceled Completed Deleted Q_orphan R_orphan
user	string	the username of user who submitted the job			Personal identifiers are unique and would not give any information that can be generalized.	Ex. abbode2
user_group	string	The allocation group the job was charged to ?			Job status has no dependence on allocation group. Any correlation would be independent.	Ex. bw_staff
account	string	???			Personal identifiers are unique and would not give any information that can be generalized.
jobname	string	???
queue	string	The scheduler queue used for the job.				normal debug high low tput bench high_long normal_long NULL noalloc sleepaprun sleepnoaprun streamaprun sleepnoapacct
ctime	Unix epoch timestamp	Unix epoch time of ???	x?
qtime	Unix epoch timestamp	Unix epoch time of when job was queued?	x?
etime	Unix epoch timestamp	Unix epoch time of when job ended?	x?
start	Unix epoch timestamp	Unix epoch time of when job started?	x
end	Unix epoch timestamp	Unix epoch time of when job ended?	x
owner	string	The name of the user who submitted and the host node they submitted from.			Personal identifiers are unique and would not give any information that can be generalized.	abbode2@h2ologin1
RLNeednodes	string	The number of nodes and type of node requested.				40:ppn=32:xe
RLnodect	string	The number of nodes requested same as prefeix of RLNeednodes.	x	x?		40
RLnodes	string	Same as RLNeednodes?				40:ppn=32:xe
RLwalltime	string	Requested walltime of job?	x	x?		01:00:00
RLminwclimit	string	???				18:00:00
RLflags	string	???				commtolerant:commlocal:preemptee
login_node	string	???				nid25338
session	int	???				16528
exit_status	int	The int exit status of the jobs root process.	x	Possible Label		0 Success 1 Error 2 9, 137, 265 Hard kill 15, 143, 271 Soft kill ...
RUcput	string	???	x?	x?		188
RUmem	string	???	x?	x?		23988kb
RUvmem	string	???	x?	x?		199644kb
RUwalltime	string	Real walltime of the job?	x	x?		01:03:39
tc	int	???				0,1,2,3...
node_count	int	Number of nodes actually allocated?	x	x?		40
res_tasks	int	???				4096
priority	int	Likely scheduler priority?				37594
est_start	Unix epoch timestamp	Unix timestamp of estimated start?
moab_hold_begin	???	??? Null for all entries in table				NULL
moab_start	Unix epoch timestamp	Unix timestamp of moab_start???	x
moab_end	Unix epoch timestamp	Unix timestamp of moab end???	x
moab_queue_time	int	Guessing the time that the job was in queue, Not sure on unit	x	x?		3780
moab_run_time	int	Guessing the time that the job was running for, Not sure on unit or cpu time or wall time.	x	x?		2221
moab_accuracy	decimal	???				72.82
moab_xfactor	decimal	???				0.83
moab_wc	int	??? 0 for all entries in table.				0
shape_x	int	placement shape x dim?
shape_y	int	placement shape y dim?
shape_z	int	placement shape z dim?
origin_x	int	placement origin x dim?
origin_y	int	placement origin y dim?
origin_z	int	placement origin z dim?
resname	string	???				6037153
start_type	enum					backfill Null reserved priority admin
preempted_by	int	???				6038323
prologue_start	Unix epoch timestamp	Unix timestamp of??
prologue_end	Unix epoch timestamp	Unix timestamp of??
epilogue_start	Unix epoch timestamp	Unix timestamp of??
epilogue_end	Unix epoch timestamp	Unix timestamp of??

Page tree

Torque Datastore on Hydro