KMR
Functions | Variables
kmrrungenscript.in.py File Reference

KMRRUN Job-Script Generator. More...

Go to the source code of this file.

Functions

def kmrrungenscript.check_cmdline (cmdline, sched)
 Check if command in the specified command line exists. More...
 
def kmrrungenscript.check_indir (dirname, sched)
 Check if command in the specified command line exists. More...
 
def kmrrungenscript.check_restart (restart_basename, procstr, sched)
 Check restart mode. More...
 
def kmrrungenscript.focus_scheduler (name, queue, rsctime, node, kmrrun_path, kmrrun_parameter, template_path)
 Generates job-script for FOCUS supercomputer. More...
 
def kmrrungenscript.k_node_to_int (shape_str)
 Parse K node declaration into an integer. More...
 
def kmrrungenscript.k_scheduler (name, queue, rsctime, node, kmrrun_path, kmrrun_parameter, template_path, shape, proc, mapper, kvgen, reducer, indir, ckpt, restart_basename)
 Generates job-script for K. More...
 
def kmrrungenscript.select_scheduler (opts, sched)
 Selects job-scheduler. More...
 
def kmrrungenscript.warn_stageout (opts)
 Warn to write Stage-out section. More...
 

Variables

 kmrrungenscript.action
 
 kmrrungenscript.args
 
 kmrrungenscript.default
 
 kmrrungenscript.dest
 
 kmrrungenscript.help
 
string kmrrungenscript.kmrhome = '@KMRHOME@'
 
 kmrrungenscript.metavar
 
 kmrrungenscript.options
 
 kmrrungenscript.parser = OptionParser(usage)
 
 kmrrungenscript.type
 
string kmrrungenscript.usage = "usage: %prog [options] -m mapper [-k keygener -r reducer]"
 kmrgenscript main routine. More...
 

Detailed Description

KMRRUN Job-Script Generator.

Definition in file kmrrungenscript.in.py.

Function Documentation

def kmrrungenscript.check_cmdline (   cmdline,
  sched 
)

Check if command in the specified command line exists.

Parameters
cmdlinea command line to be executed
schedstring that represents scheduler type

Definition at line 30 of file kmrrungenscript.in.py.

def kmrrungenscript.check_indir (   dirname,
  sched 
)

Check if command in the specified command line exists.

Parameters
dirnamename of directory where input files are located
schedstring that represents scheduler type

Definition at line 43 of file kmrrungenscript.in.py.

def kmrrungenscript.check_restart (   restart_basename,
  procstr,
  sched 
)

Check restart mode.

If node > number of checkpoint file, error.

Parameters
restart_basenameprefix of checkpoint directory name
procstrstring that represents process number
schedstring that represents scheduler type

Definition at line 58 of file kmrrungenscript.in.py.

def kmrrungenscript.k_node_to_int (   shape_str)

Parse K node declaration into an integer.

Parameters
shape_strstring that represents K node shape

Definition at line 97 of file kmrrungenscript.in.py.

def kmrrungenscript.k_scheduler (   name,
  queue,
  rsctime,
  node,
  kmrrun_path,
  kmrrun_parameter,
  template_path,
  shape,
  proc,
  mapper,
  kvgen,
  reducer,
  indir,
  ckpt,
  restart_basename 
)

Generates job-script for K.

Parameters
namename of the job
queuequeue to submit job
rsctimeresource time limit
nodenumber of node to execute.
kmrrun_pathpath to kmrrun command
kmrrun_parameterparameter for kmrrun
template_pathpath for template file
shapempi process shape
procnumber of execute proc
mappermapper command line
kvgenkv generator command line
reducerreducer command line
indirdirectory where inputs are located(staged-in)
ckptenable checkpoint
restart_basenameprefix of checkpoint directory name

Definition at line 125 of file kmrrungenscript.in.py.

def kmrrungenscript.focus_scheduler (   name,
  queue,
  rsctime,
  node,
  kmrrun_path,
  kmrrun_parameter,
  template_path 
)

Generates job-script for FOCUS supercomputer.

Parameters
namename of the job
queuequeue to submit job
rsctimeresource time limit
nodenumber of MPI processes to use
kmrrun_pathpath to kmrrun command
kmrrun_parameterparameter for kmrrun
template_pathpath for template file

Definition at line 185 of file kmrrungenscript.in.py.

def kmrrungenscript.select_scheduler (   opts,
  sched 
)

Selects job-scheduler.

Parameters
optsOptions to the generator
schedscheduler

Definition at line 196 of file kmrrungenscript.in.py.

def kmrrungenscript.warn_stageout (   opts)

Warn to write Stage-out section.

Parameters
optsOptions to the generator

Definition at line 261 of file kmrrungenscript.in.py.

Variable Documentation

string kmrrungenscript.usage = "usage: %prog [options] -m mapper [-k keygener -r reducer]"

kmrgenscript main routine.

It works on Python 2.4 or later.

Definition at line 285 of file kmrrungenscript.in.py.