New Jobs

This script searches the database for files flagged “N”ew or “M”odified. For each date in the configured range, it checks if other stations are available and defines the new jobs to be processed. Those are inserted in the jobs table of the database.

To run it from the console:

$ msnoise new_jobs

Upon first run, if you expect the number of jobs to be large (many days, many stations), pass the --init parameter to optimize the insert. Only use this flag once, otherwise problems will arise from duplicate entries in the jobs table.

$ msnoise new_jobs --init

Performance / running on HPC

By setting the hpc configuration parameter to Y, you will disable the automatic creation of jobs during the workflow, to avoid numerous interactions with the database (select & update or insert). The jobs have then to be inserted manually:

$ msnoise new_jobs --hpc CC:STACK

should be run after the msnoise compute_cc step in order to create the STACK jobs.