State machine#

The progress_monitor_dataset and progress_monitor_item tables track the progress of datasets and items.

Dataset#

Phase

State

Definition

Set by

CONTRACTING_PROCESS

IN_PROGRESS

Extraction is in-progress

workers.extract.*

CONTRACTING_PROCESS

OK

Extraction is complete

workers.extract.*

DATASET

IN_PROGRESS

Dataset-level checks are in-progress

workers.check.dataset

DATASET

OK

Dataset-level checks are complete

workers.check.dataset

TIME_VARIANCE

IN_PROGRESS

Time-based checks are in-progress

workers.check.time_based

TIME_VARIANCE

OK

Time-based checks are complete

workers.check.time_based

CHECKED

OK

All work is complete

workers.report

DELETED

OK

The dataset is deleted, but the row is needed for foreign key references

remove command

Item#

State

Definition

Set by

IN_PROGRESS

The item’s field-level and compiled release-level checks have not yet been performed

workers.extract.*

OK

The item’s field-level and compiled release-level checks have been performed

contracting_process/processor.py