Production

Work that runs without you watching it.

A scheduled job across five nights, one of which failed, and what the failure produced. the difference between a script and a job is what happens when it failsMonTueWedThuFrian alert, with the stagea log you can reada resume from file 412none of these are the GISA job nobody is watching needs to say what it did, and be safe to run again

The difference between a script and a job is what happens when nobody is watching. A script that works on your machine, on your files, while you sit in front of it, has proved almost nothing about what it will do at three in the morning against a supplier who changed a column name.

So this section is not really about GIS. It is about the ring around the GIS: a config file so the run is described rather than typed, a log that says what happened, an alert when it did not, a manifest so a crash means resuming rather than restarting, and a container so the versions are the same on the next machine. The processing itself is usually the shortest part of the file.

Five topics: running one operation across a folder, wrapping that in a pipeline, making it fast enough, reading from cloud-native formats instead of downloading, and proving it still works.

Other areas