diff --git a/docs/configuration/jobs.rst b/docs/configuration/jobs.rst index 96203c8..e6cd934 100644 --- a/docs/configuration/jobs.rst +++ b/docs/configuration/jobs.rst @@ -7,6 +7,8 @@ .. |filter| replace:: :ref:`filter ` .. |prune| replace:: :ref:`prune ` +.. _job: + Job Types ========= diff --git a/docs/configuration/prune.rst b/docs/configuration/prune.rst index daf10f1..fab5589 100644 --- a/docs/configuration/prune.rst +++ b/docs/configuration/prune.rst @@ -1,16 +1,18 @@ .. _prune: -Snapshot Pruning +Pruning Policies ================ In zrepl, *pruning* means *destroying snapshots by some policy*. -A *pruning policy* takes a list of snapshots and - for each snapshot - decides whether it should be kept or destroyed. +A *pruning policy* takes a list of snapshots and -- for each snapshot -- decides whether it should be kept or destroyed. -The job context defines which snapshots are even considered for pruning, for example through the `snapshot_prefix` variable. -Check the [job definition]({{< relref "configuration/jobs.md">}}) for details. +The job context defines which snapshots are even considered for pruning, for example through the ``snapshot_prefix`` variable. +Check the respective :ref:`job definition ` for details. -Currently, the retention grid is the only supported pruning policy. +Currently, the :ref:`prune-retention-grid` is the only supported pruning policy. + +.. _prune-retention-grid: Retention Grid -------------- @@ -29,33 +31,34 @@ Retention Grid └─ 24 adjacent one-hour intervals The retention grid can be thought of as a time-based sieve: - -The `grid` field specifies a list of adjacent time intervals: -the left edge of the leftmost (first) interval is the `creation` date of the youngest snapshot. +The ``grid`` field specifies a list of adjacent time intervals: +the left edge of the leftmost (first) interval is the ``creation`` date of the youngest snapshot. All intervals to its right describe time intervals further in the past. Each interval carries a maximum number of snapshots to keep. -It is secified via `(keep=N)`, where `N` is either `all` (all snapshots are kept) or a positive integer. +It is secified via ``(keep=N)``, where ``N`` is either ``all`` (all snapshots are kept) or a positive integer. The default value is **1**. The following procedure happens during pruning: -1. The list of snapshots eligible for pruning is sorted by `creation` -1. The left edge of the first interval is aligned to the `creation` date of the youngest snapshot -1. A list of buckets is created, one for each interval -1. The list of snapshots is split up into the buckets. -1. For each bucket +#. The list of snapshots eligible for pruning is sorted by ``creation`` +#. The left edge of the first interval is aligned to the ``creation`` date of the youngest snapshot +#. A list of buckets is created, one for each interval +#. The list of snapshots is split up into the buckets. +#. For each bucket - 1. the contained snapshot list is sorted by creation. - 1. snapshots from the list, oldest first, are destroyed until the specified `keep` count is reached. - 1. all remaining snapshots on the list are kept. + #. the contained snapshot list is sorted by creation. + #. snapshots from the list, oldest first, are destroyed until the specified ``keep`` count is reached. + #. all remaining snapshots on the list are kept. .. ATTENTION:: - The configuration of the first interval (`1x1h(keep=all)` in the example) determines the **maximum allowable replication lag** between source and destination. + .. TODO this is obsolete as soon as bookmarks are created during snapshotting + + The configuration of the first interval (``1x1h(keep=all)`` in the example) determines the **maximum allowable replication lag** between source and destination. After the first interval, source and destination likely have different retention settings. This means source and destination may prune different snapshots, prohibiting incremental replication froms snapshots that are not in the first interval. - **Always** configure the first interval to **`1x?(keep=all)`**, substituting `?` with the maximum time replication may fail due to downtimes, maintenance, connectivity issues, etc. - After outages longer than `?` you may be required to perform **full replication** again. + **Always** configure the first interval to ``1x?(keep=all)``, substituting ``?`` with the maximum time replication may fail due to downtimes, maintenance, connectivity issues, etc. + After outages longer than ``?`` you may be required to perform **full replication** again.