Christian Schwarz
000d8bba66
hotfix: limit concurrency of zfs send & recv commands
...
ATM, the replication logic sends all dry-run requests in parallel,
which might overwhelm the ZFS pool on the sending side.
Since we use rpc/dataconn for dry sends, this also opens one TCP
connection per dry-run request.
Use a sempahore to limit the degree of concurrency where we know it is a
problem ATM.
As indicated by the comments, the cleaner solution would involve some
kind of 'resource exhaustion' error code.
refs #161
refs #164
2019-03-28 22:17:12 +01:00
Christian Schwarz
5f909dab76
build: CircleCI build artifact upload
2019-03-28 14:41:20 +01:00
Christian Schwarz
56e63ff551
Merge pull request #159 from zrepl/problame/cleanup-project
...
cleanup project: formatting & basic lints
2019-03-27 16:25:10 +01:00
Christian Schwarz
f31b54582f
daemon/job: fix receiving-job root-fs overlap detection
...
fixup for 7756c9a5fixes #160
2019-03-27 13:12:26 +01:00
Christian Schwarz
5b256a92b3
include linting in build process
2019-03-27 13:12:26 +01:00
Christian Schwarz
cd829bd79a
pin formatter and linter as deps
2019-03-27 13:12:26 +01:00
Christian Schwarz
5b97953bfb
run golangci-lint and apply suggested fixes
2019-03-27 13:12:26 +01:00
Christian Schwarz
afed762774
format source tree using goimports
2019-03-22 19:41:12 +01:00
Christian Schwarz
5324f29693
docs: publish.sh: allow v0.1.0-rc4
2019-03-22 12:02:07 +01:00
Christian Schwarz
b96a287a2f
docs: adjust publish.sh script
2019-03-22 11:54:49 +01:00
Christian Schwarz
0ab62f197a
Merge branch 'problame/overlapping-dataset-hierarchy-improvements' into 'master'
...
closes #153
2019-03-22 11:02:57 +01:00
Christian Schwarz
9a2d1b3074
Merge branch 'problame/138-snapshotter-fails-silently' into 'master'
...
closes #152
2019-03-22 10:59:58 +01:00
Christian Schwarz
e809dbf45e
Merge branch 'problame/social_and_donation_shields'
2019-03-21 21:44:29 +01:00
Christian Schwarz
644d6f8ffb
Merge branch 'problame/simplify-placeholder-property' into master
...
As became clear in #126 (comment) the current zrepl:placeholder user
property makes it hard to rename datasets because the placeholder status
is determined by computing a hash of the dataset path and comparing it
with the property value.
This PR
- changes zrepl:placeholder to a simple on|off property
- derives property status from the property source (local),avoiding the
original problem of property inheritance in the original implementation
- provides a migration command that, based on the current zrepl
configuration, migrates property values to the new on|off schema
refs #150
2019-03-21 21:37:40 +01:00
Christian Schwarz
e37bb73b4e
Merge branch 'problame/fix-spaces-in-dataset-names-131'
2019-03-21 21:09:08 +01:00
Christian Schwarz
26ec29d8b2
snapper: retry on errors during syncUp and log them
...
fixes #138
2019-03-21 17:17:10 +01:00
Christian Schwarz
c0028c1c44
daemon/logging: add replication logic logger
2019-03-21 17:03:34 +01:00
Christian Schwarz
ab38f24198
zfs: bookmark / replication cursor: handle spaces in ds names correctly
...
fixes #131
2019-03-21 17:03:26 +01:00
Christian Schwarz
7d9a1b7eae
zfs: dry send: handle spaces in dataset names correctly
...
fixes #131
2019-03-21 17:03:19 +01:00
Christian Schwarz
2107483588
docs: jobs: correct root_fs field explanation
2019-03-21 12:51:39 +01:00
Christian Schwarz
c2b05954e9
docs: jobs: explain multi-job & machine considerations
...
refs #136
refs #140
2019-03-21 12:51:07 +01:00
Christian Schwarz
7756c9a55c
config + job: forbid non-verlapping receiver root_fs
...
refs #136
refs #140
2019-03-21 12:07:55 +01:00
Christian Schwarz
3e71542c78
endpoint: serialize dataset hierarchy modification within a receiver job
...
refs #136
refs #140
2019-03-20 23:02:10 +01:00
Christian Schwarz
2f2e6e6a00
receiving side: placeholder as simple on|off property
2019-03-20 20:26:30 +01:00
Christian Schwarz
6f7467e8d8
Merge branch 'InsanePrawn-master' into 'master'
2019-03-20 19:45:00 +01:00
Christian Schwarz
f2a6193735
Merge branch 'problame/replication_refactor'
2019-03-20 19:44:15 +01:00
Christian Schwarz
84eca86e14
Merge branch 'problame/0.1-docs-fixes'
2019-03-20 19:31:32 +01:00
Christian Schwarz
86fdcfc437
replication: stepqueue: make TestPqNotconcurrent less flaky
2019-03-19 18:50:12 +01:00
Christian Schwarz
25eeedbce8
docs: link to good_first_issue and docs category
2019-03-19 18:22:15 +01:00
Christian Schwarz
2ba1ff15b7
docs: mention automatic retries
2019-03-19 18:18:41 +01:00
Christian Schwarz
5aefc47f71
daemon: remove last traces of watchdog mechanism
2019-03-19 18:15:34 +01:00
Christian Schwarz
7633c1cdf1
docs: tutorial: s/pull/push
2019-03-18 14:56:32 +01:00
Christian Schwarz
283c2821cd
docs: add SnapJob to 0.1 changelog
2019-03-18 14:53:12 +01:00
Christian Schwarz
fb999c8617
docs: drop references to 'main config file'
...
were just confusing in the remaining places where they were used
fixes #127
2019-03-18 14:50:32 +01:00
Christian Schwarz
53dc0c3c5e
docs: document existence of zrepl:placeholder property
...
fixes #129
2019-03-18 14:50:32 +01:00
Christian Schwarz
84019238df
docs: changelog: remove whitespace & churn
2019-03-18 14:50:32 +01:00
Christian Schwarz
cef865f5ce
docs: changelog 0.1: document forgotten bugfixes & features
2019-03-18 14:50:32 +01:00
Christian Schwarz
bdf99f6bb4
docs: document material in dist/
2019-03-18 12:45:27 +01:00
Christian Schwarz
7424423d9a
Merge pull request #146 from zrepl/problame/add-some-dist-stuff
...
Grafana Dashboard & Systemd Unit
2019-03-18 12:41:39 +01:00
Christian Schwarz
c9b812570d
docs: changelog: document new rpc & retry behavior changes
2019-03-18 12:39:53 +01:00
Christian Schwarz
e62d157aac
docs: remove typo at end of changelog
2019-03-18 12:23:39 +01:00
Christian Schwarz
99b3337b1c
docs: add shields for license, language, donations + tweeting
2019-03-18 11:13:50 +01:00
Christian Schwarz
dd673bf923
docs: condense snap job overview table row
2019-03-17 21:29:09 +01:00
Christian Schwarz
158d1175e3
rename SinglePruner to LocalPruner
2019-03-17 21:18:25 +01:00
Christian Schwarz
b25da7b9b0
job: snap: comment fix
2019-03-17 21:07:42 +01:00
Christian Schwarz
5cd2593f52
job: snap: workaround for replication cursor requirement
2019-03-17 21:07:01 +01:00
Christian Schwarz
d8d9e34914
pruner: single: remove unused member considerSnapAtCursorReplicated
2019-03-17 20:57:34 +01:00
Christian Schwarz
e8c0d206ea
docs: fix nitpicks
2019-03-17 20:54:47 +01:00
Christian Schwarz
17818439a0
Merge branch 'problame/replication_refactor' into InsanePrawn-master
2019-03-17 17:33:51 +01:00
Christian Schwarz
056be1185d
dist: add grafana dashboard
...
fixes #116
2019-03-16 16:12:34 +01:00
