edcd258cc9
replication: more elaborate messages for Conflict errors
2019-03-13 18:46:04 +01:00
d5250bbf51
client/status: fix wrap for multiline strings with leading space
2019-03-13 18:46:04 +01:00
d50e553ebb
handle changes to placeholder state correctly
...
We assumed that `zfs recv -F FS` would basically replace FS inplace, leaving its children untouched.
That is in fact not the case, it only works if `zfs send -R` is set, which we don't do.
Thus, implement the required functionality manually.
This solves a `zfs recv` error that would occur when a filesystem previously created as placeholder on the receiving side becomes a non-placeholder filesystem (likely due to config change on the sending side):
zfs send pool1/foo@1 | zfs recv -F pool1/bar
cannot receive new filesystem stream:
destination has snapshots (eg. pool1/bar)
must destroy them to overwrite it
2019-03-13 18:46:04 +01:00
1eb0f12a61
replication: add diff test case
2019-03-13 18:45:40 +01:00
8129ed91f1
zfs + replication: migrate dead zfs/diff_test.go to replication/logic/diff
...
(and remove the dead code from package zfs)
2019-03-13 16:39:10 +01:00
c87759affe
replication/driver: automatic retries on connectivity-related errors
2019-03-13 15:00:40 +01:00
07b43bffa4
replication: refactor driving logic (no more explicit state machine)
2019-03-13 15:00:40 +01:00
0230c6321f
rpc/dataconn: microbenchmark
2019-03-13 13:57:21 +01:00
796c5ad42d
rpc rewrite: control RPCs using gRPC + separate RPC for data transfer
...
transport/ssh: update go-netssh to new version
=> supports CloseWrite and Deadlines
=> build: require Go 1.11 (netssh requires it)
2019-03-13 13:53:48 +01:00
d281fb00e3
socketpair: directly export *net.UnixConn (and add test for that behavior)
2019-03-13 11:36:34 +01:00
76a6c623f3
tlsconf and transport/tls: support NSS-formatted keylog file for debugging
...
... via env variable
2019-03-13 00:28:38 +01:00
25c974f0b5
envconst: support for int64
2019-03-13 00:07:33 +01:00
ea719f5b5a
build: use 'git describe --always' to determine ZREPL_VERSION
2019-03-13 00:07:33 +01:00
3105fa4ff8
build: use dep's required feature for dev tools
2019-03-12 23:43:39 +01:00
38b0bd76f5
build: just use go {test,vet} ./... for targets vet, test and generate
2018-12-11 22:00:03 +01:00
c1aab0bee9
config: update yaml-config and use zeropositive constraint for timeouts
2018-12-11 21:54:36 +01:00
ef3283638a
logger: add stderrlogger (sometimes useful)
2018-12-11 21:24:54 +01:00
68b62a5c00
tlsconf: clear handshake deadline after completed handshake
2018-12-11 21:24:26 +01:00
7a75a4d384
util/iocommand: timeout kill on close + other hardening
2018-12-11 21:06:54 +01:00
1aae7b222f
docs: fix confusing description of the role of client identity for sink jobs
2018-12-01 15:19:59 +01:00
3535b251ab
freeze Go build dependencies in Gopkg.lock
...
* use pseudo-depdencies in build/build.go to convince dep
* update Travis, Dockerfile and Docs
* build.Dockerfile image now contains the Go build dependencies
* => faster builds
* bump pdu file after protoc update
fixes #106
2018-12-01 14:36:40 +01:00
707f070a3c
build: fix dirty detection at the end of release build
...
was using Bashisms
2018-12-01 14:36:40 +01:00
7ab51fad0d
zfs: add 'received' property source, handle 'any' source correctly and use 'any' for placeholder FS detection
...
we want was first noticed in zfs 0.8rc1
Upstream doc PR: https://github.com/zfsonlinux/zfs/pull/8134
2018-11-16 13:07:13 +01:00
3472145df6
pruner + proto change: better handling of missing replication cursor
...
- don't treat missing replication cursor as an error in protocol
- treat it as a per-fs planning error instead
2018-11-16 12:21:54 +01:00
5e1ea21f85
pruning: add 'Negate' option to KeepRegex and expose it in config
2018-11-16 12:21:54 +01:00
2db3977408
cli: add 'test placeholder' subcommand for placeholder debugging
2018-11-16 12:21:54 +01:00
ca6d5d3bb5
build: Travis CI configuration
2018-11-16 12:10:58 +01:00
163c2bc533
docs: update requirements.txt
2018-11-16 12:10:58 +01:00
dd286aa12e
client: fix status bytes per second measurement
...
still far from perfect, but better than incorrect values
2018-11-05 01:37:51 +01:00
80babe3ab4
docs/README: update package hierarchy overview
2018-10-26 22:05:57 +02:00
ca0cab0a15
docs/tutorial: fix headlines
2018-10-26 21:52:49 +02:00
ad8be226fd
fix small typo
2018-10-22 11:32:37 +02:00
9b3e5c38e2
docs: fix changelog + invocations of wakeup subcommand
2018-10-22 11:27:00 +02:00
7e1c5f5d1f
docs: discourage use of ssh+stdinserver transport due to inferior error handling
2018-10-22 11:25:16 +02:00
98bc8d1717
daemon/job: explicit notice of ZREPL_JOB_WATCHDOG_TIMEOUT environment variable on cancellation
2018-10-22 11:03:31 +02:00
2889a5d5ff
client/status: current bytes/second + spinning progress bar
2018-10-21 23:15:21 +02:00
0b8c19c620
docs/tutorial: switch to push setup & use mutual TLS (2 machines)
2018-10-21 22:20:35 +02:00
a62b475f46
docs/transport/tls: document self-signed certs procedure for 2-machine setup
2018-10-21 22:20:07 +02:00
1691839c6b
replication: handle context cancellation errors as GlobalError
2018-10-21 19:06:35 +02:00
36265ff349
fixup 438f950be3: forgotten ErrorCount in printf
2018-10-21 18:37:57 +02:00
94427d334b
replication + pruner + watchdog: adjust timeouts based on practical experience
2018-10-21 18:37:57 +02:00
b2844569c8
replication: rewrite error handling + simplify state machines
...
* Remove explicity state machine code for all but replication.Replication
* Introduce explicit error types that satisfy interfaces which provide
sufficient information for replication.Replication to make intelligent
retry + queuing decisions
* Temporary()
* LocalToFS()
* Remove the queue and replace it with a simple array that we sort each
time (yay no generics :( )
2018-10-21 18:37:57 +02:00
ae5e60b1ae
client/status: display problems as wrapped + indented if they do not fit the current line
2018-10-21 17:50:08 +02:00
fffda09f67
replication + pruner: progress markers during planning
2018-10-21 17:50:08 +02:00
5ec7a5c078
pruner: report: fix broken checks for state (wrong precedence rules)
2018-10-21 13:37:08 +02:00
190c7270d9
daemon/active + watchdog: simplify control flow using explicit ActiveSideState
2018-10-21 12:53:34 +02:00
f704b28cad
daemon/job: track active side state explicitly
2018-10-21 12:52:48 +02:00
5efeec1819
daemon/control: stop logging status endpoint requests
2018-10-20 12:50:31 +02:00
438f950be3
pruner: improve cancellation + error handling strategy
...
Pruner now backs off as soon as there is an error, making that error the
Error field in the pruner report.
The error is also stored in the specific *fs that failed, and we
maintain an error counter per *fs to de-prioritize those fs that failed.
Like with replication, the de-prioritization on errors is to avoid '
getting stuck' with an individual filesystem until the watchdog hits.
2018-10-20 12:46:43 +02:00
50c1549865
pruner: fixup 69bfcb7bed: add missing progress updates for watchdog
2018-10-20 10:58:22 +02:00
