Christian Schwarz
17818439a0
Merge branch 'problame/replication_refactor' into InsanePrawn-master
2019-03-17 17:33:51 +01:00
Christian Schwarz
056be1185d
dist: add grafana dashboard
...
fixes #116
2019-03-16 16:12:34 +01:00
Christian Schwarz
b0898ec8bc
dist: systemd service definition template
...
fixes #117
refs #145
2019-03-16 16:12:34 +01:00
Christian Schwarz
133b7013a0
Merge remote-tracking branch 'origin/master' into problame/replication_refactor
2019-03-16 16:09:40 +01:00
Christian Schwarz
dabf7e3ec9
build: travis: Go1.12 and some refactorings
2019-03-16 16:02:45 +01:00
Christian Schwarz
da3ba50a2c
Merge remote-tracking branch 'origin/master' into problame/replication_refactor
2019-03-16 14:48:01 +01:00
Christian Schwarz
5eababe0b0
endpoing: receiver: return visitErr on traversal error
...
fixes #137
2019-03-16 14:47:34 +01:00
Christian Schwarz
b2c5ffcaea
rpc: dataconn: handle incorrect handler return values
...
refs #137
2019-03-16 14:47:29 +01:00
Christian Schwarz
4ee00091d6
pull job: support manual-only invocation
2019-03-16 14:24:05 +01:00
Christian Schwarz
c655622bf7
build: travis: allow_failures of go:master
2019-03-15 22:43:18 +01:00
Christian Schwarz
71d331af16
Add CircleCI config
...
Doesn't cover all of Travis, but CircleCI archives artifacts.
2019-03-15 22:15:15 +01:00
Christian Schwarz
34052d98d6
docs: move snap job below all replication-related job types
2019-03-15 22:00:29 +01:00
Christian Schwarz
3543fbbb65
docs: clarify language & example of source-side pruning workaround
2019-03-15 22:00:29 +01:00
Christian Schwarz
aff639e87a
Merge remote-tracking branch 'origin/master' into InsanePrawn-master
2019-03-15 21:05:20 +01:00
Christian Schwarz
5dfe24eeee
Merge 'joshsouza/fix_peer_cert_chains' into 'master'
2019-03-15 18:40:05 +01:00
Christian Schwarz
78ec5aa716
Merge remote-tracking branch 'origin/master' into joshsouza-fix_peer_cert_chains
2019-03-15 18:37:11 +01:00
Christian Schwarz
457d5bad9a
Merge 'ximalias/Ximalas-syslog-facility' into 'master'
2019-03-15 18:33:47 +01:00
Christian Schwarz
a0f301d700
syslog logging: fix priority parsing + add test for default facility
2019-03-15 18:18:16 +01:00
Ximalas
fc311a9fd6
syslog logging: support setting facility in config
2019-03-15 17:55:11 +01:00
Christian Schwarz
a7993d18c6
transport/tls: clarify docs & error message language
2019-03-15 17:17:25 +01:00
Christian Schwarz
5595cff6a6
Merge branch 'master' into fix_peer_cert_chains
2019-03-15 16:34:21 +01:00
Christian Schwarz
2c3b3c093d
rpc: do not leak grpc state change logger goroutine
2019-03-15 16:18:01 +01:00
Christian Schwarz
ab3e783168
rpc: treat protocol handshake errors as permanent
...
treat handshake errors as permanent on the client
The issue was observed by 100% CPU usage due to lack ofrate-limiting in
dataconn.ReqPing retries=> safeguard that
2019-03-15 16:18:01 +01:00
Christian Schwarz
7584c66bdb
pruner: remove retry handling + fix early give-up
...
Retry handling is broken since the gRPC changes (wrong error classification).
Will come back at some point, hopefully by merging the replication
driver retry infrastructure.
However, the simpler architecture allows an easy fix for the problem
that the pruner practically gave up on the first error it encountered.
fixes #123
2019-03-13 21:04:39 +01:00
Christian Schwarz
d78d20e2d0
pruner: skip placeholders + FSes without correspondents on source
...
fixes #126
2019-03-13 20:42:37 +01:00
Christian Schwarz
b85ec52387
rpc/ctrl: nicer perr info debug log messages
2019-03-13 19:20:04 +01:00
Christian Schwarz
edcd258cc9
replication: more elaborate messages for Conflict errors
2019-03-13 18:46:04 +01:00
Christian Schwarz
d5250bbf51
client/status: fix wrap for multiline strings with leading space
2019-03-13 18:46:04 +01:00
Christian Schwarz
d50e553ebb
handle changes to placeholder state correctly
...
We assumed that `zfs recv -F FS` would basically replace FS inplace, leaving its children untouched.
That is in fact not the case, it only works if `zfs send -R` is set, which we don't do.
Thus, implement the required functionality manually.
This solves a `zfs recv` error that would occur when a filesystem previously created as placeholder on the receiving side becomes a non-placeholder filesystem (likely due to config change on the sending side):
zfs send pool1/foo@1 | zfs recv -F pool1/bar
cannot receive new filesystem stream:
destination has snapshots (eg. pool1/bar)
must destroy them to overwrite it
2019-03-13 18:46:04 +01:00
Christian Schwarz
1eb0f12a61
replication: add diff test case
2019-03-13 18:45:40 +01:00
Christian Schwarz
8129ed91f1
zfs + replication: migrate dead zfs/diff_test.go to replication/logic/diff
...
(and remove the dead code from package zfs)
2019-03-13 16:39:10 +01:00
Christian Schwarz
c87759affe
replication/driver: automatic retries on connectivity-related errors
2019-03-13 15:00:40 +01:00
Christian Schwarz
07b43bffa4
replication: refactor driving logic (no more explicit state machine)
2019-03-13 15:00:40 +01:00
Christian Schwarz
0230c6321f
rpc/dataconn: microbenchmark
2019-03-13 13:57:21 +01:00
Christian Schwarz
796c5ad42d
rpc rewrite: control RPCs using gRPC + separate RPC for data transfer
...
transport/ssh: update go-netssh to new version
=> supports CloseWrite and Deadlines
=> build: require Go 1.11 (netssh requires it)
2019-03-13 13:53:48 +01:00
Christian Schwarz
d281fb00e3
socketpair: directly export *net.UnixConn (and add test for that behavior)
2019-03-13 11:36:34 +01:00
Christian Schwarz
76a6c623f3
tlsconf and transport/tls: support NSS-formatted keylog file for debugging
...
... via env variable
2019-03-13 00:28:38 +01:00
Christian Schwarz
25c974f0b5
envconst: support for int64
2019-03-13 00:07:33 +01:00
Christian Schwarz
ea719f5b5a
build: use 'git describe --always' to determine ZREPL_VERSION
2019-03-13 00:07:33 +01:00
Christian Schwarz
3105fa4ff8
build: use dep's required feature for dev tools
2019-03-12 23:43:39 +01:00
Josh Souza
f724480c7b
Add documentation regarding using a certificate chain
2019-01-22 10:09:24 -08:00
Jakob Berger
5c5e8c0baf
Documentation changes mostly as requested
2019-01-22 16:46:34 +01:00
Josh Souza
bb5278fe9b
Permit peers to provide a cert chain (multiple certs). fixes #103
2019-01-09 10:10:37 -08:00
Christian Schwarz
38b0bd76f5
build: just use go {test,vet} ./... for targets vet, test and generate
2018-12-11 22:00:03 +01:00
Christian Schwarz
c1aab0bee9
config: update yaml-config and use zeropositive constraint for timeouts
2018-12-11 21:54:36 +01:00
Christian Schwarz
ef3283638a
logger: add stderrlogger (sometimes useful)
2018-12-11 21:24:54 +01:00
Christian Schwarz
68b62a5c00
tlsconf: clear handshake deadline after completed handshake
2018-12-11 21:24:26 +01:00
Christian Schwarz
7a75a4d384
util/iocommand: timeout kill on close + other hardening
2018-12-11 21:06:54 +01:00
Christian Schwarz
1aae7b222f
docs: fix confusing description of the role of client identity for sink jobs
2018-12-01 15:19:59 +01:00
Christian Schwarz
3535b251ab
freeze Go build dependencies in Gopkg.lock
...
* use pseudo-depdencies in build/build.go to convince dep
* update Travis, Dockerfile and Docs
* build.Dockerfile image now contains the Go build dependencies
* => faster builds
* bump pdu file after protoc update
fixes #106
2018-12-01 14:36:40 +01:00
