Christian Schwarz
5595cff6a6
Merge branch 'master' into fix_peer_cert_chains
2019-03-15 16:34:21 +01:00
Christian Schwarz
796c5ad42d
rpc rewrite: control RPCs using gRPC + separate RPC for data transfer
...
transport/ssh: update go-netssh to new version
=> supports CloseWrite and Deadlines
=> build: require Go 1.11 (netssh requires it)
2019-03-13 13:53:48 +01:00
Josh Souza
f724480c7b
Add documentation regarding using a certificate chain
2019-01-22 10:09:24 -08:00
Jakob Berger
5c5e8c0baf
Documentation changes mostly as requested
2019-01-22 16:46:34 +01:00
Christian Schwarz
1aae7b222f
docs: fix confusing description of the role of client identity for sink jobs
2018-12-01 15:19:59 +01:00
Christian Schwarz
3535b251ab
freeze Go build dependencies in Gopkg.lock
...
* use pseudo-depdencies in build/build.go to convince dep
* update Travis, Dockerfile and Docs
* build.Dockerfile image now contains the Go build dependencies
* => faster builds
* bump pdu file after protoc update
fixes #106
2018-12-01 14:36:40 +01:00
InsanePrawn
d977796f18
Add SnapJob docs
2018-11-21 16:59:46 +01:00
Christian Schwarz
5e1ea21f85
pruning: add 'Negate' option to KeepRegex and expose it in config
2018-11-16 12:21:54 +01:00
Christian Schwarz
163c2bc533
docs: update requirements.txt
2018-11-16 12:10:58 +01:00
Christian Schwarz
ca0cab0a15
docs/tutorial: fix headlines
2018-10-26 21:52:49 +02:00
JMoVS
ad8be226fd
fix small typo
2018-10-22 11:32:37 +02:00
Christian Schwarz
9b3e5c38e2
docs: fix changelog + invocations of wakeup subcommand
2018-10-22 11:27:00 +02:00
Christian Schwarz
7e1c5f5d1f
docs: discourage use of ssh+stdinserver transport due to inferior error handling
2018-10-22 11:25:16 +02:00
Christian Schwarz
0b8c19c620
docs/tutorial: switch to push setup & use mutual TLS (2 machines)
2018-10-21 22:20:35 +02:00
Christian Schwarz
a62b475f46
docs/transport/tls: document self-signed certs procedure for 2-machine setup
2018-10-21 22:20:07 +02:00
Christian Schwarz
f13749380d
docs: add warnings of changing semantics for manually created snapshots in 0.1
2018-10-13 18:34:37 +02:00
Christian Schwarz
eadb6f823d
docs: remove unreleased annotation from changelog for 0.1
2018-10-13 17:35:38 +02:00
Christian Schwarz
e7497ab3d0
LICENSE + docs: adjust copyright
2018-10-13 17:34:05 +02:00
Christian Schwarz
074f989547
Merge branch 'replication_rewrite' (in fact it's a 90% rewrite)
2018-10-13 16:26:23 +02:00
Christian Schwarz
f6cf23779f
docs: Remove stale TIP for dry-run zrepl test subcommand.
...
Won't make it to 0.1
2018-10-13 16:22:19 +02:00
Christian Schwarz
92a1a6d2ca
docs: fix wrong subcommand for configcheck
2018-10-13 16:22:19 +02:00
Christian Schwarz
63169c51b7
add 'test filesystems' subcommand for testing filesystem filters
2018-10-13 16:22:19 +02:00
Christian Schwarz
1643198713
docs: reflect changes in replication_rewrite branch
2018-10-11 18:03:18 +02:00
Christian Schwarz
88de8ba8bb
initial repl policy: get rid of unimplemented options
2018-08-25 22:23:47 +02:00
Christian Schwarz
e6426db8da
rpc: bump go-netssh package to address goroutine leak on timeouts
2018-05-22 17:30:29 +02:00
Christian Schwarz
67743d2a66
docs: promote monitoring on front page
2018-04-14 11:30:48 +02:00
Christian Schwarz
386d3b19b2
docs: fix missing slash in sampleconf link text
2018-04-14 11:25:31 +02:00
Christian Schwarz
82ea535692
daemon: expose prometheus in new global.monitoring config section + document it
...
refs #67
2018-04-14 11:24:47 +02:00
Christian Schwarz
0d2f73d728
docs: tutorial: minor refinements
2018-04-01 14:58:12 +02:00
Christian Schwarz
9b803aad2d
docs: tutorial: document known_hosts file setup
...
fixes #64
2018-04-01 14:58:04 +02:00
Christian Schwarz
7f89372cfa
docs: fix enumeration in ssh+stdinserver docs
2018-03-04 17:20:08 +01:00
Christian Schwarz
26b436463d
ssh+stdinserver: connect: dial_timeout
...
This is a follow-up to ccd062e
2018-03-04 17:19:41 +01:00
Christian Schwarz
7464e967c8
docs: changelog remove senseless headline
2018-02-18 13:35:57 +01:00
Christian Schwarz
921deb43f5
docs: changelog for 0.0.3
2018-02-18 13:35:40 +01:00
Christian Schwarz
3ba3648f0f
zfs: use channel as iterator for ZFSList results
...
The old approach with ZFSList would keep the two-dimensional array of
lines and their fields in memory (for a short time), which could easily
consume 100s of MiB with > 10000 snapshots / bookmarks (see #34 )
fixes #61
2018-02-18 13:28:46 +01:00
Christian Schwarz
aa92261ea7
bookmarking: prune policy for bookmarks
...
refs #34
2018-02-17 20:48:31 +01:00
Christian Schwarz
94967b596c
docs: document changes to ssh+stdinserver transport implementation: ccd062e
2018-02-17 15:16:29 +01:00
Christian Schwarz
a622ef1487
docs: promote test subcommand
2017-12-29 22:53:33 +01:00
Christian Schwarz
8473462adf
build: adjust wrong path of zrepl source dir in build.Dockerfile
...
was symlinking /zrepl to /go/src/github.com/zrepl/zrepl earlier, forgot
to change that apparently
see 47726ad877#38
2017-12-29 22:25:48 +01:00
Christian Schwarz
839eccf513
logger.Outlet: WriteEntry must not block
...
- make TCPOutlet fully asynchronous, dropping messages if connection is
not fast enough
- syslog is just fine for now, local anyways
- stdout same thing
refs #26
2017-12-29 17:21:58 +01:00
Christian Schwarz
9a19615fd4
docs: document bookmarking + remove warning about replication lag
...
refs #34
2017-12-28 13:24:25 +01:00
Christian Schwarz
03ba2bb7c8
docs: move config files + runtime dir doc to new configuration/preface
2017-12-27 18:34:24 +01:00
Christian Schwarz
7ac2821147
docs: small usage section mentioning CLI
2017-12-27 18:34:24 +01:00
Christian Schwarz
e6554b77c0
docs: mention control status command in tutorial
...
refs #10
2017-12-27 18:34:24 +01:00
Christian Schwarz
2716c75ad5
build: target for go library dependencies
...
Didn't notice it because vendor/ was already populated on my dev
machine, but did notice it in Docker build.
Docker build now consumes devsetup like regular user, so this should
catch future problems.
Remove remaining curl|shit functionality from lazy.sh (no checkout logic
needed anymore).
refs #35
2017-11-19 12:34:01 +01:00
Christian Schwarz
e8facfe9fa
docs: sphinx-versioning would not build master
...
sphinx-versioning only build branches / commits with a 'docs/conf.py',
otherwise:
=> Gathering info about the remote git repository...
=> Getting list of all remote branches/tags...
=> Found: docs_theme master resumable_send_recv 0.0.1 0.0.2
=> With docs: 0.0.2
=> Root ref master not found in: 0.0.2
refs #35
2017-11-18 21:28:10 +01:00
Christian Schwarz
d424e800c8
docs: publish.sh check if sphinx-versioning is installed
...
refs #35
2017-11-18 21:16:54 +01:00
Christian Schwarz
903fbff710
Add Docker build image, modularize lazy.sh and adjust build from source instructions
...
refs #35
2017-11-18 19:11:14 +01:00
Christian Schwarz
b4b1bebb5c
rename clone_and_build.sh to lazy.sh
...
refs #35
2017-11-18 17:02:11 +01:00
Christian Schwarz
445a280aa2
build: include docs in release artifacts + use sphinxcontrib-versioning
...
refs #35
2017-11-18 16:28:06 +01:00
Christian Schwarz
2bfcfa5be8
logging: first outlet receives logger error message
...
Abandons stderr special-casing:
* looks weird on shell and IO redirection to same file because of
interleaving of stdout and stderr
* better than a separate dedicated outlet because it does not require
additional configuration
fixes #28
BREAK SEMANTICS CONFIG
2017-11-17 00:25:38 +01:00
Christian Schwarz
8249a5d1b7
docs: tutorial: fix indentation of sample config
2017-11-16 09:14:01 +01:00
Christian Schwarz
476348689a
logging: stdout outlet: include time in output if tty or forced through config
2017-11-15 11:04:34 +01:00
Christian Schwarz
fe40352f8e
docs: link to github
2017-11-12 16:45:11 +01:00
Christian Schwarz
fd123fc6c4
docs: add warning about lack of async TCP outlet
...
refs #26
2017-11-12 16:41:25 +01:00
Christian Schwarz
47726ad877
improve install from source
...
* Idempotent clone_and_build.sh does everything
* Add documentation for how to build in Docker
Had to sacrificy go generate because stringer apparently can't handle
vendor directory used by go dep, fails with error
on go generate rpc/frame_layer.go
refs #37
2017-11-12 16:15:12 +01:00
Christian Schwarz
2cad13f27b
docs: add changelog
2017-11-12 14:12:57 +01:00
Christian Schwarz
b5475921a8
docs: fixup wrong fieldname in source-job
...
3e647c1
2017-11-12 14:11:48 +01:00
Christian Schwarz
a4d28701d9
docs: fix publish.sh script (was not pushing changes to master)
2017-11-12 13:33:34 +01:00
Christian Schwarz
8cc31bd76a
docs: publishing workflow as script
2017-11-11 23:25:12 +01:00
Christian Schwarz
43871a9211
docs: fix minor syntactical bugs
2017-11-11 23:25:12 +01:00
Christian Schwarz
77576164ae
docs: add logo
2017-11-11 23:25:12 +01:00
Christian Schwarz
4c450a640c
docs: logging: outlet type in comment field
2017-11-11 23:25:12 +01:00
Christian Schwarz
36d2cb115a
docs: fixup index site
2017-11-11 23:25:12 +01:00
Christian Schwarz
7ba5c14679
docs: refine tutorial and installation pages
2017-11-11 23:25:12 +01:00
Christian Schwarz
ab7eb47483
docs: adjust pr page to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
707a189144
docs: adjust implementation article to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
4f37dccb76
docs: adjust transports to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
69084fb08f
docs: adjust prune to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
0a77be0ff2
docs: adjust misc to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
597302de3f
docs: adjust map_filter_syntax to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
828c2982f3
docs: adjust logging to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
6f7b8ca1af
docs: adjust jobs documentation to rst + use extlinks extension
2017-11-11 23:25:12 +01:00
Christian Schwarz
e0f40de69f
docs: adjust installation section to rst
2017-11-11 23:25:12 +01:00
Christian Schwarz
2fe7f29d31
docs: index + tutorial rst adjustments
2017-11-11 23:25:12 +01:00
Christian Schwarz
df181108b4
docs: initial port of hugo to sphinx, including rtd theme
2017-11-11 23:25:12 +01:00
Christian Schwarz
c3af267f48
docs: initial empty sphinx docs directory
2017-11-11 23:25:12 +01:00
Christian Schwarz
a15a73e884
docs: move hugo docs to old directory
2017-11-11 23:25:12 +01:00
Christian Schwarz
ff10a71f3a
docs: add warning on replication lag & retention grid.
2017-11-04 13:04:32 +01:00
Christian Schwarz
1f266d02ce
docs: tutorial, ssh+stdinserver: mention PermitRootLogin option
...
fixes #21
2017-10-16 21:58:02 +02:00
Christian Schwarz
4efff312ea
docs: bump theme version
2017-10-16 21:55:38 +02:00
Christian Schwarz
0ed5c01473
docs: add talks & presentation page
...
refs #16
2017-10-05 22:28:43 +02:00
Christian Schwarz
63bc27e6e1
docs: fix new paragraph after zrepl-issue shortcode
2017-10-05 22:16:09 +02:00
Christian Schwarz
e72d274e88
docs: add notice on missing property replication feature
...
fixes #23
2017-10-05 22:13:05 +02:00
Christian Schwarz
72d288567e
mappings: fix aliasing bug with '<' wildcards
...
In contrast to any 'something<' mapping, a '<' mapping cannot be unique
Thus, '<' mappings are thus just an append to target, which is exactly
what we get when trimming empty prefix ''.
Otherwise, given mapping
{ "<": "storage/backups/app-srv" }
Before (clearly a conflict)
zroot => storage/backups/app-srv
storage => storage/backups/app-srv
After:
zroot => storage/backups/app-srv/zroot
storage => storage/backups/app-srv/storage
However, mapping directly with subtree wildcard is still possible, just
not with the root wildcard
{
"<" "storage/backups/app-srv"
"zroot/var/db<": "storage/db_replication/app-srv"
}
fixes #22
2017-10-05 20:10:05 +02:00
Christian Schwarz
83d450b1f2
config: support days (d) and weeks (w) in durations
...
fixes #18
2017-10-05 15:17:37 +02:00
Christian Schwarz
3e647c14c0
config: source job: rename field 'datasets' to 'filesystems'
...
While filesystems is also not the right term (since it excludes ZVOLs),
we want to stay consistent with comments & terminology used in docs.
BREAK CONFIG
fixes #17
2017-10-05 13:39:05 +02:00
Christian Schwarz
b95260f4b5
config: logging: defaults + definition as list
...
* Stdout logger as default logger
* Clearer keyword / value separation
* Allows multiple outlet definitions
BREAK CONFIG
fixes #20
fixes #19
2017-10-05 13:31:16 +02:00
Christian Schwarz
2764c95952
docs: update front page with new features & refs
2017-10-03 16:07:21 +02:00
Christian Schwarz
678b4a6f4b
docs: update implementation overview
2017-10-03 16:06:58 +02:00
Christian Schwarz
79ab43ebca
docs: add docs for logging
2017-10-03 15:41:44 +02:00
Christian Schwarz
a4963cecb7
docs: document job types
...
The documentation describes intended behavior.
Apparently, there are some bugs regarding *patient* tasks.
refs #8
refs #13
2017-10-03 14:21:10 +02:00
Christian Schwarz
e6d08149ef
docs: update 'mappping & filter syntax' + more elaborate sampleconf
2017-10-02 18:29:58 +02:00
Christian Schwarz
ea6f02368b
docs: document pruning policies
...
refs #13
2017-10-02 17:51:28 +02:00
Christian Schwarz
d891b2b119
docs: shortcode for links to the cmd/sampleconf directory
...
fixes #11
2017-10-02 15:12:35 +02:00
Christian Schwarz
5c6c9485a8
docs: tutorial: clarify identity semantics
...
* use only one identity file for all connect instructions
* Explain where the argument to stdinserver comes from.
fixes #14
2017-10-02 14:50:28 +02:00
Christian Schwarz
b4d8c93fae
docs: transport: document ssh+stdinserver
2017-10-02 14:21:22 +02:00
Christian Schwarz
3f394a8960
docs: tutorial: unambiguous hostnames
...
s/backups/backup-srv
s/prod1/app-srv
Also fixes wrong hostname in Analysis section.
fixes #15
2017-10-02 13:51:05 +02:00
Christian Schwarz
164f77d80c
docs: switch back to patched up relref for links to section pages
2017-10-02 12:42:09 +02:00
Christian Schwarz
40920c4ea5
docs: highlight command for watching replication
2017-09-24 11:03:54 +02:00
Christian Schwarz
4e4bf3dbd8
docs: adjust install page regarding changes to logging.
2017-09-24 11:02:35 +02:00
Christian Schwarz
1c3e4e2f07
docs: install: dep ensure
2017-09-24 10:52:29 +02:00
Christian Schwarz
8dabfe08c7
docs: actually, we support bookmarks
2017-09-24 02:20:13 +02:00
Christian Schwarz
5c7d658143
docs: placeholder for logging + links to sampleconf
2017-09-24 02:14:30 +02:00
Christian Schwarz
bfcba7b281
cmd: logging using logrus
2017-09-22 17:01:54 +02:00
Christian Schwarz
af2ff08940
docs: document UNIX sockets & job debugging
2017-09-18 01:01:51 +02:00
Christian Schwarz
3fd9726719
docs: keep up with changed reality.
...
ugly hack with relativ URLs because relref is apparently broken when
linking to section pages (_index.md) except for a few cases...
2017-09-17 16:18:39 +02:00
Christian Schwarz
e5b713ce5b
docs: pattern syntax: more precise terminology
2017-08-11 18:45:39 +02:00
Christian Schwarz
64baa3915f
docs: bump theme
2017-08-11 18:44:53 +02:00
Christian Schwarz
d9064d46f6
docs: improve welcome page
2017-08-09 23:42:50 +02:00
Christian Schwarz
cd9bfbff6c
docs: bump theme version
2017-08-09 23:36:39 +02:00
Christian Schwarz
73d586f305
diff: actually fix publish.sh script
2017-08-09 22:05:29 +02:00
Christian Schwarz
9e9f464de7
docs: remove GH pages repo as submodule, adjust publish.sh
...
Would need to bump zrepl main repo for every publish otherwise...
2017-08-09 21:41:46 +02:00
Christian Schwarz
e2bbd4287e
docs: include GH pages repo as submodule
2017-08-09 16:18:13 +02:00
Christian Schwarz
c1e792dc51
docs: initial commit
2017-08-09 16:13:34 +02:00
