extern/zrepl
1
0
Fork 0
mirror of https://github.com/zrepl/zrepl.git synced 2024-11-21 16:03:32 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
1,132 Commits 48 Branches 23 Tags 3.6 MiB
master
Commit Graph

300 Commits

Author SHA1 Message Date
Christian Schwarz
bbcfb47d28 docs: changelog: more maintainer notices 2019-03-30 18:53:28 +01:00
Christian Schwarz
5324f29693 docs: publish.sh: allow v0.1.0-rc4 2019-03-22 12:02:07 +01:00
Christian Schwarz
b96a287a2f docs: adjust publish.sh script 2019-03-22 11:54:49 +01:00
Christian Schwarz
0ab62f197a Merge branch 'problame/overlapping-dataset-hierarchy-improvements' into 'master' 
closes #153
 2019-03-22 11:02:57 +01:00
Christian Schwarz
e809dbf45e Merge branch 'problame/social_and_donation_shields' 2019-03-21 21:44:29 +01:00
Christian Schwarz
2107483588 docs: jobs: correct root_fs field explanation 2019-03-21 12:51:39 +01:00
Christian Schwarz
c2b05954e9 docs: jobs: explain multi-job & machine considerations 
refs #136
refs #140
 2019-03-21 12:51:07 +01:00
Christian Schwarz
2f2e6e6a00 receiving side: placeholder as simple on|off property 2019-03-20 20:26:30 +01:00
Christian Schwarz
6f7467e8d8 Merge branch 'InsanePrawn-master' into 'master' 2019-03-20 19:45:00 +01:00
Christian Schwarz
f2a6193735 Merge branch 'problame/replication_refactor' 2019-03-20 19:44:15 +01:00
Christian Schwarz
25eeedbce8 docs: link to good_first_issue and docs category 2019-03-19 18:22:15 +01:00
Christian Schwarz
2ba1ff15b7 docs: mention automatic retries 2019-03-19 18:18:41 +01:00
Christian Schwarz
7633c1cdf1 docs: tutorial: s/pull/push 2019-03-18 14:56:32 +01:00
Christian Schwarz
283c2821cd docs: add SnapJob to 0.1 changelog 2019-03-18 14:53:12 +01:00
Christian Schwarz
fb999c8617 docs: drop references to 'main config file' 
were just confusing in the remaining places where they were used

fixes #127
 2019-03-18 14:50:32 +01:00
Christian Schwarz
53dc0c3c5e docs: document existence of zrepl:placeholder property 
fixes #129
 2019-03-18 14:50:32 +01:00
Christian Schwarz
84019238df docs: changelog: remove whitespace & churn 2019-03-18 14:50:32 +01:00
Christian Schwarz
cef865f5ce docs: changelog 0.1: document forgotten bugfixes & features 2019-03-18 14:50:32 +01:00
Christian Schwarz
bdf99f6bb4 docs: document material in dist/ 2019-03-18 12:45:27 +01:00
Christian Schwarz
c9b812570d docs: changelog: document new rpc & retry behavior changes 2019-03-18 12:39:53 +01:00
Christian Schwarz
e62d157aac docs: remove typo at end of changelog 2019-03-18 12:23:39 +01:00
Christian Schwarz
99b3337b1c docs: add shields for license, language, donations + tweeting 2019-03-18 11:13:50 +01:00
Christian Schwarz
dd673bf923 docs: condense snap job overview table row 2019-03-17 21:29:09 +01:00
Christian Schwarz
e8c0d206ea docs: fix nitpicks 2019-03-17 20:54:47 +01:00
Christian Schwarz
17818439a0 Merge branch 'problame/replication_refactor' into InsanePrawn-master 2019-03-17 17:33:51 +01:00
Christian Schwarz
056be1185d dist: add grafana dashboard 
fixes #116
 2019-03-16 16:12:34 +01:00
Christian Schwarz
b0898ec8bc dist: systemd service definition template 
fixes #117
refs #145
 2019-03-16 16:12:34 +01:00
Christian Schwarz
da3ba50a2c Merge remote-tracking branch 'origin/master' into problame/replication_refactor 2019-03-16 14:48:01 +01:00
Christian Schwarz
4ee00091d6 pull job: support manual-only invocation 2019-03-16 14:24:05 +01:00
Christian Schwarz
34052d98d6 docs: move snap job below all replication-related job types 2019-03-15 22:00:29 +01:00
Christian Schwarz
3543fbbb65 docs: clarify language & example of source-side pruning workaround 2019-03-15 22:00:29 +01:00
Christian Schwarz
aff639e87a Merge remote-tracking branch 'origin/master' into InsanePrawn-master 2019-03-15 21:05:20 +01:00
Christian Schwarz
78ec5aa716 Merge remote-tracking branch 'origin/master' into joshsouza-fix_peer_cert_chains 2019-03-15 18:37:11 +01:00
Ximalas
fc311a9fd6 syslog logging: support setting facility in config 2019-03-15 17:55:11 +01:00
Christian Schwarz
a7993d18c6 transport/tls: clarify docs & error message language 2019-03-15 17:17:25 +01:00
Christian Schwarz
5595cff6a6
Merge branch 'master' into fix_peer_cert_chains 2019-03-15 16:34:21 +01:00
Christian Schwarz
796c5ad42d rpc rewrite: control RPCs using gRPC + separate RPC for data transfer 
transport/ssh: update go-netssh to new version
    => supports CloseWrite and Deadlines
    => build: require Go 1.11 (netssh requires it)
 2019-03-13 13:53:48 +01:00
Josh Souza
f724480c7b Add documentation regarding using a certificate chain 2019-01-22 10:09:24 -08:00
Jakob Berger
5c5e8c0baf Documentation changes mostly as requested 2019-01-22 16:46:34 +01:00
Christian Schwarz
1aae7b222f docs: fix confusing description of the role of client identity for sink jobs 2018-12-01 15:19:59 +01:00
Christian Schwarz
3535b251ab freeze Go build dependencies in Gopkg.lock 
* use pseudo-depdencies in build/build.go to convince dep
* update Travis, Dockerfile and Docs
* build.Dockerfile image now contains the Go build dependencies
* => faster builds
* bump pdu file after protoc update

fixes #106
 2018-12-01 14:36:40 +01:00
InsanePrawn
d977796f18 Add SnapJob docs 2018-11-21 16:59:46 +01:00
Christian Schwarz
5e1ea21f85 pruning: add 'Negate' option to KeepRegex and expose it in config 2018-11-16 12:21:54 +01:00
Christian Schwarz
163c2bc533 docs: update requirements.txt 2018-11-16 12:10:58 +01:00
Christian Schwarz
ca0cab0a15 docs/tutorial: fix headlines 2018-10-26 21:52:49 +02:00
JMoVS
ad8be226fd fix small typo 2018-10-22 11:32:37 +02:00
Christian Schwarz
9b3e5c38e2 docs: fix changelog + invocations of wakeup subcommand 2018-10-22 11:27:00 +02:00
Christian Schwarz
7e1c5f5d1f docs: discourage use of ssh+stdinserver transport due to inferior error handling 2018-10-22 11:25:16 +02:00
Christian Schwarz
0b8c19c620 docs/tutorial: switch to push setup & use mutual TLS (2 machines) 2018-10-21 22:20:35 +02:00
Christian Schwarz
a62b475f46 docs/transport/tls: document self-signed certs procedure for 2-machine setup 2018-10-21 22:20:07 +02:00
Christian Schwarz
f13749380d docs: add warnings of changing semantics for manually created snapshots in 0.1 2018-10-13 18:34:37 +02:00
Christian Schwarz
eadb6f823d docs: remove unreleased annotation from changelog for 0.1 2018-10-13 17:35:38 +02:00
Christian Schwarz
e7497ab3d0 LICENSE + docs: adjust copyright 2018-10-13 17:34:05 +02:00
Christian Schwarz
074f989547 Merge branch 'replication_rewrite' (in fact it's a 90% rewrite) 2018-10-13 16:26:23 +02:00
Christian Schwarz
f6cf23779f docs: Remove stale TIP for dry-run zrepl test subcommand. 
Won't make it to 0.1
 2018-10-13 16:22:19 +02:00
Christian Schwarz
92a1a6d2ca docs: fix wrong subcommand for configcheck 2018-10-13 16:22:19 +02:00
Christian Schwarz
63169c51b7 add 'test filesystems' subcommand for testing filesystem filters 2018-10-13 16:22:19 +02:00
Christian Schwarz
1643198713 docs: reflect changes in replication_rewrite branch 2018-10-11 18:03:18 +02:00
Christian Schwarz
88de8ba8bb initial repl policy: get rid of unimplemented options 2018-08-25 22:23:47 +02:00
Christian Schwarz
e6426db8da rpc: bump go-netssh package to address goroutine leak on timeouts 2018-05-22 17:30:29 +02:00
Christian Schwarz
67743d2a66 docs: promote monitoring on front page 2018-04-14 11:30:48 +02:00
Christian Schwarz
386d3b19b2 docs: fix missing slash in sampleconf link text 2018-04-14 11:25:31 +02:00
Christian Schwarz
82ea535692 daemon: expose prometheus in new global.monitoring config section + document it 
refs #67
 2018-04-14 11:24:47 +02:00
Christian Schwarz
0d2f73d728 docs: tutorial: minor refinements 2018-04-01 14:58:12 +02:00
Christian Schwarz
9b803aad2d docs: tutorial: document known_hosts file setup 
fixes #64
 2018-04-01 14:58:04 +02:00
Christian Schwarz
7f89372cfa docs: fix enumeration in ssh+stdinserver docs 2018-03-04 17:20:08 +01:00
Christian Schwarz
26b436463d ssh+stdinserver: connect: dial_timeout 
This  is a follow-up to ccd062e
 2018-03-04 17:19:41 +01:00
Christian Schwarz
7464e967c8 docs: changelog remove senseless headline 2018-02-18 13:35:57 +01:00
Christian Schwarz
921deb43f5 docs: changelog for 0.0.3 2018-02-18 13:35:40 +01:00
Christian Schwarz
3ba3648f0f zfs: use channel as iterator for ZFSList results 
The old approach with ZFSList would keep the two-dimensional array of
lines and their fields in memory (for a short time), which could easily
consume 100s of MiB with > 10000 snapshots / bookmarks (see #34)

fixes #61
 2018-02-18 13:28:46 +01:00
Christian Schwarz
aa92261ea7 bookmarking: prune policy for bookmarks 
refs #34
 2018-02-17 20:48:31 +01:00
Christian Schwarz
94967b596c docs: document changes to ssh+stdinserver transport implementation: ccd062e 2018-02-17 15:16:29 +01:00
Christian Schwarz
a622ef1487 docs: promote test subcommand 2017-12-29 22:53:33 +01:00
Christian Schwarz
8473462adf build: adjust wrong path of zrepl source dir in build.Dockerfile 
was symlinking /zrepl to /go/src/github.com/zrepl/zrepl earlier, forgot
to change that apparently

see 47726ad877

refs #38
 2017-12-29 22:25:48 +01:00
Christian Schwarz
839eccf513 logger.Outlet: WriteEntry must not block 
- make TCPOutlet fully asynchronous, dropping messages if connection is
  not fast enough
- syslog is just fine for now, local anyways
- stdout same thing

refs #26
 2017-12-29 17:21:58 +01:00
Christian Schwarz
9a19615fd4 docs: document bookmarking + remove warning about replication lag 
refs #34
 2017-12-28 13:24:25 +01:00
Christian Schwarz
03ba2bb7c8 docs: move config files + runtime dir doc to new configuration/preface 2017-12-27 18:34:24 +01:00
Christian Schwarz
7ac2821147 docs: small usage section mentioning CLI 2017-12-27 18:34:24 +01:00
Christian Schwarz
e6554b77c0 docs: mention control status command in tutorial 
refs #10
 2017-12-27 18:34:24 +01:00
Christian Schwarz
2716c75ad5 build: target for go library dependencies 
Didn't notice it because vendor/ was already populated on my dev
machine, but did notice it in Docker build.

Docker build now consumes devsetup like regular user, so this should
catch future problems.

Remove remaining curl|shit functionality from lazy.sh (no checkout logic
needed anymore).

refs #35
 2017-11-19 12:34:01 +01:00
Christian Schwarz
e8facfe9fa docs: sphinx-versioning would not build master 
sphinx-versioning only build branches / commits with a 'docs/conf.py',
otherwise:

    => Gathering info about the remote git repository...
    => Getting list of all remote branches/tags...
    => Found: docs_theme master resumable_send_recv 0.0.1 0.0.2
    => With docs: 0.0.2
    => Root ref master not found in: 0.0.2

refs #35
 2017-11-18 21:28:10 +01:00
Christian Schwarz
d424e800c8 docs: publish.sh check if sphinx-versioning is installed 
refs #35
 2017-11-18 21:16:54 +01:00
Christian Schwarz
903fbff710 Add Docker build image, modularize lazy.sh and adjust build from source instructions 
refs #35
 2017-11-18 19:11:14 +01:00
Christian Schwarz
b4b1bebb5c rename clone_and_build.sh to lazy.sh 
refs #35
 2017-11-18 17:02:11 +01:00
Christian Schwarz
445a280aa2 build: include docs in release artifacts + use sphinxcontrib-versioning 
refs #35
 2017-11-18 16:28:06 +01:00
Christian Schwarz
2bfcfa5be8 logging: first outlet receives logger error message 
Abandons stderr special-casing:

* looks weird on shell and IO redirection to same file because of
interleaving of stdout and stderr
* better than a separate dedicated outlet because it does not require
additional configuration

fixes #28

BREAK SEMANTICS CONFIG
 2017-11-17 00:25:38 +01:00
Christian Schwarz
8249a5d1b7 docs: tutorial: fix indentation of sample config 2017-11-16 09:14:01 +01:00
Christian Schwarz
476348689a logging: stdout outlet: include time in output if tty or forced through config 2017-11-15 11:04:34 +01:00
Christian Schwarz
fe40352f8e docs: link to github 2017-11-12 16:45:11 +01:00
Christian Schwarz
fd123fc6c4 docs: add warning about lack of async TCP outlet 
refs #26
 2017-11-12 16:41:25 +01:00
Christian Schwarz
47726ad877 improve install from source 
* Idempotent clone_and_build.sh does everything
* Add documentation for how to build in Docker

Had to sacrificy go generate because stringer apparently can't handle
vendor directory used by go dep, fails with error
on go generate rpc/frame_layer.go

refs #37
 2017-11-12 16:15:12 +01:00
Christian Schwarz
2cad13f27b docs: add changelog 2017-11-12 14:12:57 +01:00
Christian Schwarz
b5475921a8 docs: fixup wrong fieldname in source-job 
3e647c1 config: source job: rename field 'datasets' to 'filesystems'

BREAK CONFIG
 2017-11-12 14:11:48 +01:00
Christian Schwarz
a4d28701d9 docs: fix publish.sh script (was not pushing changes to master) 2017-11-12 13:33:34 +01:00
Christian Schwarz
8cc31bd76a docs: publishing workflow as script 2017-11-11 23:25:12 +01:00
Christian Schwarz
43871a9211 docs: fix minor syntactical bugs 2017-11-11 23:25:12 +01:00
Christian Schwarz
77576164ae docs: add logo 2017-11-11 23:25:12 +01:00
Christian Schwarz
4c450a640c docs: logging: outlet type in comment field 2017-11-11 23:25:12 +01:00
Christian Schwarz
36d2cb115a docs: fixup index site 2017-11-11 23:25:12 +01:00
Christian Schwarz
7ba5c14679 docs: refine tutorial and installation pages 2017-11-11 23:25:12 +01:00
Christian Schwarz
ab7eb47483 docs: adjust pr page to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
707a189144 docs: adjust implementation article to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
4f37dccb76 docs: adjust transports to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
69084fb08f docs: adjust prune to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
0a77be0ff2 docs: adjust misc to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
597302de3f docs: adjust map_filter_syntax to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
828c2982f3 docs: adjust logging to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
6f7b8ca1af docs: adjust jobs documentation to rst + use extlinks extension 2017-11-11 23:25:12 +01:00
Christian Schwarz
e0f40de69f docs: adjust installation section to rst 2017-11-11 23:25:12 +01:00
Christian Schwarz
2fe7f29d31 docs: index + tutorial rst adjustments 2017-11-11 23:25:12 +01:00
Christian Schwarz
df181108b4 docs: initial port of hugo to sphinx, including rtd theme 2017-11-11 23:25:12 +01:00
Christian Schwarz
c3af267f48 docs: initial empty sphinx docs directory 2017-11-11 23:25:12 +01:00
Christian Schwarz
a15a73e884 docs: move hugo docs to old directory 2017-11-11 23:25:12 +01:00
Christian Schwarz
ff10a71f3a docs: add warning on replication lag & retention grid. 2017-11-04 13:04:32 +01:00
Christian Schwarz
1f266d02ce docs: tutorial, ssh+stdinserver: mention PermitRootLogin option 
fixes #21
 2017-10-16 21:58:02 +02:00
Christian Schwarz
4efff312ea docs: bump theme version 2017-10-16 21:55:38 +02:00
Christian Schwarz
0ed5c01473 docs: add talks & presentation page 
refs #16
 2017-10-05 22:28:43 +02:00
Christian Schwarz
63bc27e6e1 docs: fix new paragraph after zrepl-issue shortcode 2017-10-05 22:16:09 +02:00
Christian Schwarz
e72d274e88 docs: add notice on missing property replication feature 
fixes #23
 2017-10-05 22:13:05 +02:00
Christian Schwarz
72d288567e mappings: fix aliasing bug with '<' wildcards 
In contrast to any 'something<' mapping, a '<' mapping cannot be unique
Thus, '<' mappings are thus just an append to target, which is exactly
what we get when trimming empty prefix ''.

Otherwise, given mapping

{ "<": "storage/backups/app-srv" }

Before (clearly a conflict)
zroot     => storage/backups/app-srv
storage   => storage/backups/app-srv
After:
zroot     => storage/backups/app-srv/zroot
storage   => storage/backups/app-srv/storage

However, mapping directly with subtree wildcard is still possible, just
not with the root wildcard

{
    "<"              "storage/backups/app-srv"
    "zroot/var/db<": "storage/db_replication/app-srv"
}

fixes #22
 2017-10-05 20:10:05 +02:00
Christian Schwarz
83d450b1f2 config: support days (d) and weeks (w) in durations 
fixes #18
 2017-10-05 15:17:37 +02:00
Christian Schwarz
3e647c14c0 config: source job: rename field 'datasets' to 'filesystems' 
While filesystems is also not the right term (since it excludes ZVOLs),
we want to stay consistent with comments & terminology used in docs.

BREAK CONFIG

fixes #17
 2017-10-05 13:39:05 +02:00
Christian Schwarz
b95260f4b5 config: logging: defaults + definition as list 
* Stdout logger as default logger
* Clearer keyword / value separation
* Allows multiple outlet definitions

BREAK CONFIG

fixes #20
fixes #19
 2017-10-05 13:31:16 +02:00
Christian Schwarz
2764c95952 docs: update front page with new features & refs 2017-10-03 16:07:21 +02:00
Christian Schwarz
678b4a6f4b docs: update implementation overview 2017-10-03 16:06:58 +02:00
Christian Schwarz
79ab43ebca docs: add docs for logging 2017-10-03 15:41:44 +02:00
Christian Schwarz
a4963cecb7 docs: document job types 
The documentation describes intended behavior.

Apparently, there are some bugs regarding *patient* tasks.

refs #8
refs #13
 2017-10-03 14:21:10 +02:00
Christian Schwarz
e6d08149ef docs: update 'mappping & filter syntax' + more elaborate sampleconf 2017-10-02 18:29:58 +02:00
Christian Schwarz
ea6f02368b docs: document pruning policies 
refs #13
 2017-10-02 17:51:28 +02:00
Christian Schwarz
d891b2b119 docs: shortcode for links to the cmd/sampleconf directory 
fixes #11
 2017-10-02 15:12:35 +02:00
Christian Schwarz
5c6c9485a8 docs: tutorial: clarify identity semantics 
* use only one identity file for all connect instructions
* Explain where the argument to stdinserver comes from.

fixes #14
 2017-10-02 14:50:28 +02:00
Christian Schwarz
b4d8c93fae docs: transport: document ssh+stdinserver 2017-10-02 14:21:22 +02:00
Christian Schwarz
3f394a8960 docs: tutorial: unambiguous hostnames 
s/backups/backup-srv
s/prod1/app-srv

Also fixes wrong hostname in Analysis section.

fixes #15
 2017-10-02 13:51:05 +02:00
Christian Schwarz
164f77d80c docs: switch back to patched up relref for links to section pages 2017-10-02 12:42:09 +02:00
Christian Schwarz
40920c4ea5 docs: highlight command for watching replication 2017-09-24 11:03:54 +02:00
Christian Schwarz
4e4bf3dbd8 docs: adjust install page regarding changes to logging. 2017-09-24 11:02:35 +02:00
Christian Schwarz
1c3e4e2f07 docs: install: dep ensure 2017-09-24 10:52:29 +02:00
Christian Schwarz
8dabfe08c7 docs: actually, we support bookmarks 2017-09-24 02:20:13 +02:00
Christian Schwarz
5c7d658143 docs: placeholder for logging + links to sampleconf 2017-09-24 02:14:30 +02:00
Christian Schwarz
bfcba7b281 cmd: logging using logrus 2017-09-22 17:01:54 +02:00
Christian Schwarz
af2ff08940 docs: document UNIX sockets & job debugging 2017-09-18 01:01:51 +02:00
Christian Schwarz
3fd9726719 docs: keep up with changed reality. 
ugly hack with relativ URLs because relref is apparently broken when
linking to section pages (_index.md) except for a few cases...
 2017-09-17 16:18:39 +02:00
Christian Schwarz
e5b713ce5b docs: pattern syntax: more precise terminology 2017-08-11 18:45:39 +02:00
Christian Schwarz
64baa3915f docs: bump theme 2017-08-11 18:44:53 +02:00
Christian Schwarz
d9064d46f6 docs: improve welcome page 2017-08-09 23:42:50 +02:00
Christian Schwarz
cd9bfbff6c docs: bump theme version 2017-08-09 23:36:39 +02:00
Christian Schwarz
73d586f305 diff: actually fix publish.sh script 2017-08-09 22:05:29 +02:00
Christian Schwarz
9e9f464de7 docs: remove GH pages repo as submodule, adjust publish.sh 
Would need to bump zrepl main repo for every publish otherwise...
 2017-08-09 21:41:46 +02:00
Christian Schwarz
e2bbd4287e docs: include GH pages repo as submodule 2017-08-09 16:18:13 +02:00
Christian Schwarz
c1e792dc51 docs: initial commit 2017-08-09 16:13:34 +02:00