Commit Graph

737 Commits

Author SHA1 Message Date
Christian Schwarz
b95e983d0d bump go-streamrpc to 0.2, cleanup logging
logging should be user-friendly in INFO mode
2018-09-02 15:45:18 -07:00
Anton Schirg
f387e23214 fix: at least two snapshots were needed to start replication 2018-08-30 19:20:18 +02:00
Anton Schirg
32391adf4f build pruner in factory and check prune rules 2018-08-30 19:20:14 +02:00
Anton Schirg
c0a3e1f121 wrap error in buildJob with job name 2018-08-30 17:40:02 +02:00
Anton Schirg
5442d8e7d5 status: calculate max fs name length 2018-08-30 15:21:07 +02:00
Anton Schirg
48feaff054 fix some status display alignment 2018-08-30 15:21:07 +02:00
Christian Schwarz
acd2a68cfb fix build: bump yaml-config 2018-08-30 13:40:28 +02:00
Christian Schwarz
1690339440 colorized stdout logger if stdout is tty 2018-08-30 13:33:28 +02:00
Anton Schirg
b5957aca37 do dry runs in planning stage to estimate size of all sends 2018-08-30 12:59:16 +02:00
Anton Schirg
47d8a5a7cd status: only show active not all versions of active filesystem 2018-08-30 12:58:13 +02:00
Anton Schirg
583773025f nicer progress bar 2018-08-30 12:58:13 +02:00
Anton Schirg
98f3f3dfd8 show expected size of current send
Needs to be changed to send sizes for all planned steps
2018-08-30 12:58:13 +02:00
Anton Schirg
6ca11a7391 byte counter for status 2018-08-30 12:54:30 +02:00
Anton Schirg
42056f7a32 status: do not show problem field when none exists 2018-08-30 12:54:30 +02:00
Anton Schirg
b2f01e454f bug in ZFSListFilesystemVersions? 2018-08-30 12:54:30 +02:00
Anton Schirg
6cedd0a2e8 add status command 2018-08-30 12:54:30 +02:00
Anton Schirg
e495824834 move wakeup to client package and extract http client 2018-08-30 12:53:21 +02:00
Christian Schwarz
7dd49b835a finish pruning implementation in push job 2018-08-30 11:52:05 +02:00
Christian Schwarz
22ca80eb7e remote snapshot destruction & replication status zfs property 2018-08-30 11:51:47 +02:00
Christian Schwarz
12dd240b5f fixup pruner 2018-08-30 11:49:06 +02:00
Christian Schwarz
d684302864 pruning: fix tests + implement 'not_replicated' and 'keep_regex' keep rule
tests expected that a KeepRule returns a *keep* list whereas it
actually returns a *destroy* list.
2018-08-30 11:46:47 +02:00
Christian Schwarz
a2aa8e7bd7 finish pruner implementation 2018-08-29 19:00:45 +02:00
Christian Schwarz
0de17fd051 move cmd/pruning to pruning, as it's independent of the command implementation 2018-08-29 14:55:59 +02:00
Christian Schwarz
fb0a8d8b40 gofmt cmd/ 2018-08-29 14:54:29 +02:00
Christian Schwarz
c69ebd3806 WIP rewrite the daemon
cmd subdir does not build on purpose, it's only left in tree to grab old
code and move it to github.com/zrepl/zrepl/daemon
2018-08-27 22:22:44 +02:00
Christian Schwarz
df6e1bc64d privatize pprofServer 2018-08-27 19:13:35 +02:00
Christian Schwarz
89dc267780 start implementing new daemon in package daemon 2018-08-27 19:10:55 +02:00
Anton Schirg
c7237cb09d test keep last n pruning 2018-08-27 16:24:19 +02:00
Anton Schirg
4073c5dfb0 change pruning testing function to use set compare on names 2018-08-27 16:17:39 +02:00
Anton Schirg
c2b04d10c5 wip floocode backup 2018-08-27 15:22:32 +02:00
Anton Schirg
b0d17803f0 job source with new config 2018-08-27 15:19:56 +02:00
Anton Schirg
16e1396261 connecters with new config 2018-08-27 15:19:17 +02:00
Anton Schirg
b955d308d9 add to config 2018-08-27 15:18:08 +02:00
Christian Schwarz
ecd9db4ac6 start pruning reimplementation in cmd/pruning subpackage 2018-08-27 15:12:00 +02:00
Anton Schirg
b4ea5f56b2 ssh config 2018-08-26 23:46:59 +02:00
Anton Schirg
5e51595d7f local job config 2018-08-26 23:29:57 +02:00
Anton Schirg
48a08e4f4d config for pull and source 2018-08-26 23:13:16 +02:00
Anton Schirg
e2bf557d17 use optional and default feature of yaml-config 2018-08-26 22:06:47 +02:00
Anton Schirg
fbb8a25320 add prometheus monitoring to config 2018-08-26 22:06:47 +02:00
Anton Schirg
add1b69809 move retentiongrid to own package 2018-08-26 22:06:47 +02:00
Anton Schirg
cd9a428841 rename variable 2018-08-26 22:06:47 +02:00
Anton Schirg
4ec5e23457 set channel buffer to prevent leaking goroutine 2018-08-26 22:06:47 +02:00
Anton Schirg
13dc63bd23 build logger from new config 2018-08-26 22:06:47 +02:00
Anton Schirg
38bb78b642 WIP new config format 2018-08-26 22:03:57 +02:00
Christian Schwarz
6425c26b1b start refactoring: move daemon into subpackage 2018-08-26 21:58:58 +02:00
Christian Schwarz
428339e1ad move version info to separate package 2018-08-26 21:58:20 +02:00
Christian Schwarz
ee5445777d logging format 'human': continue printing prefixed fields if some are missing 2018-08-26 19:13:09 +02:00
Christian Schwarz
a0f72b585b remove JobStatus, Task abstraction and 'control status' subcommand
Control status will be replaced by job-specific output at some point.

Task was not useful anymore with state machine, may reintroduce
something similar at a later point, but consider alternatives:

- opentracing.io
- embedding everything in ctx
	- activity stack would work easily
	- log entries via proxy logger.Logger object
- progress reporting should be in status reports of individial jobs
2018-08-26 19:08:30 +02:00
Christian Schwarz
7ff72fb6d9 replication: document most important aspects of Endpoint interface 2018-08-26 15:12:43 +02:00
Christian Schwarz
f6be5b776b cmd: clean up usage of contextKeyLog through getter and setter functions 2018-08-26 14:58:57 +02:00