Commit Graph

26 Commits

Author SHA1 Message Date
f3433df617 cmd/sampleconf/zrep.yml: remove it, it's from the stone ages 2017-10-05 21:48:18 +02:00
3e647c14c0 config: source job: rename field 'datasets' to 'filesystems'
While filesystems is also not the right term (since it excludes ZVOLs),
we want to stay consistent with comments & terminology used in docs.

BREAK CONFIG

fixes #17
2017-10-05 13:39:05 +02:00
b95260f4b5 config: logging: defaults + definition as list
* Stdout logger as default logger
* Clearer keyword / value separation
* Allows multiple outlet definitions

BREAK CONFIG

fixes #20
fixes #19
2017-10-05 13:31:16 +02:00
e6d08149ef docs: update 'mappping & filter syntax' + more elaborate sampleconf 2017-10-02 18:29:58 +02:00
c1a5b04065 TLS support for TCP logger 2017-09-24 14:34:50 +02:00
d5df354e64 sampleconf for supported logging 2017-09-24 02:10:29 +02:00
36b66f6fd7 cmd: mapfilter: support rejecting mappings
breaking config
2017-09-16 19:43:02 +02:00
e70b6f3071 WIP: recurring jobs
Done:

* implement autosnapper that asserts interval between snapshots
* implement pruner

* job pull: pulling + pruning
* job source: autosnapping + serving

TODO

* job source: pruning
* job local: everything
* fatal errors such as serve that cannot bind socket must be more
visible
* couldn't things that need a snapshotprefix just use a interface
Prefixer() instead? then we could have prefixsnapshotfilter and not
duplicate it every time...
* either go full context.Context or not at all...? just wait because
community climate around it isn't that great and we only need it for
cancellation? roll our own?
2017-09-15 19:35:19 +02:00
1deaa459c8 config: unify job debugging options 2017-09-11 15:45:10 +02:00
f3689563b5 config: restructure in 'jobs' and 'global' section 2017-09-11 13:43:18 +02:00
8bf3516003 Extend sampleconf, explain what stdinserver serve type does. 2017-09-10 16:01:45 +02:00
b2f3645bfd alternative prototype for new config format 2017-09-07 11:18:06 +02:00
98fc59dbd5 prototype new config format 2017-09-06 12:46:33 +02:00
70258fbada cmd: add 'test' subcommand
configbreak
2017-09-02 12:30:03 +02:00
e048386cd5 cmd: add repeat config option to Prune 2017-09-02 11:08:24 +02:00
2ce07c9342 rework filters & mappings
config defines a single datastructure that can act both as a Map and as a Filter
(DatasetMapFilter)

Cleanup wildcard syntax along the way (also changes semantics).
2017-08-06 16:21:54 +02:00
d1999fc17c Remove months as a possible time interval unit as it is too volatile.
Thanks to @erdgeist for pointing that out.

refs #2
2017-07-09 00:38:16 +02:00
2c13fbe6ec config: rename 'pools' section to 'remotes' 2017-07-08 12:08:34 +02:00
e951beaef5 Simplify CLI by requiring explicit job names.
Job names are derived from job type + user-defined name in config file
CLI now has subcommands corresponding 1:1 to the config file sections:

        push,pull,autosnap,prune

A subcommand always expects a job name, thus executes exactly one job.

Dict-style syntax also used for PullACL and Sink sections.

jobrun package is currently only used for autosnap, all others need to
be invoked repeatedly via external tool.
Plan is to re-integrate jobrun in an explicit daemon-mode (subcommand).
2017-07-08 11:13:50 +02:00
655b3ab55f implement automatic snapshotting feature 2017-07-02 00:02:33 +02:00
8c8a6ee905 implement snapshot pruning feature 2017-07-02 00:02:33 +02:00
af2aa9dfe1 cmd/jobrun: repeat strategies as part of jobrun 2017-07-01 23:19:25 +02:00
35dcfc234e Implement push support.
Pushing is achieved by inverting the roles on the established
connection, i.e. the client tells the server what data it should pull
from the client (PullMeRequest).

Role inversion is achieved by moving the server loop to the serverLoop
function of ByteStreamRPC, which can be called from both the Listen()
function (server-side) and the PullMeRequest() client-side function.

A donwside of this PullMe approach is that the replication policies
become part of the rpc, because the puller must follow the policy.
2017-05-20 18:17:08 +02:00
3e0c758d7f config: PushACLs, sinks are also just ClientMappings & LOCAL_TRANSPORT_IDENTITY 2017-04-30 23:47:11 +02:00
2d57e15936 Change transport format in zrepl config & parse it. 2017-04-29 20:10:09 +02:00
00231ecb73 Implement config parser. 2017-04-26 19:57:40 +02:00