Commit Graph

63 Commits

Author SHA1 Message Date
Christian Schwarz
5bc6d460cf WIP: sink & pull implementation 2017-05-13 15:25:09 +02:00
Christian Schwarz
b2de658270 util: fix package name of chunking 2017-05-13 15:25:09 +02:00
Christian Schwarz
6524cfce0c create file if it doesn't exist 2017-05-13 15:25:09 +02:00
Christian Schwarz
dd6dd60e98 Simplify "fork then io.Reader" abstractions 2017-05-13 15:23:37 +02:00
Christian Schwarz
54778c0374 zfs: remove erronous output from ForkReader 2017-05-13 15:23:28 +02:00
Christian Schwarz
c762502f6e zfs: implement DatasetPath top down walk 2017-05-13 15:23:28 +02:00
Christian Schwarz
2407556f15 main: implement request handler. 2017-05-07 12:28:03 +02:00
Christian Schwarz
996be3704d zfs: implement ZFSListFilesystemExists() 2017-05-07 12:26:41 +02:00
Christian Schwarz
6a420e872e zfs: implement ZFSSet 2017-05-07 12:23:12 +02:00
Christian Schwarz
d37bdc3d7a zfs: implement ZFSRecv 2017-05-07 12:22:57 +02:00
Christian Schwarz
030bd7affe zfs: implement ZFSSend 2017-05-07 12:20:56 +02:00
Christian Schwarz
1a92717894 zfs: FilesytemDiff: len(IncrementalPath) < 2 means same most recent version
bonus: style + typo fixes
2017-05-07 12:20:56 +02:00
Christian Schwarz
d0c0e2510b zfs: FilesystemDiff: support empty left list = no common ancestor 2017-05-07 12:20:56 +02:00
Christian Schwarz
cd8796aed4 rpc: Initial|IncrementalTransferRequest transfer zfs data structures 2017-05-07 12:20:56 +02:00
Christian Schwarz
fa97d3d98a config: parse InitialReplPolicy with default to most_recent 2017-05-07 12:00:34 +02:00
Christian Schwarz
c71be910f9 rpc: fix incremental transfer request handling 2017-05-07 11:53:47 +02:00
Christian Schwarz
44d20ac256 zfs: ZFSListMapping fix broken logic 2017-05-06 23:45:33 +02:00
Christian Schwarz
cb37470010 sshbytestream: exited command always returns io.EOF 2017-05-06 23:44:59 +02:00
Christian Schwarz
82beea94d5 rpc: missing response header for InitialTransferRequest 2017-05-06 23:43:55 +02:00
Christian Schwarz
61c263b91d chunking: rewrite to handle EOF events correctly
bonus: some tests asserting the chunking protocol is adhered to
2017-05-06 23:41:51 +02:00
Christian Schwarz
9b871fb7c0 rpc: more detailed errors 2017-05-06 10:58:23 +02:00
Christian Schwarz
aa696dd0ce zfs: use createtxg and guid properties for FilesystemVersion 2017-05-06 10:58:01 +02:00
Christian Schwarz
22454738af application-wide logging through Logger interface 2017-05-03 18:32:11 +02:00
Christian Schwarz
1e7b29bdc5 license: change attribution 2017-05-03 18:28:04 +02:00
Christian Schwarz
55463e5f26 jobrun: per-job logger 2017-05-03 18:28:04 +02:00
Christian Schwarz
3b6d79ec67 jobrun: log through abstract logger interface instead of stderr 2017-05-03 18:27:55 +02:00
Christian Schwarz
77f749112c main: remove global handler and unused structs 2017-05-03 18:27:23 +02:00
Christian Schwarz
f005ce318d Purge model package, not really used anyways. 2017-05-03 17:26:45 +02:00
Christian Schwarz
514f9aa123 rpc: hex-ints for RequestType definitions 2017-05-03 17:13:08 +02:00
Christian Schwarz
b8e7ddd61f rpc fixup msising directions filesystemrequest 2017-05-03 17:12:31 +02:00
Christian Schwarz
43f67d2b7c rpc: add FilesystemVersionsRequest 2017-05-03 17:12:15 +02:00
Christian Schwarz
f46fb2f34f zfs: filesystem versioning and diffing 2017-05-01 20:35:49 +02:00
Christian Schwarz
644d3dd06b zfs: public ZFSList() function + consolidation of mapping code 2017-05-01 20:35:04 +02:00
Christian Schwarz
28f0b90c25 zfs: check for forbidden dataset path characters 2017-05-01 20:09:35 +02:00
Christian Schwarz
301be177ea config: fix broken parsing of direct mapping
Would only parse wildcard ('|') DirectMapping but no specific direct
mappings.
2017-05-01 20:08:20 +02:00
Christian Schwarz
b87829817a rpc: bytestream: listen: filesystems request: reply with header 2017-04-30 23:47:12 +02:00
Christian Schwarz
8bdcdd5ec6 rpc: bytestream: listen: consistent error handling 2017-04-30 23:47:12 +02:00
Christian Schwarz
ec4284f80c sshbytestream: fix semantics when ssh connection dies
in the Wait()ing goroutine, we create an instance of our own error
containing WaitErr + stderr excerpt. Only if the remote command exits
non-zero.

io.EOF is the error we get as soon as the other end of the pipe
(the ssh command) has died.
=> wait for it in the ReadWriter methods.
2017-04-30 23:47:12 +02:00
Christian Schwarz
226935ddea jobrun: error handling through notification channel 2017-04-30 23:47:12 +02:00
Christian Schwarz
9fdd1ea909 rpc: fix panic when parsing filesystem response 2017-04-30 23:47:12 +02:00
Christian Schwarz
08370689c8 rpc: implement respondWithError 2017-04-30 23:47:11 +02:00
Christian Schwarz
6da2deb96e config: fix mapping parser 2017-04-30 23:47:11 +02:00
Christian Schwarz
3e0c758d7f config: PushACLs, sinks are also just ClientMappings & LOCAL_TRANSPORT_IDENTITY 2017-04-30 23:47:11 +02:00
Christian Schwarz
ac5a911c64 zfs: glob mapping for complete wildcard ("*") 2017-04-30 23:47:11 +02:00
Christian Schwarz
2e6dc26993 sshbytestream: IdentityFile and custom SSHCommand. 2017-04-30 23:46:59 +02:00
Christian Schwarz
b9361f275a Lift chunker up to recent sshbytestream changes. 2017-04-30 16:09:41 +02:00
Christian Schwarz
c7927b27c1 Log to stderr. 2017-04-30 16:08:22 +02:00
Christian Schwarz
2d57e15936 Change transport format in zrepl config & parse it. 2017-04-29 20:10:09 +02:00
Christian Schwarz
fd24096137 Decouple model and sshbytestream. 2017-04-29 20:09:09 +02:00
Christian Schwarz
9edc2005ea config; pointer to pools for pull and push jobs 2017-04-29 19:07:47 +02:00