Christian Schwarz
0517b746a1
remove scratchpad
2017-09-30 15:17:23 +02:00
Christian Schwarz
4b23648e6e
remove unused package jobrun
2017-09-30 15:10:54 +02:00
Christian Schwarz
7c86628f3b
logger: json serialization of log level is a string
2017-09-24 19:39:44 +02:00
Christian Schwarz
03955196a9
cmd: config: build identity map
...
not necessary with one cert but good practice
2017-09-24 16:25:41 +02:00
Christian Schwarz
54b391f77c
tcp outlet: add newline after each entry
...
otherwise tools like graylog don't parse it
2017-09-24 16:24:43 +02:00
Christian Schwarz
c1a5b04065
TLS support for TCP logger
2017-09-24 14:34:50 +02:00
Christian Schwarz
0cb5ffb48b
more elaborate README
2017-09-24 13:42:04 +02:00
Christian Schwarz
40920c4ea5
docs: highlight command for watching replication
2017-09-24 11:03:54 +02:00
Christian Schwarz
4e4bf3dbd8
docs: adjust install page regarding changes to logging.
2017-09-24 11:02:35 +02:00
Christian Schwarz
1c3e4e2f07
docs: install: dep ensure
2017-09-24 10:52:29 +02:00
Christian Schwarz
8dabfe08c7
docs: actually, we support bookmarks
2017-09-24 02:20:13 +02:00
Christian Schwarz
a99e82f490
ignore vendor directory
...
dep uses it and we don't vendor anything manually
2017-09-24 02:18:22 +02:00
Christian Schwarz
5c7d658143
docs: placeholder for logging + links to sampleconf
2017-09-24 02:14:30 +02:00
Christian Schwarz
d5df354e64
sampleconf for supported logging
2017-09-24 02:10:29 +02:00
Christian Schwarz
fae34f5927
implement logfmt formatter
2017-09-24 02:09:50 +02:00
Christian Schwarz
c4c38d5b23
add syslog outlet
2017-09-24 02:05:41 +02:00
Christian Schwarz
e0e362c4ff
dump logrus and roll our own logger instead
2017-09-24 00:57:52 +02:00
Christian Schwarz
c31ec8c646
convert more code to structured logging
2017-09-23 17:52:29 +02:00
Christian Schwarz
83edcb3889
experimental TCP hook for logrus
2017-09-23 12:58:13 +02:00
Christian Schwarz
9465b593f9
cmd: configurable logrus formatters
...
We lost the nice context-stack [jobname][taskname][...] at the beginning
of each log line when switching to logrus.
Define some field names that define these contexts.
Write a human-friendly formatter that presents these field names like
the solution we had before logrus.
Write some other formatters for logfmt and json output along the way.
Limit ourselves to stdout logging for now.
2017-09-23 11:24:36 +02:00
Christian Schwarz
3ff9e6d2f7
structured logging for control job
2017-09-23 11:07:08 +02:00
Christian Schwarz
bfcba7b281
cmd: logging using logrus
2017-09-22 17:01:54 +02:00
Christian Schwarz
a459f0a0f6
go-yaml: direct dependency on github repo
2017-09-22 15:29:54 +02:00
Christian Schwarz
eaff4fb963
use the go dep tool to pin dependencies
2017-09-22 14:42:17 +02:00
Christian Schwarz
e87ce3f7cf
cmd: no context + logging for config parsing
2017-09-22 14:13:30 +02:00
Christian Schwarz
af2ff08940
docs: document UNIX sockets & job debugging
2017-09-18 01:01:51 +02:00
Christian Schwarz
458c28e1d0
cmd: UNIX sockets: try to autoremove stale sockets
2017-09-18 00:16:28 +02:00
Christian Schwarz
eaed271a00
cmd: config: remove annoying parser logs
2017-09-18 00:16:28 +02:00
Christian Schwarz
3eaba92025
cmd: introduce control socket & subcommand
...
Move pprof debugging there.
2017-09-18 00:16:28 +02:00
Christian Schwarz
aea62a9d85
cmd: extract listening on a UNIX socket in a private directory into a helper func
2017-09-17 23:41:51 +02:00
Christian Schwarz
1a62d635a6
cmd: test: would always run testCmdGlobalInit
2017-09-17 23:40:40 +02:00
Christian Schwarz
9cd83399d3
cmd: remove global state in main.go
...
* refactoring
* Now supporting default config locations
2017-09-17 18:32:00 +02:00
Christian Schwarz
4ac7e78e2b
cmd: config: was using wrong reference to config
2017-09-17 17:45:02 +02:00
Christian Schwarz
71650819d3
cmd: remove stderrFile option
2017-09-17 17:25:24 +02:00
Christian Schwarz
3fd9726719
docs: keep up with changed reality.
...
ugly hack with relativ URLs because relref is apparently broken when
linking to section pages (_index.md) except for a few cases...
2017-09-17 16:18:39 +02:00
Christian Schwarz
6a05e101cf
WIP daemon:
...
Implement
* pruning on source side
* local job
* test subcommand for doing a dry-run of a prune policy
* use a non-blocking callback from autosnap to trigger the depending
jobs -> avoids races, looks saner in the debug log
2017-09-16 21:13:19 +02:00
Christian Schwarz
b168274048
fixup dmf tests
2017-09-16 20:32:01 +02:00
Christian Schwarz
cd4e09ebb3
cmd: handler: privatise & rename variables
2017-09-16 20:27:08 +02:00
Christian Schwarz
e3ec093d53
cmd: handler: check FilesystemVersionFilter as part of ACL
2017-09-16 20:24:46 +02:00
Christian Schwarz
dc3378e890
cmd: daemon: use closure-local variable when starting job
2017-09-16 20:21:05 +02:00
Christian Schwarz
36b66f6fd7
cmd: mapfilter: support rejecting mappings
...
breaking config
2017-09-16 19:43:02 +02:00
Christian Schwarz
e70b6f3071
WIP: recurring jobs
...
Done:
* implement autosnapper that asserts interval between snapshots
* implement pruner
* job pull: pulling + pruning
* job source: autosnapping + serving
TODO
* job source: pruning
* job local: everything
* fatal errors such as serve that cannot bind socket must be more
visible
* couldn't things that need a snapshotprefix just use a interface
Prefixer() instead? then we could have prefixsnapshotfilter and not
duplicate it every time...
* either go full context.Context or not at all...? just wait because
community climate around it isn't that great and we only need it for
cancellation? roll our own?
2017-09-15 19:35:19 +02:00
Christian Schwarz
c6ca1efaae
cmd: fix typo
2017-09-15 19:34:38 +02:00
Christian Schwarz
0acb2e9ec0
cmd: fix missing error message
2017-09-15 19:32:09 +02:00
Christian Schwarz
5faafbb1b4
cmd: noprune prune policy
2017-09-15 19:32:09 +02:00
Christian Schwarz
e2149de840
cmd: automatic inverting of DatasetMapFilter
2017-09-13 22:55:23 +02:00
Christian Schwarz
1deaa459c8
config: unify job debugging options
2017-09-11 15:45:10 +02:00
Christian Schwarz
93a58a36bf
util: add PrefixLogger
2017-09-11 15:37:45 +02:00
Christian Schwarz
d76d3db0b3
handler: remove unused SinkMappingFunc
2017-09-11 13:51:19 +02:00
Christian Schwarz
0a53b2415f
signal handling for source job
2017-09-11 13:50:35 +02:00
