Commit graph

50 commits

Author SHA1 Message Date
ansuz
ebcb6b2ab0 log child process ids in the event of an RPC timeout 2022-02-03 15:11:26 +05:30
ansuz
7c7acbeae6 delegate block validation to workers 2021-06-28 15:07:48 +05:30
ansuz
caece0123e archive pin logs instead of removing them outright 2021-06-25 20:22:16 +05:30
ansuz
729d51fb9b update block storage APIs 2021-04-29 13:32:19 +05:30
yflory
7971a6d267 Major broadcast refactoring 2021-03-16 17:00:23 +01:00
Dmitry Borodaenko
6cd2131f27 Pass archivePath to Store.create always 2021-03-03 11:31:08 -08:00
yflory
f5908e5f57 Fix history range 2021-02-18 16:28:40 +01:00
yflory
ea4c529e39 Remove offset code 2021-02-09 15:29:34 +01:00
yflory
0fc8bfde4a Use new server format for history keeper time 2021-01-20 15:06:43 +01:00
ansuz
fed04a025c display size of uploaded files upon completion 2020-12-23 17:21:06 +05:30
ansuz
93d56e5e3d profile worker commands by total running time in seconds 2020-12-08 10:44:46 +05:30
ansuz
93c807524f update offset debugging info 2020-12-08 10:24:09 +05:30
ansuz
466072d03b read files starting from the oldest known point of relevance when computing indices 2020-11-26 12:15:02 +05:30
ansuz
faa84bcbd7 describe arguments for 'completeUpload' RPC 2020-11-19 12:16:02 +05:30
ansuz
e185008846 complete uploads in child processes
also fix a nasty race condition for unowned file uploads
2020-11-18 18:26:21 +05:30
ansuz
b155f7b291 increase child-process timeout and improve error handling 2020-11-17 16:09:47 +05:30
ansuz
fbfb25bf29 lint compliance 2020-10-21 21:29:52 +05:30
ansuz
100b417646 guard against several serverside typeErrors
and warn in cases where they would have occurred
2020-10-21 18:24:54 +05:30
ansuz
90f046f896 prevent long-running worker tasks from timing out 2020-10-14 17:18:57 +05:30
ansuz
d509fd8b8f downgrade severity of several XXX notes 2020-10-07 17:09:46 +05:30
yflory
e698241ee9 Merge branch 'historyOO' into staging 2020-10-05 16:41:23 +02:00
ansuz
04d1bc9cd7 archive inactive data in one of the server's workers 2020-09-30 14:45:52 +05:30
yflory
25606b92bf lint compliance 2020-09-22 15:27:16 +02:00
yflory
4f147d4fd2 Add support for onlyoffice history 2020-09-18 17:54:57 +02:00
yflory
b31707098a Improve getHistoryRange to support 'toHash' 2020-09-18 12:42:09 +02:00
ansuz
9f1f01f3b4 disable worker task queueing and address a probable memory leak 2020-05-05 18:06:28 -04:00
ansuz
b0af6b5488 fix an incorrect condition when checking for available server workers
Also, log when the RPC queue has a backlog and when it is drained
2020-05-05 10:53:42 -04:00
ansuz
9975c27e84 increase timeout from one minute to three and decrease the number of parallel jobs per worker 2020-04-29 17:24:38 -04:00
ansuz
e05891184e fix regression in maxWorkers 2020-04-21 12:23:48 -04:00
ansuz
b56c73be6e delegate more work from getOlderHistory to the worker 2020-04-17 17:01:47 -04:00
ansuz
4e57e390da write tasks inside of workers 2020-04-16 16:37:24 -04:00
ansuz
ba6faca02e make the number of workers configurable 2020-04-16 13:53:45 -04:00
ansuz
04ab7f538a recover from worker faults and unify worker types 2020-04-16 13:02:07 -04:00
ansuz
e8b1fcf710 solve some cases where crashing workers could result in an invalid state for the queue 2020-04-15 13:59:54 -04:00
ansuz
c53675c9d5 WIP worker rpc call queue 2020-04-06 10:28:26 -04:00
ansuz
ed5d97f899 WIP history-keeper fixes 2020-04-01 11:48:16 -04:00
ansuz
77961e3954 trim lookup tables for channels without checkpoints 2020-03-30 18:03:37 -04:00
ansuz
cbd3547814 remove log statements 2020-03-27 17:20:57 -04:00
ansuz
9058a59555 reassign db tasks if the responsible worker fails 2020-03-27 17:17:42 -04:00
ansuz
172823c954 lint compliance 2020-03-27 16:59:41 -04:00
ansuz
3f86b6141e rename worker processes 2020-03-27 15:14:45 -04:00
ansuz
d8a88cb4ca run expiration tasks in a worker instead of the main process 2020-03-27 14:38:58 -04:00
ansuz
9dbd32758a improve worker logging and move blob deletion to worker processes as well 2020-03-27 13:38:27 -04:00
ansuz
14feef1757 calculate pin list checksums in a worker 2020-03-25 18:37:42 -04:00
ansuz
70a0d4efb4 move more database reads into the database worker 2020-03-25 17:43:57 -04:00
ansuz
4ba36a9173 load user pins in the database worker 2020-03-25 11:39:14 -04:00
ansuz
50e8893b24 move the 'getOlderHistory' call into the database worker 2020-03-25 10:54:29 -04:00
ansuz
471e374533 compute metadata in the same child process that builds indexes 2020-03-24 17:43:15 -04:00
ansuz
479b76f848 lint compliance 2020-03-24 17:40:07 -04:00
ansuz
40251948d4 check authenticated rpc signatures in separate threads 2020-03-24 14:31:40 -04:00