Commit graph

385 commits

Author SHA1 Message Date
ansuz
aa547a7b76 align nodejs http headers with example nginx 2020-11-03 16:48:31 +05:30
ansuz
5cf8ca70e6 don't pin falsey document ids 2020-11-03 16:48:31 +05:30
yflory
c9a3cad78b Fix various issues with restricted pads 2020-11-03 16:48:31 +05:30
yflory
d16cc2472d First prototype of an offline cache 2020-11-03 10:49:13 +01:00
David Benqué
66d434b583 Remove about page from defaults and add XXX for future pages 2020-10-30 14:29:15 +00:00
ansuz
034472d3dd move some implictly global state to env.js 2020-10-27 12:47:15 +05:30
ansuz
0bc2433e02 Merge branch 'accessBug' into staging 2020-10-27 09:09:09 +05:30
ansuz
d95b0954f9 Merge branch 'fix-printing' into staging 2020-10-27 08:13:58 +05:30
ansuz
a2b79d84b8 align nodejs http headers with example nginx 2020-10-27 08:12:23 +05:30
ansuz
f7bd3bdc23 don't pin falsey document ids 2020-10-26 17:34:41 +05:30
yflory
69c26fe8c7 Fix various issues with restricted pads 2020-10-23 15:44:47 +02:00
ansuz
d72e053560 make a note to improve stream timeout error handling 2020-10-22 11:24:58 +05:30
ansuz
67430de7ff Make efforts to avoid closing streams mid-read
1. Close streams when you're done with them
2. Close streams if they seem to have been abandoned
2020-10-22 11:17:03 +05:30
ansuz
fbfb25bf29 lint compliance 2020-10-21 21:29:52 +05:30
ansuz
100b417646 guard against several serverside typeErrors
and warn in cases where they would have occurred
2020-10-21 18:24:54 +05:30
ansuz
e8428a2a73 prevent a case of multiple callbacks 2020-10-21 18:13:10 +05:30
ansuz
fbc9edd795 rename latest admin commands and implement metadata getter/remover 2020-10-20 17:12:26 +05:30
ansuz
488ec93ece allow expert admins to get and clear cached channel indices 2020-10-20 17:07:55 +05:30
ansuz
faa7ebf399 Fix some bugs with integrated eviction
1. implement SET_LAST_EVICTION as an admin command, not a decree
2. expect a return value from Env.evictInactive and expose it via Env.evictionReport
2020-10-15 13:15:39 +05:30
ansuz
ac322c8e82 make the eviction script call back with accumulated statistics 2020-10-14 17:23:53 +05:30
ansuz
a29c5641b8 introduce some artificial delays in the eviction script
...and reduce the margin of error in its bloom filters
2020-10-14 17:22:31 +05:30
ansuz
90f046f896 prevent long-running worker tasks from timing out 2020-10-14 17:18:57 +05:30
ansuz
6e57366b7f address a file descriptor leak 2020-10-13 13:14:39 +05:30
ansuz
a2c0d2165b implement a few more admin decrees 2020-10-13 11:36:30 +05:30
ansuz
abd84665ae lint compliance 2020-10-13 11:00:45 +05:30
ansuz
6ec5171518 add support for changing a few more Env parameters at runtime 2020-10-13 10:56:40 +05:30
ansuz
adb988058d stop logging dev/fresh mode 2020-10-12 19:19:57 +05:30
ansuz
f2ec9cbe33 load premium and customLimits to avoid evicting them even if inactive 2020-10-12 19:18:12 +05:30
ansuz
45b063e378 suppress irrelevant errors from Decrees.load 2020-10-12 19:15:48 +05:30
ansuz
854e4c06ff report lastEviction in an admin INSTANCE_STATUS 2020-10-12 17:52:15 +05:30
ansuz
471a9a33ac take note of a minor error with pin RPCs 2020-10-12 17:51:38 +05:30
ansuz
f86409e1ba take note of which Environment variables should be made mutable via decree 2020-10-12 17:50:40 +05:30
ansuz
6d13a785c6 downgrade a non-critical XXX to a FIXME 2020-10-12 17:42:41 +05:30
ansuz
46ebd7b40b remove unsupported storage configuration parameters 2020-10-12 17:40:21 +05:30
ansuz
369c92c01d initialize Env from server and deduplicate several attributes 2020-10-12 17:39:53 +05:30
ansuz
b5d3a10dc2 guard against possible typeErrors from unvalidated config input 2020-10-09 13:28:13 +05:30
ansuz
964aa2bb79 validate custom limits provided via config at launch 2020-10-08 19:07:00 +05:30
ansuz
f4f803ccd9 reuse Keys.canonicalize to accept any pubkey format 2020-10-08 19:07:00 +05:30
ansuz
914139dbfa lint compliance 2020-10-08 19:07:00 +05:30
yflory
51e1b9b043 Fix custom limit not applied when using a raw edPublic 2020-10-08 19:07:00 +05:30
ansuz
145386e944 suppress an inconsequential error 2020-10-08 19:07:00 +05:30
ansuz
aa35e092f7 update an inaccurate comment 2020-10-08 19:07:00 +05:30
ansuz
928b7e3583 implement GET_LIMITS admin rpc
...and label stored usage limits according to their source
2020-10-08 19:07:00 +05:30
ansuz
5029281a53 implement RM_QUOTA decree 2020-10-08 19:07:00 +05:30
ansuz
af47b2cab1 implement ADD_QUOTA admin decree 2020-10-08 19:07:00 +05:30
ansuz
998f2267c4 ensure the path to the decree file exists before attempting to write to it 2020-10-08 19:07:00 +05:30
ansuz
c2918ac888 fix inverted conditional 2020-10-08 19:07:00 +05:30
ansuz
b62d4387a6 drop support for SET_DEFAULT_STORAGE_LIMIT
it's redundant now that we support persistent admin decrees
and it was never exposed via the UI anyway
2020-10-08 19:07:00 +05:30
ansuz
0c5db31fbc refactor quota logic for external usage 2020-10-08 19:07:00 +05:30
ansuz
bd6234c5bc lint compliance and some notes 2020-10-08 19:07:00 +05:30
ansuz
1781ee2585 implement 'UPDATE_DEFAULT_STORAGE' as a decree 2020-10-08 19:07:00 +05:30
ansuz
7aa7d5978f implement persistence of config changes from admin panel 2020-10-08 19:07:00 +05:30
ansuz
fcfcb3dca6 fix history trim for channels with access lists 2020-10-07 18:44:24 +05:30
ansuz
d509fd8b8f downgrade severity of several XXX notes 2020-10-07 17:09:46 +05:30
ansuz
1ba080739b Merge branch 'X' into staging 2020-10-07 16:28:08 +05:30
ansuz
cfcfe2f65f enable APIs for XLSX export in firefox 2020-10-07 14:47:43 +05:30
yflory
e698241ee9 Merge branch 'historyOO' into staging 2020-10-05 16:41:23 +02:00
ansuz
04d1bc9cd7 archive inactive data in one of the server's workers 2020-09-30 14:45:52 +05:30
ansuz
6ada5fd751 always consider premium accounts to be active 2020-09-29 18:48:23 +05:30
ansuz
5358fab615 more WIP inactive account eviction 2020-09-29 18:04:51 +05:30
ansuz
a9b95865ba Merge branch 'staging' into inactive-accounts 2020-09-28 17:56:30 +05:30
ansuz
d9219f4ecc add a note for later 2020-09-25 14:27:22 +05:30
ansuz
5749b6fd7b add an admin RPC to archive documents 2020-09-25 14:24:26 +05:30
ansuz
d794e0b48f include inactive accounts in the archival script 2020-09-24 19:02:22 +05:30
yflory
25606b92bf lint compliance 2020-09-22 15:27:16 +02:00
yflory
4f147d4fd2 Add support for onlyoffice history 2020-09-18 17:54:57 +02:00
yflory
b31707098a Improve getHistoryRange to support 'toHash' 2020-09-18 12:42:09 +02:00
ansuz
95778cc7c9 respond with ENOENT instead of E_NO_OWNERS when archiving a file that does not exist 2020-07-23 09:30:04 -04:00
ansuz
b04133e6c3 remove some dead code 2020-07-23 09:28:00 -04:00
ansuz
a21c3372c0 avoid a potential type error 2020-07-23 09:27:29 -04:00
yflory
04af753a81 lint compliance 2020-07-01 12:10:12 +02:00
ansuz
03be102ce4 deduplicate some code by reusing the client definition on the server 2020-06-30 14:33:00 -04:00
ansuz
ebcc9a069b add server-side support for the new format of public signing keys 2020-06-25 13:14:26 -04:00
ansuz
48deced859 fix serverside index corruption 2020-06-16 04:08:03 -04:00
ansuz
5b2929a6fc suppress some useless info from some commonly logged errors 2020-05-06 13:50:48 -04:00
ansuz
9f1f01f3b4 disable worker task queueing and address a probable memory leak 2020-05-05 18:06:28 -04:00
ansuz
b0af6b5488 fix an incorrect condition when checking for available server workers
Also, log when the RPC queue has a backlog and when it is drained
2020-05-05 10:53:42 -04:00
ansuz
4037270a23 add a FIXME note for a sketchy implementation in history keeper 2020-05-04 15:46:08 -04:00
ansuz
02347d134a queue signature validation per-channel to ensure correct ordering 2020-04-30 18:18:05 -04:00
ansuz
9975c27e84 increase timeout from one minute to three and decrease the number of parallel jobs per worker 2020-04-29 17:24:38 -04:00
ansuz
488f876ad6 lint compliance 2020-04-29 17:23:29 -04:00
ansuz
d35b015c3f log some info on successful file uploads 2020-04-28 17:12:03 -04:00
ansuz
37d3995ac1 unify format of console output with stored logs 2020-04-28 17:05:15 -04:00
ansuz
8a5d012edf add special error handling for a few special serverside errors 2020-04-28 16:57:52 -04:00
ansuz
8bee95d13d improve error reporting in GET_HISTORY 2020-04-28 16:56:11 -04:00
ansuz
e05891184e fix regression in maxWorkers 2020-04-21 12:23:48 -04:00
ansuz
b56c73be6e delegate more work from getOlderHistory to the worker 2020-04-17 17:01:47 -04:00
ansuz
fd169ff39c close streams after 2 minutes instead of 5
Hopefully this helps to even out our memory and CPU usage.
There's also some improved labels so that IF streams time out
we will know the exact origin of the offending call.
2020-04-17 15:05:48 -04:00
ansuz
bac8ef3c6e lint compliance 2020-04-17 11:43:54 -04:00
ansuz
4e57e390da write tasks inside of workers 2020-04-16 16:37:24 -04:00
ansuz
ba6faca02e make the number of workers configurable 2020-04-16 13:53:45 -04:00
ansuz
0465f31a45 add a FIXME note 2020-04-16 13:02:27 -04:00
ansuz
04ab7f538a recover from worker faults and unify worker types 2020-04-16 13:02:07 -04:00
ansuz
e0a6852b79 correctly serialize an error log 2020-04-16 10:45:18 -04:00
ansuz
9ed82640bf Merge branch 'worker-queue' into staging 2020-04-15 19:32:42 -04:00
ansuz
e8b1fcf710 solve some cases where crashing workers could result in an invalid state for the queue 2020-04-15 13:59:54 -04:00
ansuz
9ed26cfeb0 lint compliance 2020-04-15 12:40:18 -04:00
ansuz
dc0460780f Merge branch 'soon' into staging 2020-04-15 09:44:30 -04:00
ansuz
74567e0cf4 return process memory usage in GET CACHE STATS RPC 2020-04-14 15:53:58 -04:00
Martin Alexander Neumann
e3f42cbc20 Allow config.defaultStorageLimit to be zero bytes 2020-04-11 20:46:09 +02:00