Commit graph

9460 commits

Author SHA1 Message Date
Hongbo Wu
702bd6c3c6 async bulk action on item count > 100 and create batch jobs 2024-02-01 17:44:30 +08:00
Jackson Harper
7f4f7c6a80
Merge pull request #3479 from omnivore-app/fix/queue-processor-lifecycle-hook
Implement a lifecycle hook for queue processor so it can shut down gracefully
2024-02-01 17:01:11 +08:00
Hongbo Wu
8ac696e87d
Merge pull request #3480 from omnivore-app/fix/mark-read-action
fix: update reading progress in cache when mark as read action was triggered by a rule
2024-02-01 16:56:21 +08:00
Jackson Harper
fe5d986e91
Merge pull request #3478 from omnivore-app/fix/reduce-reading-progress
Use the DB stored reading progress when calculating maxes
2024-02-01 16:52:46 +08:00
Hongbo Wu
252443f1e4 fix: update reading progress in cache when mark as read action was triggered in a rule 2024-02-01 16:45:08 +08:00
Jackson Harper
0e9e331e18 Implement a lifecycle hook for queue processor so it can shut down gracefully 2024-02-01 16:43:57 +08:00
Jackson Harper
3feef7ca66 Use the DB stored reading progress when calculating maxes 2024-02-01 16:23:21 +08:00
Jackson Harper
f03b7182b3
Merge pull request #3460 from omnivore-app/feat/reading-progress-write-behind
Write behind cache for reading progress
2024-02-01 14:43:45 +08:00
Hongbo Wu
cf27174c70
Merge pull request #3476 from omnivore-app/fix/update-db-job
fix: update-label job uses too much cpu
2024-02-01 13:22:58 +08:00
Hongbo Wu
abaf726044 revert the change of priority 2024-02-01 13:22:06 +08:00
Hongbo Wu
19fe60d27a change the update-db job priority to 5 and use exponential backoff strategy for retrying 2024-02-01 13:14:01 +08:00
Hongbo Wu
e13c418389 remove the inner join with highlights table in the sql of update-label job 2024-02-01 13:09:50 +08:00
Jackson Harper
a7371fe7a1
Merge pull request #3475 from omnivore-app/fix/ios-subscription-add-label
fix: ios add labels not working in subscription settings
2024-02-01 11:31:49 +08:00
Jackson Harper
02c28be403 reduce unction is no longer async 2024-02-01 11:24:13 +08:00
Hongbo Wu
177a3c3f90 fix: ios add labels not working in subscription settings
* creating wrong filter in the rule
2024-02-01 11:09:20 +08:00
Jackson Harper
792f13edfc Remove async from non-async function 2024-02-01 10:49:48 +08:00
Jackson Harper
1b44cb860b Function for cron jobs dont include queue in the read position metrics since its not part of that queue 2024-02-01 10:33:51 +08:00
Jackson Harper
7d6645b87a Rebase 2024-02-01 10:02:38 +08:00
Jackson Harper
ddf7d590fd Copy params so no extra params are sent 2024-02-01 09:59:42 +08:00
Jackson Harper
570b7a4b78 Use a set in redis and push items to the set
This lets us grab all available items, apply them, and then
remove them from the set. Once completed the items that were
applied can be removed from the set, if any new items were
added during that time they wont be effected.
2024-02-01 09:59:42 +08:00
Jackson Harper
38a90e3987 Revert web change 2024-02-01 09:59:42 +08:00
Jackson Harper
3ecbd3f434 Need to force this test to overwrite the cached value 2024-02-01 09:59:42 +08:00
Jackson Harper
0e37bfa03d We need to update readAt because that isnt resolved from the cache 2024-02-01 09:59:42 +08:00
Jackson Harper
c47a720fe4 Do not cache on write, so the most updated item is always available on read
This is mostly an issue on tests where all the queries can be run
in a single process, but if we cache on write, it means the next
read will just have the cached value, instead of the calculated
maximum value.
2024-02-01 09:59:42 +08:00
Jackson Harper
bdf01ddaab Clear cache on force, return updated read position values 2024-02-01 09:59:42 +08:00
Jackson Harper
97efbe4487 Force read position writes when user explicitly sets it 2024-02-01 09:59:42 +08:00
Jackson Harper
a060aaf496 Make reading position parsing safer 2024-02-01 09:59:42 +08:00
Jackson Harper
9dc070243a Revert temp 2024-02-01 09:59:41 +08:00
Jackson Harper
d8ea4ff1c5 Add reading position messages to exported metrics for queue processor 2024-02-01 09:59:41 +08:00
Jackson Harper
7bb3718a8f Add job to sync read position data 2024-02-01 09:59:41 +08:00
Jackson Harper
a40f5bed55 Create a service for interacting with cached read positions 2024-02-01 09:59:41 +08:00
Jackson Harper
fbfa934479 Write behind reading progress as a list that can be reduced at commit or read time 2024-02-01 09:59:39 +08:00
Jackson Harper
c2327781e1 Remove empty ctor 2024-02-01 09:57:11 +08:00
Jackson Harper
86c80d991f Write behing cache for reading progress 2024-02-01 09:57:11 +08:00
Jackson Harper
7289480ca5
Merge pull request #3467 from odebroqueville/main
Add Rules menu item to dropdown menu
2024-02-01 09:42:06 +08:00
Jackson Harper
95bdc893d9
Merge pull request #3468 from kawamataryo/main
Prevent add label if press enter in composition session
2024-02-01 09:41:27 +08:00
Hongbo Wu
c3276fdaf1
Merge pull request #3466 from omnivore-app/fix/rewrite-trigger-functions-in-db
create a job for db trigger
2024-01-31 19:47:45 +08:00
Hongbo Wu
6d5ce451ac fix bulk action 2024-01-31 19:24:18 +08:00
Hongbo Wu
1b8111b907 wait until all jobs are done in test 2024-01-31 19:10:57 +08:00
Hongbo Wu
5e883cb2ba running worker in the test 2024-01-31 17:45:49 +08:00
Hongbo Wu
cf898299e4 some lint 2024-01-31 14:18:34 +08:00
Hongbo Wu
5646413b59 add a job for updating highlight annotations in library_item 2024-01-31 14:15:33 +08:00
Hongbo Wu
43855247b8 update bulk action to add labels 2024-01-31 13:56:56 +08:00
Hongbo Wu
5ed35bbeff create a job for update labels in library item 2024-01-31 13:32:37 +08:00
kawamataryo
6d484884da Prevent add label if press enter in composition session 2024-01-31 13:38:00 +09:00
Olivier de Broqueville
cd42ce56d8 Add Rules menu item to dropdown menu 2024-01-30 19:15:17 +01:00
Hongbo Wu
ddddf8234e create a job for db trigger 2024-01-30 23:53:05 +08:00
Jackson Harper
c8b687fa63
Merge pull request #3462 from omnivore-app/fix/rule-job-priority
fix: assign the rule job with priority 1 and do not retry
2024-01-30 18:42:51 +08:00
Hongbo Wu
36d2c21466 remove thumbnail job on complete or failure 2024-01-30 18:24:48 +08:00
Hongbo Wu
2eedba1522 fix: assign the rule job with priority 1 and do not retry 2024-01-30 18:14:34 +08:00