9294 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Jackson Harper	eac93e6cb6	Reduce logging	2024-01-22 12:02:35 +08:00
Jackson Harper	db8284dc0b	Wait until backend queue is ready before putting jobs into it	2024-01-22 11:31:46 +08:00
Jackson Harper	f7b17cb93f	Only create queue object once in queue processor	2024-01-22 11:27:13 +08:00
Jackson Harper	0f78419e1a	Remove some debug	2024-01-22 11:26:59 +08:00
Jackson Harper	33c994ad5c	Remove RSS feed task handler url as this handled with jobs now	2024-01-22 11:00:55 +08:00
Jackson Harper	9d3a183c45	Dont map label input	2024-01-21 15:44:41 +08:00
Jackson Harper	6ab737432b	More logging	2024-01-21 15:31:16 +08:00
Jackson Harper	6cedffc249	Only require original content in savePageJob	2024-01-21 15:30:06 +08:00
Jackson Harper	202d19c9d3	Fix api status mapping	2024-01-21 14:11:53 +08:00
Jackson Harper	5393743c9d	Fix imports of authorized function	2024-01-21 13:33:05 +08:00
Jackson Harper	56a8ef23b6	Remove authorized function from imported helpers ... This creates some issues with init order when using the queue processor.	2024-01-21 13:22:17 +08:00
Jackson Harper	eefceeb1ef	Move checks to have the PDF check	2024-01-21 13:19:50 +08:00
Jackson Harper	9abd0a59da	Clean up imports	2024-01-21 13:16:35 +08:00
Jackson Harper	db3d7dca36	Add missing file	2024-01-21 07:43:50 +08:00
Jackson Harper	a4e707075f	Refactor savePage a bit to use it as a service from the jobs	2024-01-20 21:07:02 +08:00
Jackson Harper	2f405ebed0	Use savePage service instead of API call	2024-01-20 14:07:22 +08:00
Jackson Harper	3a18327230	Remove unused	2024-01-20 13:43:17 +08:00
Jackson Harper	7786221fbc	Fix update_subscription awaits	2024-01-20 13:38:25 +08:00
Jackson Harper	89537c13de	Simplify function input	2024-01-20 13:32:11 +08:00
Jackson Harper	1898e32607	Use service instead of API to update subscription	2024-01-20 13:27:54 +08:00
Jackson Harper	e5dec228f3	Remove some debug	2024-01-20 12:46:22 +08:00
Jackson Harper	4eeb012b78	Pass lits of fetchContentTasks into rss handlers ... This prevents the list from growing on each run	2024-01-20 11:36:14 +08:00
Jackson Harper	2b536c6086	Add more debug	2024-01-20 10:48:57 +08:00
Jackson Harper	52050728ba	Add more debugging logs	2024-01-20 10:29:07 +08:00
Jackson Harper	f4af4593c2	Fix debug line	2024-01-20 10:04:54 +08:00
Jackson Harper	4c1a182c7f	Add a refresh context to make debugging refresh runs easier	2024-01-20 09:50:21 +08:00
Jackson Harper	2961f69f02	Add a refresh context to make debugging rss jobs easier	2024-01-20 09:47:46 +08:00
Jackson Harper	a9eeda9369	Remove non-useful logging line	2024-01-20 09:23:45 +08:00
Jackson Harper	e9f22bba43	Some debug	2024-01-20 09:09:25 +08:00
Hongbo Wu	fb1d8331a4	Merge pull request #3396 from omnivore-app/fix/queue-redis-connection ... use worker redis client when connect to the queue in queue-processor	2024-01-19 21:03:20 +08:00
Hongbo Wu	780cda6e4b	use worker redis client when connect to the queue in queue-processor	2024-01-19 20:44:54 +08:00
Hongbo Wu	338733829f	Merge pull request #3394 from omnivore-app/fix/cache-content-fetched ... fix/cache content fetched	2024-01-19 18:16:05 +08:00
Hongbo Wu	6b89f4b809	graceful shutdown redis	2024-01-19 18:06:12 +08:00
Hongbo Wu	356ad38678	reduce logs	2024-01-19 18:01:09 +08:00
Hongbo Wu	4340286b89	add retry on failure in jobs	2024-01-19 17:38:25 +08:00
Jackson Harper	b8d08ae33f	Merge pull request #3393 from omnivore-app/fix/job-priority ... Fix refresh feed job priority	2024-01-19 17:28:09 +08:00
Hongbo Wu	8acdea5002	set cache if not exists	2024-01-19 17:14:49 +08:00
Jackson Harper	defb79d8c8	Use let instead of var	2024-01-19 17:12:34 +08:00
Hongbo Wu	51d5166321	get cached content from redis when saving pages	2024-01-19 17:06:37 +08:00
Jackson Harper	8ba1242ffb	Back off refresh-all-feeds if queue is very deep	2024-01-19 16:59:41 +08:00
Jackson Harper	d2491d3eb7	Reduce refresh-all-feeds priority	2024-01-19 16:59:15 +08:00
Hongbo Wu	699d38609b	cache fetch result in redis	2024-01-19 16:58:24 +08:00
Jackson Harper	e06ff24cea	Fix logging	2024-01-19 16:44:20 +08:00
Jackson Harper	02818d94a2	Adjust priorities	2024-01-19 16:37:57 +08:00
Hongbo Wu	35805e6e8f	use user provided url for feed added	2024-01-19 16:28:37 +08:00
Jackson Harper	84375b7c36	Add validation before refreshing feed URLs	2024-01-19 16:25:05 +08:00
Jackson Harper	2dbff6a6ab	Add some more debug output	2024-01-19 16:12:44 +08:00
Jackson Harper	0e590e53a6	Improve RSS priorities for refreshing feeds	2024-01-19 16:12:22 +08:00
Hongbo Wu	d135a7fe6a	Merge pull request #3391 from omnivore-app/fix/content-fetch-dockerfile ... fix: build content-fetch in dockerfile	2024-01-19 12:45:19 +08:00
Jackson Harper	69541d3e91	Merge pull request #3392 from omnivore-app/fix/backend-svc-endpoint ... Fix construction of service endpoint	2024-01-19 12:40:30 +08:00