52 commits

Author	SHA1	Message	Date
Hongbo Wu	07d43812a7	use winston logger instead of console log so the log will be truncated if it exceeds the max entry size	2023-07-26 16:27:18 +08:00
Hongbo Wu	e0a6a2e0a4	limit number of rss subscriptions to 20	2023-07-21 15:28:20 +08:00
Hongbo Wu	7ceb96a93e	fix edit rss ui	2023-07-20 13:35:43 +08:00
Hongbo Wu	6ef74a2601	disable import button while importer is running	2023-07-20 09:52:23 +08:00
Hongbo Wu	cd440a77c3	send last fetched at as a unix timestamp in ms	2023-07-19 14:09:38 +08:00
Hongbo Wu	03ce4b00d2	add authorization header in rss feed fetching request	2023-07-17 17:27:12 +08:00
Hongbo Wu	87275fbb9c	use a separate queue for fetching rss feed item content	2023-07-13 10:27:15 +08:00
Hongbo Wu	435fa0c541	Merge pull request #2478 from omnivore-app/fix/puppeteer-timezone ... add optional locale and timezone to saveUrl request for puppeteer to use	2023-07-11 17:32:10 +08:00
Hongbo Wu	1f283e6122	add optional locale and timezone to saveUrl request for puppeteer to use	2023-07-11 16:15:32 +08:00
Hongbo Wu	c500997693	add lastFetchedAt to the cloud task payload	2023-07-11 13:05:27 +08:00
Hongbo Wu	68667053c8	create an endpoint to fetch all rss feeds	2023-07-07 21:15:42 +08:00
Hongbo Wu	b7c133d58e	fix: email sending and recommendation ... * use token in the custom header as the key in rate limiter	2023-06-28 17:00:11 +08:00
Hongbo Wu	0d8a3f7346	fix pocket paginated api	2023-06-16 18:11:31 +08:00
Hongbo Wu	1a48ad03e4	use a separate queue for thumbnailer	2023-06-12 12:25:04 +08:00
Hongbo Wu	b698029972	store token in cookie instead of authorization header	2023-06-07 14:24:52 +08:00
Hongbo Wu	9be84fb473	create thumbnail task for newsletters too	2023-06-07 11:52:13 +08:00
Hongbo Wu	0c3fa2cdd4	feat: start a cloud task to set thumbnail and pre-cache all the images in the content	2023-06-06 11:56:31 +08:00
Hongbo Wu	014dc773e3	Fix labels not saved correctly by saveUrl	2023-04-12 17:04:59 +08:00
Hongbo Wu	874247661b	resolve conflicts	2023-04-12 17:04:59 +08:00
Hongbo Wu	c07ada0218	resolve conflicts	2023-04-12 17:04:59 +08:00
Hongbo Wu	10c01c12f2	Add test case for integration import task handler	2023-04-12 16:50:10 +08:00
Hongbo Wu	9ff0711a73	Remove wrong comments	2023-04-12 16:50:10 +08:00
Hongbo Wu	c8ec84562b	Create an import from integration cloud task	2023-04-12 16:50:10 +08:00
Hongbo Wu	0bf4119c92	Refactor with factor pattern	2023-04-12 16:50:10 +08:00
Hongbo Wu	9056318667	Change type field in integration table from enum to text type	2023-04-12 16:50:10 +08:00
Jackson Harper	b438d42f38	Remove some unneeded console.log calls	2023-01-04 11:18:37 +08:00
Hongbo Wu	62a3f6d1d8	Add recommendHighlights API	2022-12-08 11:37:35 +08:00
Jackson Harper	8ac1afe277	Use cookie auth instead of header to not interfere with GCPs auth mechanisms	2022-12-05 18:41:08 +08:00
Hongbo Wu	6b65c386a0	Add authentication to the request header	2022-12-02 21:15:33 +08:00
Hongbo Wu	7707f100f2	Add recommend gql api	2022-12-02 19:45:26 +08:00
Hongbo Wu	0e3d1ced46	Add recommend rest api to handler tasks	2022-12-02 19:10:41 +08:00
Hongbo Wu	5fd137d23e	Add recommendation cloud task	2022-12-02 18:49:13 +08:00
Hongbo Wu	ce18d33ae1	Change queue name	2022-11-11 10:14:46 +08:00
Hongbo Wu	b0938ee96c	Pre-fetch realistic voice only if user is opted in	2022-11-10 18:48:00 +08:00
Hongbo Wu	ddd1e84686	Add language and rate in the cloud task params	2022-11-08 16:22:23 +08:00
Hongbo Wu	2e47b0879c	Convert HTML to utterances	2022-11-07 19:30:20 +08:00
Hongbo Wu	a19ec8efea	Hardcode queue name	2022-08-29 13:20:39 +08:00
Hongbo Wu	2e4cb7f4b0	Fix using wrong taskHandlerUrl for low priority task	2022-08-29 12:01:17 +08:00
Hongbo Wu	f903a92245	Use text-to-speech queue	2022-08-29 11:47:42 +08:00
Hongbo Wu	b2d49d1fbf	Add dotenv	2022-08-26 16:30:09 +08:00
Hongbo Wu	463f423cab	Enqueue TTS task in the get speech of article API if speech not found	2022-08-22 16:13:34 +08:00
Hongbo Wu	576318fcbe	Add authentication to speech svc endpoint	2022-08-18 19:24:38 +08:00
Hongbo Wu	b0bf4fc5ce	Create speech while requesting	2022-08-18 19:24:38 +08:00
Hongbo Wu	447e413605	Add function to parse HTML to SSML	2022-08-18 19:24:38 +08:00
Hongbo Wu	355e33b648	Test Mandarin	2022-08-18 19:24:38 +08:00
Hongbo Wu	94f9dd9e6e	Enqueue text to speech tasks	2022-08-18 19:23:41 +08:00
Hongbo Wu	134482a261	Add integration tests for integration router	2022-08-08 23:11:35 +08:00
Hongbo Wu	eb2ee5ab55	Add task to handle sync with integrations	2022-08-05 16:09:26 +08:00
Hongbo Wu	75d3372426	Use gcf for low priority task	2022-06-24 10:13:14 -07:00
Hongbo Wu	acec3b1acb	Use lower priority queue for large imports ... * add a count query in elastic * if priority is not set, check the rate limit of user's libary - if 5 articles added in the last minute: use low queue - default: use normal queue	2022-03-22 18:08:08 +08:00