820 commits

Author	SHA1	Message	Date
Hongbo Wu	5dca02873d	Revert originalArticleUrl change	2022-05-12 10:45:13 +08:00
Hongbo Wu	412d7cebc6	Remove www in the hostname if exists	2022-05-12 10:32:35 +08:00
Hongbo Wu	b4ec812f41	Use siteName in search result in web	2022-05-12 10:32:10 +08:00
Hongbo Wu	2aadd6d200	Add siteName in search result web	2022-05-12 10:31:14 +08:00
Hongbo Wu	8f75c43658	Add siteName in search result	2022-05-12 10:30:47 +08:00
Hongbo Wu	76aef35423	Remove www. from the siteName in the search api response	2022-05-11 23:07:34 +08:00
Hongbo Wu	37ce895d01	Revert change in web	2022-05-11 23:07:13 +08:00
Hongbo Wu	b102e35465	Remove www. from the siteName	2022-05-11 22:25:38 +08:00
Jackson Harper	40eda0a6ca	Merge pull request #533 from omnivore-app/OMN-506 ... OMN-506	2022-05-10 13:28:01 -07:00
Jackson Harper	4c7dce330c	Merge pull request #537 from omnivore-app/OMN-434 ... [OMN-434]: cypress tests for saving links	2022-05-10 12:03:00 -07:00
Jackson Harper	7949026b46	Rename cypress test script to e2e so its not run in GH Actions	2022-05-10 11:07:26 -07:00
Jackson Harper	b1c9911827	Add test script to cypress package	2022-05-10 10:48:09 -07:00
Hongbo Wu	a6c5bee909	merge youtube download fix into content-fetch	2022-05-10 10:36:51 +08:00
Hongbo Wu	7dd460352e	Merge pull request #566 from omnivore-app/optimize-puppeteer ... Optimize saving performance	2022-05-10 09:43:33 +08:00
Jackson Harper	af9888cc81	Use overflow hidden to clip google auth button to container	2022-05-09 13:14:31 -07:00
Jackson Harper	956371dd51	Clean up login page ... Update margins on login layout Add missing image from about page	2022-05-09 11:39:50 -07:00
Jackson Harper	1f0abbaa30	Add tests	2022-05-09 11:11:13 -07:00
Jackson Harper	31eb1a0f61	Fix parsing video IDs from youtube URLs	2022-05-09 11:03:17 -07:00
gitstart-omnivore	068a14b2b5	Fixing build issue	2022-05-09 17:22:51 +00:00
gitstart-omnivore	c376c8d4b4	Created Page 03 of Onboarding	2022-05-09 17:12:09 +00:00
gitstart-omnivore	caeef23bc5	Merge commit '6675688361d457fe12adda8f33f17fb7a4528210' into OMN-506	2022-05-09 17:10:57 +00:00
Hongbo Wu	45a2a1393f	Use chrome-aws-lambda args	2022-05-09 20:59:20 +08:00
Hongbo Wu	47c3578820	Add more puppeteer args	2022-05-09 14:32:46 +08:00
Hongbo Wu	bb5b4ec174	Ignore app.yaml	2022-05-09 13:54:02 +08:00
Hongbo Wu	6f82499deb	Merge puppeteer changes	2022-05-09 13:52:40 +08:00
Hongbo Wu	1dffbfc881	Add puppeteer-code dependencies	2022-05-09 13:45:45 +08:00
Hongbo Wu	59a2639b7d	Reduce http call to get jsonld data if title or content or sitename or byline exists	2022-05-09 13:45:45 +08:00
Hongbo Wu	a457c9d128	Update article content only when code blocks exist	2022-05-09 13:45:45 +08:00
Hongbo Wu	4c7f6d0281	Update comments	2022-05-09 13:45:45 +08:00
Hongbo Wu	4571f1f51c	Add metrics	2022-05-09 13:45:45 +08:00
Hongbo Wu	21799b7b6d	Add puppeteer-stealth and puppeteer-ad-block plugin and a user-data-dir to reduce processing time	2022-05-09 13:45:45 +08:00
Jackson Harper	fd934a949e	Add a standalone service content fetching	2022-05-08 21:52:36 -07:00
Hongbo Wu	b24a91c746	Merge pull request #561 from omnivore-app/faster-save ... Faster save by reusing JSDOM	2022-05-07 10:30:40 +08:00
Jackson Harper	aa95c3abe5	Merge pull request #556 from omnivore-app/fix/enable-saved-searches ... Enable saved search buttons for all users	2022-05-06 08:20:35 -07:00
Hongbo Wu	eaad96acdd	Return parsed dom back to backend	2022-05-06 12:29:08 +08:00
Hongbo Wu	5f5076e864	Highlight code element without reinitialize jsdom	2022-05-06 12:20:54 +08:00
Hongbo Wu	7c6b810522	Remove redundant JSDOM	2022-05-06 10:53:36 +08:00
Jackson Harper	1bda035890	Make the highlight cards work a little better in list mode	2022-05-05 14:44:45 -07:00
Jackson Harper	b53dae36a0	Enable saved search buttons for all users	2022-05-05 11:17:00 -07:00
Jackson Harper	d0610a7cce	Merge pull request #553 from omnivore-app/fix/financial-times-rendering ... Improve rendering of the Financial Times	2022-05-05 09:37:54 -07:00
Jackson Harper	6ef14e1f91	Mark ft.com page a readerable	2022-05-05 09:28:22 -07:00
Jackson Harper	384c5dbf9f	Improve rendering of the Financial Times	2022-05-05 09:14:51 -07:00
Hongbo Wu	b9c2c1186b	Fix batch_size=500 to avoid exceeding max memory limit and requests_per_second=250 to throttle update requests ... Fix batch_size=500 to avoid exceeding max memory limit and requests_per_second=250 to throttle update requests	2022-05-05 21:10:49 +08:00
Hongbo Wu	46b390204b	Merge pull request #549 from omnivore-app/fix/parse-image ... Parse image and save it in an <img> element	2022-05-05 20:25:14 +08:00
Hongbo Wu	24373018af	Return non-text elements if no text content found after parsing in readability	2022-05-05 19:26:39 +08:00
Hongbo Wu	35e3e347d6	Remove image text	2022-05-05 19:25:09 +08:00
Hongbo Wu	7183ca2e89	Add request timeout = 30m in elastic client	2022-05-05 13:28:01 +08:00
Hongbo Wu	911afd77e5	Reduce requests per second and scroll_size	2022-05-05 12:40:44 +08:00
Hongbo Wu	c4ea185e17	Add comment	2022-05-05 12:16:53 +08:00
Hongbo Wu	6f29f18743	Parse image and save it in a <img> element	2022-05-05 12:13:08 +08:00