prehistoric-systems/omnivore
1
0
Fork 0
mirror of https://github.com/omnivore-app/omnivore.git synced 2026-03-11 08:54:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
7058 commits 201 branches 31 tags 432 MiB
Commit graph

85 commits

Author SHA1 Message Date
Hongbo Wu
113720caf6 wrap document fragment in the <html> and <body> in order to parse the HTML correctly 2023-07-17 16:14:59 +08:00
Hongbo Wu
d69e732579 fix: dedupe url if failed to save 2023-06-01 16:11:35 +08:00
Hongbo Wu
15b41560de fix: improve the speed of generating highlighted markdown content 2023-05-26 15:51:54 +08:00
Hongbo Wu
4cc9547935 fix: fallback to html if failed to convert html to markdown 2023-05-19 16:55:50 +08:00
Hongbo Wu
0adab7ad23 fix: sentry report on unable to find highlight 2023-05-18 21:07:51 +08:00
Hongbo Wu
48554be76d fix: wrap link with == 2023-05-18 21:04:27 +08:00
Hongbo Wu
2bf932cbdc fix: &npsp; breaks highlight 2023-05-18 16:50:49 +08:00
Hongbo Wu
e3d8fae6c5 Remove debug log 2023-05-12 19:28:19 +08:00
Hongbo Wu
791d11f581 Allow content to be converted into highlightedMarkdown format 2023-05-12 19:27:04 +08:00
Hongbo Wu
42dc3f7330 Fix some external requests not being mocked 2023-04-12 17:04:59 +08:00
Hongbo Wu
4969391d4c Replace picture with image 2023-04-12 12:15:53 +08:00
Hongbo Wu
7f761049d7 Preparse the newsletter content 2023-02-17 09:49:19 +08:00
Hongbo Wu
cc8b1cefdb Preserve <pre> elements with prism- class and identity them as code blocks 2023-02-14 12:33:59 +08:00
Hongbo Wu
d816ee9563 Allow image and media to be loaded in puppeteer 2023-02-13 16:50:39 +08:00
Hongbo Wu
c285a017c3 Increase view.html iframe height 2023-02-09 22:20:58 +08:00
Hongbo Wu
761f2ff8f2 Add JWT token to the request 2023-02-09 18:05:04 +08:00
Hongbo Wu
a91cf9ef63 Add an option for the original html to be parsed by distiller 2023-02-09 17:44:02 +08:00
Hongbo Wu
7bfd36e308 Fix readability not run in puppeteer-parse 2023-01-12 18:33:47 +08:00
Hongbo Wu
7b749f974d Convert HTML to markdown if specified 2023-01-05 12:12:48 +08:00
Hongbo Wu
7c39db207b Replace createArticle with savePage in puppeteer-parse service 2022-12-28 10:15:05 +08:00
Hongbo Wu
e9b31e375f Update savePage API to accept parsed content in the param 2022-12-27 21:59:31 +08:00
Jackson Harper
080a1982b2 Remove unused import 2022-11-21 22:39:10 +08:00
Jackson Harper
9741f6b12d Add highlights to newly saved pages if they contain highlight markers 2022-11-21 22:39:10 +08:00
Hongbo Wu
a7e92addb0 Create 128 * 128 proxy image for the site icon 2022-10-18 15:32:30 +08:00
Hongbo Wu
49ed8e279b Calls preParseContent function in content-handler package before parsing content 2022-10-07 16:56:38 +08:00
Hongbo Wu
679977805f Remove custom content-handler in packages/api 2022-10-07 16:56:38 +08:00
Hongbo Wu
8942398092 Change GET to HEAD 2022-09-30 12:52:09 +08:00
Hongbo Wu
9841ce7f8e Remove parsing newsletter emails from forwarded emails 2022-09-30 12:51:23 +08:00
Hongbo Wu
2f6b26d21d Use GET request as some host do not allow HEAD requests 2022-09-28 20:18:40 +08:00
Hongbo Wu
a55ad135fd Set 5s for the HEAD request timeout 2022-09-28 19:26:42 +08:00
Hongbo Wu
a6795b380a Fetch favicon from url 2022-09-28 19:02:29 +08:00
Hongbo Wu
56e3ccadf0 Add test case for Axios AM newsletter 2022-09-21 12:16:13 +08:00
Hongbo Wu
b03f7ebeb8 Add handler to pre-process morning brew newsletters 2022-09-15 16:21:09 +08:00
Hongbo Wu
0cf689ce21 Fix not getting revue newsletter url by checking all the hyper links in the table tr td 2022-08-19 17:32:29 +08:00
Hongbo Wu
dee94f7c93 Fix a bug for converting text to speech for articles with less than 5000 characters 2022-08-18 19:24:38 +08:00
Hongbo Wu
447e413605 Add function to parse HTML to SSML 2022-08-18 19:24:38 +08:00
Jackson Harper
565da42b46 When parsing newsletters with no url dont fetch the generated url 2022-07-28 11:05:17 -07:00
Hongbo Wu
3a120b8f47 Return empty name if name not found in from header 2022-07-28 10:37:28 +08:00
Hongbo Wu
c99c1db57e Add support to the case when from address is in Name <address> format 2022-07-28 10:26:15 +08:00
Hongbo Wu
6f11ccacb1 Save article from forwarding emails 2022-07-27 12:15:28 +08:00
Hongbo Wu
d184ca8d04 Add function isProbablyArticle to test if a forwarded email contains an article to save 2022-07-27 12:15:26 +08:00
Hongbo Wu
65f28fe708 add revue.email to the revue newsletter attribute selectors 2022-07-18 10:44:39 +08:00
Hongbo Wu
345c020dea fix not saving loqseq weekly newsletter due to no url 2022-07-17 12:36:52 +08:00
Hongbo Wu
c4a599d2ba support newsletters hosted on convertkit.com 2022-07-12 11:47:38 +08:00
Hongbo Wu
9599edb9fb Add support for newsletters hosted on getrevue.co 2022-07-06 22:06:51 +08:00
Hongbo Wu
2e77241044 Check and get Revue newsletter url from email 2022-07-06 22:06:21 +08:00
Hongbo Wu
404805e0c0 Make async calls to parse() 2022-05-31 22:51:00 +08:00
Hongbo Wu
7d4d1d7b67 Parse language in readability 2022-05-26 10:55:21 +08:00
Hongbo Wu
2ee95a1c14 Fix cannot convert null to object error message 2022-05-20 20:38:30 +08:00
Jackson Harper
eadeccce81 Linting fixes 2022-05-18 11:31:42 -07:00