Hongbo Wu
88a7e8d85b
fix tests
2024-04-04 12:17:15 +08:00
Hongbo Wu
053625276b
Merge pull request #2608 from Podginator/feat/Ars-technica-handler
...
Ars Technica Multipage handling
2023-08-07 10:43:39 +08:00
Thomas Rogers
0392f6f009
Linting Fixes
2023-08-04 22:36:15 +02:00
Thomas Rogers
49c1976ac9
Add Ars Technica handler for multipage articles
2023-08-04 20:00:03 +02:00
Thomas Rogers
cf5f46026a
Add Paywalled Wired Handler
2023-08-02 19:53:20 +02:00
Thomas Rogers
44dd44dd58
update comments on tests
2023-06-20 10:26:53 +02:00
Thomas Rogers
c0f34270ee
Remove Related content links from article (IE: Read article X)
2023-06-20 10:24:41 +02:00
Thomas Rogers
55fd02b67a
Fix Tests
2023-06-20 09:20:43 +02:00
Thomas Rogers
0cae728a43
Add missing files
2023-06-20 02:42:09 +02:00
Hongbo Wu
89ac9c46cc
Remove other places that use rfc2047 decoder
2023-04-20 20:53:06 +08:00
Hongbo Wu
06733227d6
Remove new "restack" and "share" buttons from SubStack newsletters
2023-04-18 14:53:27 +08:00
Jackson Harper
c366cd6472
Fix test value, there is only one quote tweet
2023-04-12 15:37:26 +08:00
Jackson Harper
ae45067a32
Add test data file
2023-04-12 15:16:11 +08:00
Jackson Harper
344514bd0f
Handle embedded quote tweets
2023-04-12 14:50:20 +08:00
Hongbo Wu
de9524c3e8
Fix confusing unsubscribing url with email address
2023-02-27 12:06:46 +08:00
Hongbo Wu
31eb67efb1
Fix sometimes there is extra spaces between sender and email address by checking only the email address
2023-02-17 22:05:35 +08:00
Hongbo Wu
db1a194d11
Add support for india times newsletter
2023-02-03 18:18:44 +08:00
Hongbo Wu
d36b608919
Add support for energy-world newsletter
2023-02-03 17:23:51 +08:00
Hongbo Wu
b6c41b9c73
Add support for every.io newsletter
2023-02-03 16:59:27 +08:00
Hongbo Wu
363489f5be
Add generic newsletter handler
2023-02-03 14:46:24 +08:00
Hongbo Wu
39b87e2aaf
Add support for Time To Sign Off newsletter
2023-02-02 17:01:25 +08:00
Hongbo Wu
ba8b6796f3
Merge pull request #1746 from omnivore-app/fix/save-youtube-playlist
...
Fix incorrect Youtube playlist author name and description
2023-01-31 11:06:25 +08:00
Hongbo Wu
61bf89b9ad
Add tests
2023-01-30 19:10:27 +08:00
Hongbo Wu
4f12580b1c
Use email header x-beehiiv-type to detect beehiiv newsletter and get the newsletter url from the header x-newsletter
2023-01-30 19:03:15 +08:00
Hongbo Wu
88f6e20bfc
Pass email headers to the content-handler
2023-01-30 18:52:38 +08:00
Hongbo Wu
1b3d4bbffa
Do not escape the title of youtube video or tweet which is saved in elastic
2023-01-18 19:08:36 +08:00
Hongbo Wu
1243e2ace2
Fix the error when no name in subscription by using the email address as the author when no author found in the newsletter
2023-01-10 11:17:22 +08:00
Jackson Harper
0d83ecb068
Use greedy matching on the GitHub title regex
...
This fixes issues with titles that have slashes (/) in their title
as the regex match would look for the last possible matching
slash.
2022-11-16 13:52:58 +08:00
Hongbo Wu
9d753e3c0e
Forward convertkit confirmation email
2022-11-02 15:27:30 +08:00
Hongbo Wu
ae3ff6f34b
Add test case
2022-11-01 17:48:39 +08:00
Hongbo Wu
67082a478e
Add support for hey world newsletters
2022-11-01 16:41:42 +08:00
Jackson Harper
e1d7eeed01
Make test verify preparse is true
2022-11-01 10:46:31 +08:00
Jackson Harper
734c4337df
Add missing test file
2022-10-31 21:51:22 +08:00
Jackson Harper
cc91e43572
Handle embedded tweets in substack emails
...
This does a few things:
- tags static tweets found in substack emails with a special class
- upgrades readability to ignore special class names
- reduces some readability debug output
2022-10-31 21:28:36 +08:00
Hongbo Wu
31bc9fe5be
Fix node-weekly newsletter getting forwarded
...
* This error is caused by a previous rebase conflict and resolving the conflict caused an important line missing
* Revert the change to add CooperPressHandler to the array of newsletter handlers
* Updated the test to get the correct handler from email content to prevent such cases
2022-10-21 09:57:05 +08:00
Hongbo Wu
57846a1c5e
Fix tests
2022-10-18 15:14:38 +08:00
Hongbo Wu
706607ea2b
Rebase main
2022-10-18 14:54:33 +08:00
Hongbo Wu
1fda6946bb
Save newsletters hosted by cooper-press.com correctly
2022-10-18 14:53:02 +08:00
Hongbo Wu
9757394a05
Merge pull request #1318 from omnivore-app/fix/newsletter-ghost-org
...
Save newsletters hosted by ghost.org correctly
2022-10-18 14:50:27 +08:00
Jackson Harper
59427fa896
Mock the substack domain also when testing redirects
...
We were making the actual call to the redirected URL here,
instead of mocking it. We need to mock both the embedded email
domain, and the domain we are redirected to.
2022-10-18 12:51:53 +08:00
Hongbo Wu
d8c5c97960
Save newsletters hosted by ghost.org correctly
2022-10-17 19:27:02 +08:00
Hongbo Wu
37439c6622
Save fs.blog newsletter correctly
2022-10-17 17:59:27 +08:00
Hongbo Wu
5dcde8dac3
Fix not correctly identify milkroad newsletters due to the HTML format changes again by the author
2022-10-13 10:52:03 +08:00
Hongbo Wu
c2a44f4991
Restore HTTP interceptor to the normal unmocked behaviour after testing
2022-10-05 11:29:23 +08:00
Hongbo Wu
edd1b908ee
Fix tests
2022-10-05 11:29:23 +08:00
Hongbo Wu
61303419a0
Add timeout
2022-10-04 14:25:19 +08:00
Hongbo Wu
767053e31b
mock redirect request
2022-10-04 11:27:55 +08:00
Hongbo Wu
4b01fccad8
Fix content-fetch dockerfile
2022-10-03 14:21:31 +08:00
Hongbo Wu
25740465f2
Add timeout
2022-09-30 13:10:58 +08:00
Hongbo Wu
b00a516737
Add other newsletter handlers
2022-09-30 12:51:23 +08:00