Commit graph

16 commits

Author SHA1 Message Date
Jackson Harper
6ef14e1f91 Mark ft.com page a readerable 2022-05-05 09:28:22 -07:00
Jackson Harper
384c5dbf9f Improve rendering of the Financial Times 2022-05-05 09:14:51 -07:00
Jackson Harper
74693d40c0 Mark page as readerable 2022-05-04 15:01:35 -07:00
Jackson Harper
8386aebaf8 Remove ads from fiercepharma page 2022-05-04 14:22:08 -07:00
Jackson Harper
a24b976546 Remove lazy loaded srcset elements
Some tools like jetpack: https://jetpack.com/support/lazy-images/
use a temporary srcset element set to a data image when lazy
loading, these are later removed by JS. We test if there is
a valid src attribute and if the srcset attribute is a data embed
to remove these.
2022-04-29 10:05:33 -07:00
Jackson Harper
d2bb359f5c Handle srcset image density specifications 2022-04-26 15:18:23 -07:00
Hongbo Wu
72a231c97e
Do not proxy image data uri (#421)
* do not proxy image data uri

* rename data uri

* rename data uri in test
2022-04-14 12:59:12 +08:00
Hongbo Wu
4d01f689b2 replace tables of article content with divs for newsletters 2022-04-11 20:00:11 +08:00
Hongbo Wu
6d405432af
add site_name and site_icon to page model and return in resolver (#341)
* add site_name and site_icon to page model and return in resolver

* fix tests
2022-03-30 10:43:10 +08:00
Jackson Harper
12af64609c Fix readability issues with null style elements
isProbably visible can fail in this case because style could be
undefined on an element.
2022-03-23 13:35:00 -07:00
Hongbo Wu
960a22d50c
Fix/city journal parsing (#266)
* remove arrow image when parsing

* ignore m_article classname element which indicates a mobile version of the website

* generate test page for city journal
2022-03-21 22:53:21 +08:00
Jackson Harper
0361ef86fa Better handling of HTML entities in descriptions
The HTML code method didnt implent all possible
entities, causing some (usually rquote) to display.
2022-03-14 11:02:08 -07:00
Jackson Harper
fc7d972855 Fix typo in readability date handling causing this parse issue
Can remove our special handler for the published date now that we
are pulling it out correctly.
2022-03-14 10:20:19 -07:00
Jackson Harper
8a2bb0f49d Handle blogger sites that display the full feed on the article page 2022-03-10 13:48:39 -08:00
Jackson Harper
234dba9174 Improve readability of channelnewsasia
This uses negative lookahead to reject nodes that have outstream
ads embedded. Previously they were being accepted because they
contained `$article` in the class name.
2022-03-04 10:34:44 -08:00
Jackson Harper
84f32935f5 Open source omnivore 2022-02-11 09:24:33 -08:00