prehistoric-systems/omnivore
1
0
Fork 0
mirror of https://github.com/omnivore-app/omnivore.git synced 2026-03-11 08:54:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
5775 commits 201 branches 31 tags 432 MiB
Commit graph

1108 commits

Author SHA1 Message Date
Jackson Harper
d0e4c01b45 Allow passing mode to backend to better handle mode changes in client 2023-03-09 10:15:14 +08:00
Hongbo Wu
a1e3ac8a07 Add quote to the updateHighlightInput of the updateHighlight API 2023-03-08 15:37:24 +08:00
dependabot[bot]
57468fe1bd
Bump firebase-admin from 10.0.2 to 11.5.0 
Bumps [firebase-admin](https://github.com/firebase/firebase-admin-node) from 10.0.2 to 11.5.0.
- [Release notes](https://github.com/firebase/firebase-admin-node/releases)
- [Commits](https://github.com/firebase/firebase-admin-node/compare/v10.0.2...v11.5.0)

---
updated-dependencies:
- dependency-name: firebase-admin
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-06 22:04:37 +00:00
Hongbo Wu
87fd49540a
Merge pull request #1697 from omnivore-app/dependabot/npm_and_yarn/knex-2.4.2 
Bump knex from 0.21.12 to 2.4.2
 2023-03-06 09:45:50 +08:00
Hongbo Wu
0a350bef6d Fix issues with knex version bump 2023-03-05 21:36:46 +08:00
Hongbo Wu
bd12ecd7ec Add publishedAt to the updatePageInput 2023-03-02 13:40:59 +08:00
dependabot[bot]
36bac532b0
Bump @opentelemetry/instrumentation-dns from 0.29.0 to 0.31.2 
Bumps [@opentelemetry/instrumentation-dns](https://github.com/open-telemetry/opentelemetry-js-contrib) from 0.29.0 to 0.31.2.
- [Release notes](https://github.com/open-telemetry/opentelemetry-js-contrib/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-js-contrib/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-js-contrib/compare/host-metrics-v0.29.0...instrumentation-dns-v0.31.2)

---
updated-dependencies:
- dependency-name: "@opentelemetry/instrumentation-dns"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-02-27 21:17:27 +00:00
Hongbo Wu
65c244edd7
Merge pull request #1819 from omnivore-app/feature/search-filter-with-no-as-keyword 2023-02-21 12:23:22 +08:00
Hongbo Wu
eb1d8caa1c Add tests 2023-02-17 18:03:53 +08:00
Hongbo Wu
214766dda6 Add no: keyword to the search filter to filter items without label or highlight 2023-02-17 12:48:02 +08:00
Hongbo Wu
153ca6995b Refactor exclude labels query 2023-02-17 12:13:20 +08:00
Hongbo Wu
7f761049d7 Preparse the newsletter content 2023-02-17 09:49:19 +08:00
Hongbo Wu
cc8b1cefdb Preserve <pre> elements with prism- class and identity them as code blocks 2023-02-14 12:33:59 +08:00
Hongbo Wu
d816ee9563 Allow image and media to be loaded in puppeteer 2023-02-13 16:50:39 +08:00
Hongbo Wu
0359cefb4f
Merge pull request #1794 from omnivore-app/add-domdistiller-test-page 
Add dom-distiller generated test pages
 2023-02-10 10:42:59 +08:00
Hongbo Wu
c285a017c3 Increase view.html iframe height 2023-02-09 22:20:58 +08:00
Hongbo Wu
761f2ff8f2 Add JWT token to the request 2023-02-09 18:05:04 +08:00
Hongbo Wu
a91cf9ef63 Add an option for the original html to be parsed by distiller 2023-02-09 17:44:02 +08:00
Jackson Harper
b0ccfc213d Operate on pages in processing state during bulk operations 2023-02-09 12:28:06 +08:00
Jackson Harper
e6833fddff Add to address on email not forwarded logs 2023-02-06 11:13:28 +08:00
Jackson Harper
1e63899748 Add additional logging for mobile auth login errors 2023-02-06 11:11:28 +08:00
Hongbo Wu
1458395630
Merge pull request #1759 from omnivore-app/archive-all-api 
bulk action api
 2023-02-02 22:14:33 +08:00
Hongbo Wu
bb5c104a42 Change archiveAll to bulkAction which allows deletion too 2023-02-02 21:26:37 +08:00
Hongbo Wu
7255061e36 Unescape HTML entities in annotation when creating highlight 2023-02-02 11:32:24 +08:00
Hongbo Wu
3b888bbb08 Make Async call to archive all 2023-02-01 18:50:10 +08:00
Hongbo Wu
ea54b92a92 Update test 2023-02-01 18:10:47 +08:00
Hongbo Wu
03ab96b7f8 Add archiveAll API 2023-02-01 18:05:16 +08:00
Hongbo Wu
dd6c8cf6dc Make subject optional too 2023-02-01 13:53:27 +08:00
Hongbo Wu
ac6f5b497c Accept null value for text in an email 2023-02-01 13:44:27 +08:00
Hongbo Wu
83c8166b3b Unescape HTML entities in annotation to avoid showing escaped characters 2023-02-01 12:13:00 +08:00
Jackson Harper
749df941f8 Use ilike for recent email query 2023-01-28 16:18:06 +08:00
Jackson Harper
7476878254 Add more logging for recent email lookups 2023-01-28 15:05:45 +08:00
Jackson Harper
6a50e85759 Save the parsed email address as the to field in received_emails 
The unparsed addresses can look something like this:

"jacksonh-XXXX@inbox.omnivore.app" <jacksonh-XXXX@inbox-demo.omnivore.app>

but we want to join on this field to the NewsletterEmail.address
field which will look like `jacksonh-XXXX@inbox.omnivore.app`
 2023-01-28 13:53:23 +08:00
Jackson Harper
a8d2f953bc Dont use same user as previous tests for multi user test 2023-01-27 16:00:37 +08:00
Jackson Harper
8da817e8b1 Fix the clear old received emails trigger to only clear current users emails 2023-01-27 15:38:14 +08:00
Jackson Harper
15782fc5ce Add some analytics when creating reports 2023-01-26 19:32:41 +08:00
Jackson Harper
506568e0c2
Merge pull request #1667 from omnivore-app/recent-emails 
recent emails
 2023-01-25 14:22:00 +08:00
dependabot[bot]
f0e3b4588a
Bump knex from 0.21.12 to 2.4.2 
Bumps [knex](https://github.com/knex/knex) from 0.21.12 to 2.4.2.
- [Release notes](https://github.com/knex/knex/releases)
- [Changelog](https://github.com/knex/knex/blob/master/CHANGELOG.md)
- [Commits](https://github.com/knex/knex/commits)

---
updated-dependencies:
- dependency-name: knex
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-01-23 21:19:41 +00:00
Jackson Harper
59aa2561eb
Merge pull request #1636 from omnivore-app/dependabot/npm_and_yarn/luxon-3.2.1 
Bump luxon from 3.0.4 to 3.2.1
 2023-01-19 17:00:12 +08:00
Hongbo Wu
a682d87aa6 Add tests for recent emails resolver 2023-01-19 12:11:34 +08:00
Hongbo Wu
83c62c65a3 Add test for saving received email 2023-01-19 10:44:08 +08:00
Hongbo Wu
318a6557a5 Email us if a recent email marked as library item 2023-01-19 09:55:49 +08:00
Hongbo Wu
7dbf8662fc Fix test 2023-01-19 09:38:21 +08:00
Hongbo Wu
8f9c317dd1 Save received email before publishing data 2023-01-18 22:35:07 +08:00
Jackson Harper
08048405a1 Correct typo in doc about labels 2023-01-18 22:07:39 +08:00
Hongbo Wu
36d2ac041a Fix error of getting subscriptions without newsletter email by inner join them 2023-01-18 18:42:10 +08:00
Hongbo Wu
064ea5a782 Add text in the payload in the test 2023-01-18 18:25:32 +08:00
Hongbo Wu
d60890d154 Add pubsub to save received email 2023-01-18 17:13:11 +08:00
Hongbo Wu
d5e3a29fd6 Fix test 2023-01-18 15:08:28 +08:00
Hongbo Wu
60e107964f Fix typo 2023-01-18 15:00:34 +08:00
Hongbo Wu
96f727a165 Add mark a recent email as library item api 2023-01-18 15:00:34 +08:00
Hongbo Wu
62a3b48e00 Add list recent emails api 2023-01-18 15:00:34 +08:00
Hongbo Wu
3f373ab3b6 Save received email 2023-01-18 15:00:34 +08:00
Hongbo Wu
2da4ca5da8 Add saveReceivedEmail service 2023-01-18 15:00:34 +08:00
Hongbo Wu
b7d732df7c Add received_email entity 2023-01-18 15:00:34 +08:00
Hongbo Wu
f01ab3805a Left join active subscriptions of a newsletter email to get the right count 2023-01-18 14:37:54 +08:00
Hongbo Wu
e94f6de466 Delete subscription if unsub 2023-01-18 14:36:23 +08:00
dependabot[bot]
43018ea94d
Bump luxon from 3.0.4 to 3.2.1 
Bumps [luxon](https://github.com/moment/luxon) from 3.0.4 to 3.2.1.
- [Release notes](https://github.com/moment/luxon/releases)
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md)
- [Commits](https://github.com/moment/luxon/compare/3.0.4...3.2.1)

---
updated-dependencies:
- dependency-name: luxon
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-01-18 06:22:56 +00:00
Jackson Harper
786ad35da9
Merge pull request #1635 from omnivore-app/fix/content-display-reports 
Fix creation of content display report
 2023-01-13 11:37:22 +08:00
Hongbo Wu
6572f718c9
Merge pull request #1648 from omnivore-app/fix/puppeteer-parse 
fix/puppeteer parse
 2023-01-13 10:59:09 +08:00
Hongbo Wu
c4a5cbe4e2 Save newsletter_email_id in subscription instead of the whole entity 2023-01-12 22:16:00 +08:00
Hongbo Wu
c647aabeaa Save newsletter_email_id in subscription instead of the whole entity 2023-01-12 22:15:42 +08:00
Hongbo Wu
7bfd36e308 Fix readability not run in puppeteer-parse 2023-01-12 18:33:47 +08:00
Jackson Harper
824899760a Update some style, add Matter archive importer tool 2023-01-12 14:00:46 +08:00
Jackson Harper
397233054b Dont clear content display reports before running test (this was just there for debug) 2023-01-11 11:15:37 +08:00
Jackson Harper
706c4dea18 Dont try to clean up content display reports when running tests 2023-01-11 10:51:46 +08:00
Jackson Harper
3bff5fe7f8 Add a test for the content display report service 2023-01-11 10:51:46 +08:00
Jackson Harper
337b723d24 Fix creation of content display report 2023-01-11 10:51:46 +08:00
Hongbo Wu
1837f31906 Add tests 2023-01-09 16:52:54 +08:00
Hongbo Wu
75974c772e Fix test 2023-01-09 15:32:00 +08:00
Hongbo Wu
43e813a73d Add unique constraint on user_id and name to subscription entity 2023-01-09 15:12:26 +08:00
Hongbo Wu
08e0423939 Add unique constraint on user_id and name to subscriptions table 2023-01-09 15:04:01 +08:00
Hongbo Wu
892a9ef30d Add subscriptionCount and createdAt in NewsletterEmail type 2023-01-09 12:24:45 +08:00
Hongbo Wu
3c8416ca1b
Merge pull request #1620 from omnivore-app/fix/sign-up 
Log email content if Sendgrid api key not set
 2023-01-06 15:39:33 +08:00
Hongbo Wu
9762b14ebc Check if the env is local 2023-01-06 15:28:45 +08:00
Jackson Harper
3520428ff0 Get the auth token from cookie in the user_router 
This is called through Cloud Task so .authorization is actually
Cloud Task's auth token.
 2023-01-06 10:29:36 +08:00
Hongbo Wu
d86a6038ea Log email content if Sendgrid api key not set 2023-01-06 09:54:02 +08:00
Jackson Harper
88b6fcfb5d Use cookie auth instead of header as GCP uses the Authorization header 2023-01-05 20:17:43 +08:00
Hongbo Wu
24763669b3
Merge pull request #1616 from omnivore-app/html-to-markdown 
html to markdown
 2023-01-05 19:30:19 +08:00
Hongbo Wu
e28c9b10bb Fetch markdown content if specified in search API 2023-01-05 17:17:09 +08:00
Jackson Harper
b0938ea8e2
Merge pull request #1612 from omnivore-app/feat/email-after-import 
Send email to user after a bulk import completes
 2023-01-05 13:39:49 +08:00
Hongbo Wu
7b749f974d Convert HTML to markdown if specified 2023-01-05 12:12:48 +08:00
Jackson Harper
89454d8b59
Merge pull request #1610 from omnivore-app/fix/reduce-logging 
Remove some places we are logging too much data causing sentry failures
 2023-01-05 11:19:30 +08:00
Jackson Harper
cfa3b5de89 Remove unneeded linting rules 2023-01-05 10:25:10 +08:00
Jackson Harper
7b2bc21b16 Add cors config, handle exception response 2023-01-04 21:45:41 +08:00
Jackson Harper
d89a307aca Send email to user after a bulk import completes 2023-01-04 18:15:26 +08:00
Jackson Harper
2390f2d716 Cast data to NewsletterMessage 2023-01-04 16:24:41 +08:00
Jackson Harper
686b08733a Comment out tests that cant run in CI 2023-01-04 14:50:14 +08:00
Jackson Harper
e3ed7d0250 More logging changes 2023-01-04 11:23:13 +08:00
Jackson Harper
b438d42f38 Remove some unneeded console.log calls 2023-01-04 11:18:37 +08:00
Jackson Harper
8edd94bdb5 Remove some places we are logging too much data causing sentry failures 2023-01-04 11:07:54 +08:00
Jackson Harper
f939786c2a Reserve some names for tools and landing pages 2023-01-03 20:55:30 +08:00
Jackson Harper
0edd91057e Update user interface for file import tool 2023-01-03 17:49:07 +08:00
Jackson Harper
1b357f8c21 Add a test (have a feeling we will need to disable on CI due to GCS dependency) 2023-01-03 11:07:21 +08:00
Jackson Harper
9314c3d8f1 Add uploadImportFile API method 
Add uploadImportFile API method

Fix prefix, counting max files uploaded

Add resolver types

Basic web ui for the uploader interface

Allow selecting type when uploading import files
 2023-01-03 10:01:59 +08:00
Hongbo Wu
2c39916441 Add wordsCount to article schema 2023-01-02 16:49:11 +08:00
Hongbo Wu
e0b9a6689a Not raise error when there is conflict of setting labels in highlights 2022-12-30 11:22:41 +08:00
Hongbo Wu
e0437008d7 Fix not updating/deleting the right label in the highlight 2022-12-29 22:40:31 +08:00
Hongbo Wu
264ebef46e Fix not setting labels to the correct highlight in a page 2022-12-29 21:34:45 +08:00
Hongbo Wu
7c39db207b Replace createArticle with savePage in puppeteer-parse service 2022-12-28 10:15:05 +08:00