Commit graph

139 commits

Author SHA1 Message Date
Jackson Harper
50b3e38235
Merge pull request #575 from omnivore-app/dependabot/npm_and_yarn/radix-ui/react-avatar-0.1.4
Bump @radix-ui/react-avatar from 0.1.3 to 0.1.4
2022-05-10 10:21:53 -07:00
Jackson Harper
ccc4c3833f
Merge pull request #574 from omnivore-app/dependabot/npm_and_yarn/nodemon-2.0.16
Bump nodemon from 2.0.15 to 2.0.16
2022-05-10 09:44:48 -07:00
dependabot[bot]
f90437db4a
Bump @radix-ui/react-avatar from 0.1.3 to 0.1.4
Bumps [@radix-ui/react-avatar](https://github.com/radix-ui/primitives) from 0.1.3 to 0.1.4.
- [Release notes](https://github.com/radix-ui/primitives/releases)
- [Changelog](https://github.com/radix-ui/primitives/blob/main/release-process.md)
- [Commits](https://github.com/radix-ui/primitives/commits)

---
updated-dependencies:
- dependency-name: "@radix-ui/react-avatar"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-09 21:21:46 +00:00
dependabot[bot]
991bb17115
Bump nodemon from 2.0.15 to 2.0.16
Bumps [nodemon](https://github.com/remy/nodemon) from 2.0.15 to 2.0.16.
- [Release notes](https://github.com/remy/nodemon/releases)
- [Commits](https://github.com/remy/nodemon/compare/v2.0.15...v2.0.16)

---
updated-dependencies:
- dependency-name: nodemon
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-09 21:21:00 +00:00
Hongbo Wu
6f82499deb Merge puppeteer changes 2022-05-09 13:52:40 +08:00
Hongbo Wu
1dffbfc881 Add puppeteer-code dependencies 2022-05-09 13:45:45 +08:00
Hongbo Wu
21799b7b6d Add puppeteer-stealth and puppeteer-ad-block plugin and a user-data-dir to reduce processing time 2022-05-09 13:45:45 +08:00
Jackson Harper
51c25af9ef
Merge pull request #476 from omnivore-app/dependabot/npm_and_yarn/winston-3.7.2
Bump winston from 3.6.0 to 3.7.2
2022-05-02 21:13:49 -07:00
Jackson Harper
f6f523fe1e
Merge pull request #509 from omnivore-app/dependabot/npm_and_yarn/cross-fetch-3.1.5
Bump cross-fetch from 3.1.4 to 3.1.5
2022-05-02 21:13:25 -07:00
dependabot[bot]
98f028ac35
Bump nanoid from 3.3.1 to 3.3.3
Bumps [nanoid](https://github.com/ai/nanoid) from 3.3.1 to 3.3.3.
- [Release notes](https://github.com/ai/nanoid/releases)
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ai/nanoid/compare/3.3.1...3.3.3)

---
updated-dependencies:
- dependency-name: nanoid
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-02 21:15:25 +00:00
Hongbo Wu
2b70d480d2
Remove article saving request (#493)
* Add state and taskName in elastic page mappings

* Add state and taskName in elastic page interface

* Create page with PROCESSING state before scrapping

* Update createArticleRequest API

* Fix tests

* Add default state for pages

* Update createArticle API

* Update save page

* Update save file

* Update saving item description

* Show unable to parse content for failed page

* Fix date parsing

* Search for not failed pages

* Fix tests

* Add test for saveUrl

* Update get article saving request api

* Update get article test

* Add test for articleSavingRequest API

* Add test for failure

* Return new page id if clientRequestId empty

* Update clientRequestId in savePage

* Update clientRequestId in saveFile

* Replace article with slug in articleSavingRequest

* Add slug in articleSavingRequest response

* Depreciate article

* Use slug in web

* Remove article and highlight fragments

* Query article.slug on Prod

* Show unable to parse description for failed page

* Fix a bug having duplicate pages when saving the same url multiple times

* Add state in response

* Rename variables in removeArticle API

* Rename state

* Add state in response in web

* Make state an enum

* Open temporary page by link id

* Use an empty reader view as the background for loading pages

* Progressively load the article page as content is loaded

* Add includePending flag in getArticles API

* Set includePending = true in web

* Add elastic update mappings in migration script

* Add elastic mappings in docker image

* Move index_settings.json to migrate package

* Remove elastic index creation in api

* Move elastic migrations to a separate directory

* Remove index_settings from api docker image

Co-authored-by: Jackson Harper <jacksonh@gmail.com>
2022-04-29 13:41:06 +08:00
dependabot[bot]
e9522e8454
Bump cross-fetch from 3.1.4 to 3.1.5
Bumps [cross-fetch](https://github.com/lquixada/cross-fetch) from 3.1.4 to 3.1.5.
- [Release notes](https://github.com/lquixada/cross-fetch/releases)
- [Commits](https://github.com/lquixada/cross-fetch/compare/v3.1.4...v3.1.5)

---
updated-dependencies:
- dependency-name: cross-fetch
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-29 01:15:08 +00:00
dependabot[bot]
74161ef808
Bump winston from 3.6.0 to 3.7.2
Bumps [winston](https://github.com/winstonjs/winston) from 3.6.0 to 3.7.2.
- [Release notes](https://github.com/winstonjs/winston/releases)
- [Changelog](https://github.com/winstonjs/winston/blob/master/CHANGELOG.md)
- [Commits](https://github.com/winstonjs/winston/commits)

---
updated-dependencies:
- dependency-name: winston
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-25 21:27:58 +00:00
Jackson Harper
282f171b17 Remove react-intl package until we have internationalized code, drops bundle size 2022-04-22 15:12:59 -07:00
Jackson Harper
9362aa54c7
Merge pull request #443 from omnivore-app/dependabot/npm_and_yarn/cookie-0.5.0
Bump cookie from 0.4.2 to 0.5.0
2022-04-22 13:07:59 -07:00
Jackson Harper
17400dfd59
Merge pull request #441 from omnivore-app/dependabot/npm_and_yarn/opentelemetry/api-1.0.4
Bump @opentelemetry/api from 1.0.2 to 1.0.4
2022-04-22 13:07:12 -07:00
Jackson Harper
53e9696302
Merge pull request #440 from omnivore-app/dependabot/npm_and_yarn/cookie-parser-1.4.6
Bump cookie-parser from 1.4.5 to 1.4.6
2022-04-22 13:06:46 -07:00
Hongbo Wu
c3c65479bb add unsubscribe 2022-04-22 12:17:07 -07:00
Hongbo Wu
6842c4c1ad revert yarn.lock changes 2022-04-22 12:16:35 -07:00
Hongbo Wu
2070fa79fa add subscription to articles api response 2022-04-22 12:16:33 -07:00
Jackson Harper
510a95f393 Add topbar dependencies 2022-04-21 14:00:09 -07:00
Jackson Harper
714628587a Add top bar loading indicator to the library 2022-04-21 13:51:20 -07:00
Hongbo Wu
dca6461b62
Add unsubscribe resolver (#453)
* add unsubscribe resolver

* add subscription to articles api response

* revert yarn.lock changes
2022-04-21 13:18:15 +08:00
dependabot[bot]
1b27bf1f4b
Bump cookie from 0.4.2 to 0.5.0
Bumps [cookie](https://github.com/jshttp/cookie) from 0.4.2 to 0.5.0.
- [Release notes](https://github.com/jshttp/cookie/releases)
- [Changelog](https://github.com/jshttp/cookie/blob/master/HISTORY.md)
- [Commits](https://github.com/jshttp/cookie/compare/v0.4.2...v0.5.0)

---
updated-dependencies:
- dependency-name: cookie
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-21 01:43:26 +00:00
dependabot[bot]
e7bb223be9
Bump cookie-parser from 1.4.5 to 1.4.6
Bumps [cookie-parser](https://github.com/expressjs/cookie-parser) from 1.4.5 to 1.4.6.
- [Release notes](https://github.com/expressjs/cookie-parser/releases)
- [Changelog](https://github.com/expressjs/cookie-parser/blob/master/HISTORY.md)
- [Commits](https://github.com/expressjs/cookie-parser/compare/1.4.5...1.4.6)

---
updated-dependencies:
- dependency-name: cookie-parser
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-21 01:43:10 +00:00
Hongbo Wu
83cdec42f7
Add rate limiter for api request (#454)
* Add rate limiter for api request

* apply rate limit on Demo/Prod
2022-04-21 09:41:33 +08:00
dependabot[bot]
e9e4f1bb0e
Bump @opentelemetry/api from 1.0.2 to 1.0.4
Bumps [@opentelemetry/api](https://github.com/open-telemetry/opentelemetry-js-api) from 1.0.2 to 1.0.4.
- [Release notes](https://github.com/open-telemetry/opentelemetry-js-api/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-js-api/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-js-api/compare/v1.0.2...v1.0.4)

---
updated-dependencies:
- dependency-name: "@opentelemetry/api"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-18 21:18:19 +00:00
dependabot[bot]
119a9b553e
Bump async from 2.6.3 to 2.6.4
Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4.
- [Release notes](https://github.com/caolan/async/releases)
- [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md)
- [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4)

---
updated-dependencies:
- dependency-name: async
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-14 18:06:20 +00:00
dependabot[bot]
5e075fc312
Bump @sentry/nextjs from 6.17.7 to 6.19.6
Bumps [@sentry/nextjs](https://github.com/getsentry/sentry-javascript) from 6.17.7 to 6.19.6.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/6.17.7...6.19.6)

---
updated-dependencies:
- dependency-name: "@sentry/nextjs"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-14 15:48:41 +00:00
Jackson Harper
848129233a
Merge pull request #402 from omnivore-app/dependabot/npm_and_yarn/swr-1.3.0
Bump swr from 1.2.2 to 1.3.0
2022-04-12 12:21:54 -07:00
Jackson Harper
fb3f711efb
Merge pull request #378 from omnivore-app/dependabot/npm_and_yarn/next-12.1.4
Bump next from 12.1.0 to 12.1.4
2022-04-12 11:43:42 -07:00
dependabot[bot]
250239e110
Bump swr from 1.2.2 to 1.3.0
Bumps [swr](https://github.com/vercel/swr) from 1.2.2 to 1.3.0.
- [Release notes](https://github.com/vercel/swr/releases)
- [Commits](https://github.com/vercel/swr/compare/1.2.2...1.3.0)

---
updated-dependencies:
- dependency-name: swr
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-12 15:49:48 +00:00
Jackson Harper
035b61665d
Merge pull request #376 from omnivore-app/dependabot/npm_and_yarn/googleapis-100.0.0
Bump googleapis from 59.0.0 to 100.0.0
2022-04-12 08:47:11 -07:00
Jackson Harper
29039d098a
Merge pull request #375 from omnivore-app/dependabot/npm_and_yarn/google-cloud/functions-framework-3.1.0
Bump @google-cloud/functions-framework from 3.0.0 to 3.1.0
2022-04-12 08:46:21 -07:00
Jackson Harper
06360a5993
Merge branch 'main' into OMN-190 2022-04-06 09:24:49 -07:00
Hongbo Wu
7569e988bf
upgrade typeorm to 3.0 (#359)
* upgrade typeorm to 3.0

* use new datasource object in typeorm 3

* fix tests

* fix tests

* migrate before creating connection

* fail the test if migration failed
2022-04-06 10:32:41 +08:00
Jackson Harper
4f4e9a5a99 Remove just the radix package 2022-04-04 16:09:47 -07:00
Jackson Harper
2dfedd54a3 Remove grays and package 2022-04-04 16:03:46 -07:00
dependabot[bot]
28ae767657
Bump next from 12.1.0 to 12.1.4
Bumps [next](https://github.com/vercel/next.js) from 12.1.0 to 12.1.4.
- [Release notes](https://github.com/vercel/next.js/releases)
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js)
- [Commits](https://github.com/vercel/next.js/compare/v12.1.0...v12.1.4)

---
updated-dependencies:
- dependency-name: next
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-04 22:37:12 +00:00
Jackson Harper
206354f11b
Merge pull request #358 from omnivore-app/dependabot/npm_and_yarn/google-cloud/logging-winston-4.2.2
Bump @google-cloud/logging-winston from 4.1.2 to 4.2.2
2022-04-04 15:36:43 -07:00
dependabot[bot]
8df6e750dc
Bump googleapis from 59.0.0 to 100.0.0
Bumps [googleapis](https://github.com/googleapis/google-api-nodejs-client) from 59.0.0 to 100.0.0.
- [Release notes](https://github.com/googleapis/google-api-nodejs-client/releases)
- [Changelog](https://github.com/googleapis/google-api-nodejs-client/blob/main/CHANGELOG.md)
- [Commits](https://github.com/googleapis/google-api-nodejs-client/compare/v59.0.0...googleapis-v100.0.0)

---
updated-dependencies:
- dependency-name: googleapis
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-04 22:36:25 +00:00
Jackson Harper
a4198e34dd
Merge pull request #335 from omnivore-app/dependabot/npm_and_yarn/chrome-aws-lambda-10.1.0
Bump chrome-aws-lambda from 7.0.0 to 10.1.0
2022-04-04 15:36:06 -07:00
dependabot[bot]
452a776aef
Bump @google-cloud/functions-framework from 3.0.0 to 3.1.0
Bumps [@google-cloud/functions-framework](https://github.com/GoogleCloudPlatform/functions-framework-nodejs) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/releases)
- [Changelog](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/compare/v3.0.0...v3.1.0)

---
updated-dependencies:
- dependency-name: "@google-cloud/functions-framework"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-04 22:36:00 +00:00
Jackson Harper
62c3bcd968
Merge pull request #338 from omnivore-app/dependabot/npm_and_yarn/opentelemetry/semantic-conventions-1.0.1
Bump @opentelemetry/semantic-conventions from 0.24.0 to 1.0.1
2022-04-04 15:35:51 -07:00
Jackson Harper
3ae0257e66
Merge pull request #350 from omnivore-app/dependabot/npm_and_yarn/sentry/serverless-6.19.3
Bump @sentry/serverless from 6.16.1 to 6.19.3
2022-04-04 15:35:30 -07:00
dependabot[bot]
3b4254a711
Bump luxon from 1.28.0 to 2.3.1
Bumps [luxon](https://github.com/moment/luxon) from 1.28.0 to 2.3.1.
- [Release notes](https://github.com/moment/luxon/releases)
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md)
- [Commits](https://github.com/moment/luxon/compare/1.28.0...2.3.1)

---
updated-dependencies:
- dependency-name: luxon
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-04-04 17:55:59 +00:00
Jackson Harper
85b247321e Upgrade yarn.lock 2022-04-03 10:22:19 -07:00
Jackson Harper
da28998130 Pull ul list out of newsletter blurb
next/react doesnt want child elements of the paragraphs

Improve formatting

Improve wording

Use buttons in the subscribe directly blocks

Simplify docs on setting up forwarding rules

Add extra padding on bottom of help docs

Remove unused style

Add emails help page

Improve formatting

Prefetch page content on iOS

Reduce the reader overly length now that items are precached

Add invalidation when highlights are added to items

fix missing index_settings.json file in api dockerfile for creating elastic index (#363)

Handle full email address objects in the to param from sendgrid

These come in a format like:

"jacksonh-dfdf@inbox.omnivore.app" <jacksonh-dfdf@inbox-demo.omnivore.app>

New IDs for short highlights because they dont cascade delete now

Testing CI issues

Simplify test

CI test

Use promises for async tests

Temporarily remove test to debug CI

Re-enable

re-enable test, return error

Specify a userId when looking up saved email pages

create a unique url for newsletters without a URL

Use 500ms on page test timeouts

Increase timeout

Dont use deep equal to match newsletter label

Run just the labels API

Run against just the newsletter emails

Run without the page tests

Fix

Set the allow uncaught flag

Remove highlight tests

Remove newsletters tests

more resolver tests

Remove newsetter tests

Comment out resolver tests

Use nock for external requests in tests

Specify puppeteer url for tests

Comment out more tests

uncomment tests

re-enable

re-enable email test

Re-disable

Re-enable one pdf attachment test

Re-disable pdf attachment test

Use promises on setTimeout tests

rm label tests

mv label tests into a context

Comment out pdf tests

Comment out pdf tests

Async test

Async wrappers

Delay when creating test pages

More debugging

Unique short ids

Remove potentially problematic test

Fetch page before returning for test

handler in before block

more debugging

More debugging

Move errors checks into contexts

Use a context when saving newsletters to force index refresh

Prettier fix

Fix newsletter label check, remove setTimeout

Re-enable test

timeout on pdf router handler

Fix method call

comment out PDF test

Unique fake username

Comment out PDF test

Debugging signed urls

Re-enable

New email

pdf test

PDF tests

Comment out pdf test

Add nock stubs for email URLs

Use full address for PDF test

Remove debug

Use full email addresses
2022-04-02 16:56:24 -07:00
dependabot[bot]
b86dbed90c
Bump @google-cloud/logging-winston from 4.1.2 to 4.2.2
Bumps [@google-cloud/logging-winston](https://github.com/googleapis/nodejs-logging-winston) from 4.1.2 to 4.2.2.
- [Release notes](https://github.com/googleapis/nodejs-logging-winston/releases)
- [Changelog](https://github.com/googleapis/nodejs-logging-winston/blob/main/CHANGELOG.md)
- [Commits](https://github.com/googleapis/nodejs-logging-winston/compare/v4.1.2...v4.2.2)

---
updated-dependencies:
- dependency-name: "@google-cloud/logging-winston"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-03-31 06:46:41 +00:00
dependabot[bot]
5ee137d007
Bump @sentry/serverless from 6.16.1 to 6.19.3
Bumps [@sentry/serverless](https://github.com/getsentry/sentry-javascript) from 6.16.1 to 6.19.3.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/master/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/6.16.1...6.19.3)

---
updated-dependencies:
- dependency-name: "@sentry/serverless"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-03-31 02:48:02 +00:00