Commit graph

11611 commits

Author SHA1 Message Date
Hongbo Wu
f467681189
Merge pull request #4235 from omnivore-app/fix/original-html
stop storing original html in the database
2024-08-02 14:53:10 +08:00
Hongbo Wu
8bbf2c0702 add script to update original_content to NULL in db 2024-08-01 11:56:36 +08:00
Hongbo Wu
322f736fe0 stop storing original html in the database 2024-07-31 19:14:38 +08:00
Jackson Harper
07648ae592
Merge pull request #4233 from omnivore-app/dependabot/npm_and_yarn/react-hot-toast-2.4.1
Bump react-hot-toast from 2.2.0 to 2.4.1
2024-07-31 10:43:21 +08:00
Hongbo Wu
d96b22b9b4
Merge pull request #4231 from omnivore-app/dependabot/npm_and_yarn/fast-xml-parser-4.4.1
Bump fast-xml-parser from 4.3.6 to 4.4.1
2024-07-31 10:15:16 +08:00
dependabot[bot]
445839c420
Bump react-hot-toast from 2.2.0 to 2.4.1
Bumps [react-hot-toast](https://github.com/timolins/react-hot-toast) from 2.2.0 to 2.4.1.
- [Release notes](https://github.com/timolins/react-hot-toast/releases)
- [Commits](https://github.com/timolins/react-hot-toast/compare/v2.2.0...v2.4.1)

---
updated-dependencies:
- dependency-name: react-hot-toast
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 21:08:26 +00:00
dependabot[bot]
d0d6c1b164
Bump fast-xml-parser from 4.3.6 to 4.4.1
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 4.3.6 to 4.4.1.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.6...v4.4.1)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 20:56:20 +00:00
Hongbo Wu
bdae03ef95
Merge pull request #4221 from omnivore-app/fix/content-fetch-error
improve content-fetch
2024-07-25 13:40:14 +08:00
Hongbo Wu
156feb8e17 rate limit save url action in redis: max 5 save urls in a minute 2024-07-25 13:08:38 +08:00
Hongbo Wu
c503b47ea2 revert index 2024-07-25 12:10:53 +08:00
Hongbo Wu
ee5e66d9b3
Merge pull request #4075 from omnivore-app/feature/posts
feat: posts api
2024-07-25 11:42:35 +08:00
Hongbo Wu
465e5dc7d1 Add an index of columns user_id and created_at to the library_item table for counting query 2024-07-25 11:18:52 +08:00
Hongbo Wu
6f12b5e406 reduce bulk action batch size to 50 2024-07-25 10:54:21 +08:00
Jackson Harper
2cc35e23b2
Merge pull request #4204 from omnivore-app/dependabot/npm_and_yarn/aws4-axios-3.3.6
Bump aws4-axios from 3.3.4 to 3.3.6
2024-07-25 10:35:56 +08:00
Jackson Harper
261ff11014
Merge pull request #4199 from omnivore-app/dependabot/npm_and_yarn/pkg/extension/braces-3.0.3
Bump braces from 3.0.2 to 3.0.3 in /pkg/extension
2024-07-25 10:33:08 +08:00
Jackson Harper
2c4107d666
Merge pull request #4195 from omnivore-app/dependabot/npm_and_yarn/ws-7.5.10
Bump ws from 7.5.9 to 7.5.10
2024-07-25 10:32:17 +08:00
Jackson Harper
28057a45d6
Merge pull request #4169 from omnivore-app/dependabot/npm_and_yarn/csv-stringify-6.5.0
Bump csv-stringify from 6.4.0 to 6.5.0
2024-07-25 10:28:05 +08:00
Jackson Harper
7295a0052b
Merge pull request #4168 from omnivore-app/dependabot/npm_and_yarn/fast-csv/parse-5.0.0
Bump @fast-csv/parse from 4.3.6 to 5.0.0
2024-07-25 10:27:44 +08:00
Hongbo Wu
dd51500acf
Merge pull request #4222 from omnivore-app/fix/tts-cache
fix: use tts-cache Redis server for tts cache
2024-07-25 10:26:49 +08:00
Hongbo Wu
0a6672416e fix: use tts-cache Redis server for tts cache 2024-07-25 10:22:49 +08:00
Hongbo Wu
0e0c4bddac block failed domains 2024-07-24 16:55:50 +08:00
Hongbo Wu
dee421d3c8 add hour rate limiter middleware to the api router and allows max 600 requests per hour 2024-07-24 16:24:49 +08:00
Hongbo Wu
6776cdf1cd check if there are more than five items "created" within a minute instead of "saved" 2024-07-24 15:59:22 +08:00
Hongbo Wu
31fe4b65a0 remove readability from content-fetch 2024-07-24 12:53:41 +08:00
Hongbo Wu
066883a84d remove unused dependencies 2024-07-24 12:51:25 +08:00
Hongbo Wu
29a5b20d2c remove scrapingbee from content-fetch 2024-07-24 12:17:13 +08:00
Hongbo Wu
284dcfa323
Merge pull request #4212 from omnivore-app/feature/use-gpt-4-o-mini
use new gpt-4o-mini openai model
2024-07-23 14:01:06 +08:00
Hongbo Wu
f87ecbcf18
Merge pull request #4207 from omnivore-app/fix/published-date-change-in-wechat
fix/published date change in wechat
2024-07-23 13:58:17 +08:00
Hongbo Wu
4c1b9a1c4b
Merge pull request #4210 from omnivore-app/fix/self-hosting
add missing lines to build utils dependency to the docker file for self-hosting
2024-07-23 13:57:46 +08:00
Hongbo Wu
ea7f24777a
Merge pull request #4214 from omnivore-app/fix/self-hosting-1
add missing redis env var to docker-compose file
2024-07-23 13:57:17 +08:00
Hongbo Wu
8209b05273
Merge pull request #4146 from omnivore-app/remove-ultra-realistic-voices-in-backend
map realistic voice to openai voice in tts-handler
2024-07-23 11:06:53 +08:00
Hongbo Wu
0c377c370f add missing redis env var to docker-compose file 2024-07-19 15:24:22 +08:00
Hongbo Wu
3f76431c47 use new gpt-4o-mini openai model 2024-07-19 11:45:38 +08:00
Hongbo Wu
228b9df86d add missing lines to build utils dependency to the docker file for self-hosting 2024-07-18 16:26:01 +08:00
dependabot[bot]
5876e4cd66
Bump ws from 7.5.9 to 7.5.10
Bumps [ws](https://github.com/websockets/ws) from 7.5.9 to 7.5.10.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/7.5.9...7.5.10)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-18 04:24:49 +00:00
Hongbo Wu
1f29fcef78
Merge pull request #4208 from omnivore-app/fix/youtube-transcript
fix: youtube transcript not parsed correctly
2024-07-18 12:23:23 +08:00
Hongbo Wu
d9b088cc01 fix tests 2024-07-18 12:22:21 +08:00
Hongbo Wu
b5fe0cb279 remove all the commas in the raw transcript which are added by youtubei 2024-07-18 12:10:45 +08:00
Hongbo Wu
faa3e1d00e upgrade youtubei version to fix the caption parsing error 2024-07-18 12:10:07 +08:00
Hongbo Wu
52341e538f
Merge pull request #4206 from omnivore-app/fix/substack-headings
fix: substack headings are removed because its class name contains header
2024-07-18 11:20:32 +08:00
Hongbo Wu
f2b3a66b72 remove metadata and cover image from content 2024-07-18 11:18:51 +08:00
Hongbo Wu
02280b576b fix: wechat official account articles published date not captured because its format is changed 2024-07-18 10:33:06 +08:00
sywhb
7d2e10ba5f Update generated html 2024-07-17 07:57:11 +00:00
Hongbo Wu
34d8fc54e2 fix: substack headings are removed because its class name contains header 2024-07-17 15:56:09 +08:00
Jackson Harper
fdbd182cc3
Merge pull request #4205 from omnivore-app/fix/login-redirect 2024-07-16 12:56:07 +08:00
Hongbo Wu
df3c16381a fix: revert home redirect path to /home 2024-07-16 12:47:41 +08:00
dependabot[bot]
001b468333
Bump aws4-axios from 3.3.4 to 3.3.6
Bumps [aws4-axios](https://github.com/jamesmbourne/aws4-axios) from 3.3.4 to 3.3.6.
- [Release notes](https://github.com/jamesmbourne/aws4-axios/releases)
- [Commits](https://github.com/jamesmbourne/aws4-axios/compare/v3.3.4...v3.3.6)

---
updated-dependencies:
- dependency-name: aws4-axios
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-15 21:50:38 +00:00
dependabot[bot]
8675edafff
Bump braces from 3.0.2 to 3.0.3 in /pkg/extension
Bumps [braces](https://github.com/micromatch/braces) from 3.0.2 to 3.0.3.
- [Changelog](https://github.com/micromatch/braces/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/braces/compare/3.0.2...3.0.3)

---
updated-dependencies:
- dependency-name: braces
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-14 11:18:58 +00:00
Jackson Harper
cf61b933d4
Merge pull request #4194 from omnivore-app/feat/ios-18
iOS 18 fixes
2024-07-14 19:18:13 +08:00
Jackson Harper
6aeee29988 Return after ineligible error in digest sign up so its raised correctly 2024-07-12 16:58:09 +08:00