Commit graph

73 commits

Author SHA1 Message Date
Hongbo Wu
977bd1deda Fix tests 2022-08-05 11:44:02 +08:00
Hongbo Wu
7ce183d6f8 Add soft delete of pages by updating page state to Deleted 2022-07-29 18:10:05 +08:00
Hongbo Wu
83f988bb35 Soft delete articles 2022-07-29 15:53:13 +08:00
Hongbo Wu
07c6214e88 Add DELETED state to the article 2022-07-29 14:08:35 +08:00
Hongbo Wu
edd44fcafc fix get article test 2022-07-14 17:56:55 +08:00
Hongbo Wu
404798a01e use correct index name 2022-07-14 17:08:40 +08:00
Hongbo Wu
4eb55846fd create elastic index if not exists in testing 2022-07-14 16:53:23 +08:00
Hongbo Wu
931c519d44 typeahead searchs by siteName 2022-07-13 10:37:06 +08:00
Hongbo Wu
dc9523e522 add searchAsYouType in elastic 2022-07-12 09:36:00 -07:00
Jackson Harper
9feeb80cf3 Allow fetching original content
This is useful when debugging
2022-07-09 14:35:14 -07:00
Hongbo Wu
41f43b54ab Publish delete event 2022-07-07 12:31:46 +08:00
Hongbo Wu
efd47f3f83 add function to delete pages by param 2022-07-07 11:07:00 +08:00
Hongbo Wu
c08afe6451 Update page updatedAt when updating labels 2022-06-28 12:03:37 +08:00
Hongbo Wu
00f38d1134 Update page updatedAt when updating highlights 2022-06-28 11:55:26 +08:00
Hongbo Wu
59efc5fea7 Add test 2022-06-28 10:14:15 +08:00
Hongbo Wu
bf1faaeea4 Include highlights in search page result in elastic 2022-06-28 09:56:39 +08:00
Hongbo Wu
e96d5552fa Fix search by is:read or is:unread getting empty result by using the correct property name 2022-06-23 12:35:48 +08:00
Hongbo Wu
9a2f4b300a Fix a script error by deleting both labels in pages and highlights 2022-06-20 19:06:50 +08:00
Hongbo Wu
f88083e535
Merge pull request #813 from omnivore-app/advanced-search
advanced search
2022-06-19 10:55:18 +08:00
Hongbo Wu
26e7ab178e Fetch page savedAt, readingProgress from elastic 2022-06-17 17:08:26 +08:00
Hongbo Wu
1be9c980e1 Add savedAt to searchItem and make readingProgress required in elastic 2022-06-17 16:03:49 +08:00
Hongbo Wu
e3c30dd076 Allow matching title, description, content keyword in elastic 2022-06-16 22:15:05 +08:00
Hongbo Wu
40bb49012a Allow match keyword 2022-06-16 22:15:01 +08:00
Hongbo Wu
c5c8763767 Add readAt to searchItem 2022-06-15 09:32:53 +08:00
Jackson Harper
9baeb89742 Add more elastic debugging 2022-06-09 13:52:49 -07:00
Hongbo Wu
520ce0077b Add refresh index method 2022-06-09 12:34:22 +08:00
Hongbo Wu
4cf45af669 Add debug log for deleting label 2022-06-09 12:33:42 +08:00
Hongbo Wu
309c581cf5
Merge pull request #729 from omnivore-app/labels-in-highlights
Support labels in highlights
2022-06-09 09:28:43 +08:00
Hongbo Wu
2dcab66af2 Update labels for both pages and highlights 2022-06-08 17:39:38 +08:00
Hongbo Wu
7c840f5b1e Merge deleteLabel in page and highlight 2022-06-08 17:25:33 +08:00
Hongbo Wu
a981e13c86 Add test case for deleteLabel 2022-06-08 17:01:38 +08:00
Hongbo Wu
22c604c15b Add deleteLabelForHighlights 2022-06-08 15:33:43 +08:00
Hongbo Wu
bdda54d54a Add set Labels For Highlight data access method 2022-06-06 19:15:03 +08:00
Hongbo Wu
577c6e84fb Add readAt to page type 2022-06-04 22:11:14 +08:00
Hongbo Wu
04f7fdc31f Add labels in highlight type 2022-06-01 19:01:26 +08:00
Hongbo Wu
195074fa49 Update search query 2022-06-01 13:49:51 +08:00
Hongbo Wu
a04bfbb83e When searching for highlights we should include document title, description, content as secondary indexes 2022-05-29 22:43:21 +08:00
Hongbo Wu
0ef9bb3944 Allow search by language in elastic 2022-05-26 10:55:20 +08:00
Hongbo Wu
87b0f683e1 Add language term in search body 2022-05-26 10:55:04 +08:00
Hongbo Wu
a702993485 Add search by language query 2022-05-26 10:52:18 +08:00
Hongbo Wu
3e0e8b486f Add language in searchitem 2022-05-26 10:52:18 +08:00
Hongbo Wu
be91562ca1 Add language in page 2022-05-26 10:52:18 +08:00
Hongbo Wu
61065efd2b Add published sort param in elastic query 2022-05-24 18:24:30 +08:00
Hongbo Wu
34349e925c Add unit test 2022-05-19 16:36:35 +08:00
Hongbo Wu
b8225fc8c8 Fix labels not being updated in elastic 2022-05-19 12:08:50 +08:00
Hongbo Wu
f51dbafdfc Stop throwing document not found exception to sentry 2022-05-13 11:40:08 +08:00
Hongbo Wu
afe8b6e948 make savedAt a required field in page 2022-05-04 17:54:59 +08:00
Hongbo Wu
9048ccbab3 Show failed pages in library 2022-05-04 12:46:57 +08:00
Hongbo Wu
2b70d480d2
Remove article saving request (#493)
* Add state and taskName in elastic page mappings

* Add state and taskName in elastic page interface

* Create page with PROCESSING state before scrapping

* Update createArticleRequest API

* Fix tests

* Add default state for pages

* Update createArticle API

* Update save page

* Update save file

* Update saving item description

* Show unable to parse content for failed page

* Fix date parsing

* Search for not failed pages

* Fix tests

* Add test for saveUrl

* Update get article saving request api

* Update get article test

* Add test for articleSavingRequest API

* Add test for failure

* Return new page id if clientRequestId empty

* Update clientRequestId in savePage

* Update clientRequestId in saveFile

* Replace article with slug in articleSavingRequest

* Add slug in articleSavingRequest response

* Depreciate article

* Use slug in web

* Remove article and highlight fragments

* Query article.slug on Prod

* Show unable to parse description for failed page

* Fix a bug having duplicate pages when saving the same url multiple times

* Add state in response

* Rename variables in removeArticle API

* Rename state

* Add state in response in web

* Make state an enum

* Open temporary page by link id

* Use an empty reader view as the background for loading pages

* Progressively load the article page as content is loaded

* Add includePending flag in getArticles API

* Set includePending = true in web

* Add elastic update mappings in migration script

* Add elastic mappings in docker image

* Move index_settings.json to migrate package

* Remove elastic index creation in api

* Move elastic migrations to a separate directory

* Remove index_settings from api docker image

Co-authored-by: Jackson Harper <jacksonh@gmail.com>
2022-04-29 13:41:06 +08:00
Hongbo Wu
71aa66ea9c
Allow search for subscription:name (#461) 2022-04-22 08:47:41 +08:00