Christopher Gurnee
52d8d69d90
Fix bug/typo in 6d1600f
2022-03-02 16:39:33 -05:00
Christopher Gurnee
fb327e7b94
Fix bug w/0-comment posts introduced in 07c72a2
2022-02-25 13:25:02 -05:00
Christopher Gurnee
cab177c021
Refactor state.js a bit
2022-02-25 10:27:33 -05:00
Christopher Gurnee
aac22ce109
Speed up and clarify the 'load more comments' UI
...
* only rerender the comments after loading and iff something changes
* change text to 'loading...' and make link unclickable while waiting
* if all comments are already loaded, rename to 'load new comments'
2022-02-22 11:56:53 -05:00
Christopher Gurnee
07c72a2e41
Skip reloading existing comments from Pushshift
2022-02-19 13:27:40 -05:00
Christopher Gurnee
6d1600ff01
Use a token bucket to rate-limit the Pushshift API
...
Queries to Pushshift will now be started about as quickly as
permitted, while also reducing 429 responses to a minimum.
2022-02-19 10:28:27 -05:00
Christopher Gurnee
c98f71bd4d
Rewrite api/pushsift/index.js using async/await
...
* much simpler, got rid of recursion
* no more Set temporaries, less copying of arrays
* now returns a Map (thread/index.js need not create it)
2022-02-19 10:25:27 -05:00
Christopher Gurnee
e13b68f90f
Add "max. comments to download" setting
2021-12-01 13:06:01 -05:00
Christopher Gurnee
842061ef2b
More detailed console error messages for debugging
2021-11-03 16:48:18 -04:00
Christopher Gurnee
d9c46d00e7
Be more descriptive with removed comments
2021-10-23 12:58:06 -04:00
Christopher Gurnee
c8b0ac8523
Update the endpoint to api.pushsift.io v4
...
Also update the reddit endpoint for posts, and add the capability
to download from Pushshift in multiple batches, with a binary
backoff; it's currently set to download up to 1,000 comments.
Credit (once again) to @ayan4m1 for a couple snippets of code.
2021-10-16 13:50:08 -04:00
JubbeArt
9568e49c41
25k comments from Pushshift apperently craches the site, changed to 20k instead
2018-08-26 00:44:58 +02:00
JubbeArt
e945ef4c73
Changed retrived comments from Pushshift to 25k from 10k
2018-08-26 00:30:46 +02:00
JubbeArt
c039a67b76
Now shows errors from API in the status box
2018-07-28 21:14:13 +02:00
JubbeArt
d65cbe0d9a
Added readable error messages for all the APIs
2018-07-28 20:56:05 +02:00
JubbeArt
9a151080e1
Replaced absolute import paths with relative paths
2018-07-28 16:58:45 +02:00
JubbeArt
2f40c15c7f
Simplified mutiple parts of the api module to reddit/pushshift
2018-07-15 01:13:31 +02:00
JubbeArt
ea3acd2584
Changed structure to work better with webpack 4s default config
2018-07-14 23:24:23 +02:00
