Commit graph

1491 commits

Author SHA1 Message Date
Collin M. Barrett
30bb81a96b npm updates 2018-08-16 12:59:19 -05:00
Collin M. Barrett
5a4cce8ed5 set min page size to 5
ref #329
2018-08-16 12:15:06 -05:00
Collin M. Barrett
daecca1bc1 try really small (5) batch sizes
ref #343
see if tiny batch sizes eliminates duplicate key exceptions
2018-08-16 12:12:40 -05:00
Collin M. Barrett
a6481ae013 try dropping BatchSize by order of magnitude
per https://stackoverflow.com/a/38917034/2343739

ref #343
2018-08-16 07:16:38 -05:00
Collin M. Barrett
31ef536668 Merge pull request #348 from DandelionSprout/patch-4
Some heavier brushup
2018-08-16 11:03:10 +00:00
Imre Kristoffer Eilertsen
e41839ddcb Attempted to fix an incorrect licence ID 2018-08-16 12:59:52 +02:00
Imre Kristoffer Eilertsen
dcb2778480 Edited 2 descriptions
I suddenly woke up after a few hours of sleep and became concerned that the trigger-happy Chinese censors would've blocked access to almost any site that had the word "proxy" on it, incl. FilterLists.com. So I moderated the descriptions for the Chinese proxy lists a bit.
2018-08-16 11:38:19 +02:00
Imre Kristoffer Eilertsen
84594559fa Added Discontinued dates to regional Fanboy lists 2018-08-16 04:42:58 +02:00
Imre Kristoffer Eilertsen
142b2ad404 Assigned "Google Hosts" to Chinese 2018-08-16 03:56:37 +02:00
Imre Kristoffer Eilertsen
923b1fa21a Added 1 new list 2018-08-16 03:55:08 +02:00
Imre Kristoffer Eilertsen
ed641c7926 Added a licence for a new list
I'm not sure what counts as "permissive for adaption", but I've set it to false.
2018-08-16 03:48:58 +02:00
Imre Kristoffer Eilertsen
edb093fd86 Added Discontinued dates, part 2 2018-08-16 03:42:37 +02:00
Imre Kristoffer Eilertsen
03d71f2cea Added Discontinued dates for several dozen lists
And did some other stuff too.
2018-08-16 03:34:59 +02:00
Collin M. Barrett
8ac28d9ec3 move cantSnapshot to seed
ref #200
ref #201
2018-08-15 20:28:02 -05:00
Collin M. Barrett
443cc46545 update column in helper script 2018-08-15 19:48:54 -05:00
Collin M. Barrett
054f4989ea EnsureHttpStatusCodeSaved()
ref #343
2018-08-15 19:44:14 -05:00
Collin M. Barrett
429ed19967 try restarting mysql on every api deploy 2018-08-15 19:31:29 -05:00
Collin M. Barrett
88206fff58 add snapshot record even if snapshot fails
ref #343
2018-08-15 18:58:28 -05:00
Collin M. Barrett
64d652e005 fix location of cantSnapshot script
ref #343
2018-08-15 18:40:44 -05:00
Collin M. Barrett
26bfc6b39d tidy up ef core transaction refactor
ref #343
2018-08-15 18:36:18 -05:00
Collin M. Barrett
ba771e5aea simplify ParseRawRules() 2018-08-15 15:19:38 -05:00
Collin M. Barrett
b5f4200ca5 restore rest of cleanup from 46dffec60a 2018-08-15 15:18:03 -05:00
Collin M. Barrett
dd1efc5757 finish removing added date from summaries endpoint
ref #271
2018-08-15 14:43:48 -05:00
Collin M. Barrett
01538f2eb4 cleanup nullable dates from last 2018-08-15 13:51:32 -05:00
Collin M. Barrett
6ced620dc7 fix up timestamp issues with ef code-first 2018-08-15 12:53:05 -05:00
Collin M. Barrett
55d057c8cd disable sensitive data logging 2018-08-15 10:14:10 -05:00
Collin M. Barrett
f720f83bdb add in-memory caches to rules count endpoint 2018-08-15 10:12:24 -05:00
Collin M. Barrett
db09845c8a tweak snapshot LintRawRule 2018-08-15 09:32:57 -05:00
Collin M. Barrett
c35f1591c6 refactor CollectionExtensions 2018-08-15 08:09:07 -05:00
Collin M. Barrett
8ce576b93c Revert "misc SnapshotService cleanup"
This reverts commit 46dffec60a.
2018-08-15 06:27:52 -05:00
Collin M. Barrett
432fba63b4 misc SnapshotService cleanup
ref #343
2018-08-15 06:04:44 -05:00
Collin M. Barrett
e97bb95dbd continue setting snap as complete on 404
ref #343
2018-08-14 15:43:22 -05:00
Collin M. Barrett
e965bd302c try using EF transactions for snapshots
ref #343
2018-08-14 15:30:51 -05:00
Collin M. Barrett
d8760d9f42 Merge pull request #341 from DandelionSprout/patch-3
Some minor brushups
2018-08-14 17:23:59 +00:00
Imre Kristoffer Eilertsen
5af8ce886f Had forgot to update one list link to HTTPS 2018-08-14 19:11:05 +02:00
Imre Kristoffer Eilertsen
25aea54e7d Ascribed Nano Defender to Jspenguin 2018-08-14 19:09:46 +02:00
Imre Kristoffer Eilertsen
4c5f892a68 Correcting "protcool" typo, part 2 2018-08-14 18:59:35 +02:00
Imre Kristoffer Eilertsen
394e819f3e Correcting "protcool" typo, part 1 2018-08-14 18:58:14 +02:00
Collin M. Barrett
85ddd1d573 cleanup #339 2018-08-13 19:21:21 -05:00
Collin M. Barrett
130723ab48 Merge pull request #339 from DandelionSprout/patch-2
Upgraded supported list links to HTTPS
2018-08-13 23:16:35 +00:00
Collin M. Barrett
1d895455f1 add email notifications for SnapshotService errors
ref #12
2018-08-13 18:14:37 -05:00
Imre Kristoffer Eilertsen
fffd53865d Removed duplicate listing of Turk-Adlist as well 2018-08-14 00:10:50 +02:00
Imre Kristoffer Eilertsen
41cc78b223 Upgraded supported list links to HTTPS 2018-08-13 23:42:24 +02:00
Collin M. Barrett
856ffe09e6 Merge pull request #338 from DandelionSprout/patch-1
Added 3 new lists and 2 software tools
2018-08-13 18:36:08 +00:00
Imre Kristoffer Eilertsen
d4b5b0f0bc Added 2 new software tools 2018-08-13 20:26:17 +02:00
Imre Kristoffer Eilertsen
6845a247e9 Added maintainers for the 3 new lists 2018-08-13 20:21:19 +02:00
Imre Kristoffer Eilertsen
66a16da755 Added 3 new lists, part 1 2018-08-13 20:18:28 +02:00
Collin M. Barrett
328c9441a2 re-add orderby() to list summaries endpoint
still experiencing #244
2018-08-13 12:06:43 -05:00
Collin M. Barrett
b6395458a8 add in-memory caching to all API endpoints
ref #332
2018-08-12 19:46:15 -05:00
Collin M. Barrett
e03bc675d3 add 4-hr in-memory cache for key endpoints
ref #332
2018-08-12 17:23:26 -05:00