Commit graph

1504 commits

Author SHA1 Message Date
Collin M. Barrett
09b13ed304 drop batch size
ref #343
2018-08-17 06:33:18 -05:00
Collin M. Barrett
9c954288a7 make base entities abstract 2018-08-16 20:52:45 -05:00
Collin M. Barrett
5a51ac2112 bump batch size back up to 100
ref #343
2018-08-16 19:59:05 -05:00
Collin M. Barrett
888a1340bb minor SnapshotService refactors 2018-08-16 19:26:31 -05:00
Collin M. Barrett
cb95636f1c add proper async try/catch to Agent 2018-08-16 18:07:09 -05:00
Collin M. Barrett
04efb2abca refactor Agent telemetry 2018-08-16 17:53:19 -05:00
Collin M. Barrett
5d14763a0c fix sln from last 2018-08-16 14:37:33 -05:00
Collin M. Barrett
3e0f7b8291 update win webpack batch script 2018-08-16 14:14:58 -05:00
Collin M. Barrett
d5f4f5e7c6 Merge pull request #350 from DandelionSprout/patch-6
Added 1 list and updated links to HTTPS
2018-08-16 18:30:09 +00:00
Collin M. Barrett
0aebb69700 add webpack cmd for windows 2018-08-16 13:27:55 -05:00
Collin M. Barrett
c95fe8ac57 Revert "add vendor-manifest.json to enable npx webpack"
This reverts commit 776c902951.
2018-08-16 13:22:23 -05:00
Collin M. Barrett
f48550622d add vendor-manifest.json to enable npx webpack 2018-08-16 13:17:34 -05:00
Imre Kristoffer Eilertsen
4d5161dbdb Upgraded miscellaneous links to HTTPS 2018-08-16 20:16:49 +02:00
Collin M. Barrett
30bb81a96b npm updates 2018-08-16 12:59:19 -05:00
Collin M. Barrett
5a4cce8ed5 set min page size to 5
ref #329
2018-08-16 12:15:06 -05:00
Collin M. Barrett
daecca1bc1 try really small (5) batch sizes
ref #343
see if tiny batch sizes eliminates duplicate key exceptions
2018-08-16 12:12:40 -05:00
Collin M. Barrett
a6481ae013 try dropping BatchSize by order of magnitude
per https://stackoverflow.com/a/38917034/2343739

ref #343
2018-08-16 07:16:38 -05:00
Collin M. Barrett
31ef536668 Merge pull request #348 from DandelionSprout/patch-4
Some heavier brushup
2018-08-16 11:03:10 +00:00
Imre Kristoffer Eilertsen
e41839ddcb Attempted to fix an incorrect licence ID 2018-08-16 12:59:52 +02:00
Imre Kristoffer Eilertsen
dcb2778480 Edited 2 descriptions
I suddenly woke up after a few hours of sleep and became concerned that the trigger-happy Chinese censors would've blocked access to almost any site that had the word "proxy" on it, incl. FilterLists.com. So I moderated the descriptions for the Chinese proxy lists a bit.
2018-08-16 11:38:19 +02:00
Imre Kristoffer Eilertsen
84594559fa Added Discontinued dates to regional Fanboy lists 2018-08-16 04:42:58 +02:00
Imre Kristoffer Eilertsen
142b2ad404 Assigned "Google Hosts" to Chinese 2018-08-16 03:56:37 +02:00
Imre Kristoffer Eilertsen
923b1fa21a Added 1 new list 2018-08-16 03:55:08 +02:00
Imre Kristoffer Eilertsen
ed641c7926 Added a licence for a new list
I'm not sure what counts as "permissive for adaption", but I've set it to false.
2018-08-16 03:48:58 +02:00
Imre Kristoffer Eilertsen
edb093fd86 Added Discontinued dates, part 2 2018-08-16 03:42:37 +02:00
Imre Kristoffer Eilertsen
03d71f2cea Added Discontinued dates for several dozen lists
And did some other stuff too.
2018-08-16 03:34:59 +02:00
Collin M. Barrett
8ac28d9ec3 move cantSnapshot to seed
ref #200
ref #201
2018-08-15 20:28:02 -05:00
Collin M. Barrett
443cc46545 update column in helper script 2018-08-15 19:48:54 -05:00
Collin M. Barrett
054f4989ea EnsureHttpStatusCodeSaved()
ref #343
2018-08-15 19:44:14 -05:00
Collin M. Barrett
429ed19967 try restarting mysql on every api deploy 2018-08-15 19:31:29 -05:00
Collin M. Barrett
88206fff58 add snapshot record even if snapshot fails
ref #343
2018-08-15 18:58:28 -05:00
Collin M. Barrett
64d652e005 fix location of cantSnapshot script
ref #343
2018-08-15 18:40:44 -05:00
Collin M. Barrett
26bfc6b39d tidy up ef core transaction refactor
ref #343
2018-08-15 18:36:18 -05:00
Collin M. Barrett
ba771e5aea simplify ParseRawRules() 2018-08-15 15:19:38 -05:00
Collin M. Barrett
b5f4200ca5 restore rest of cleanup from 46dffec60a 2018-08-15 15:18:03 -05:00
Collin M. Barrett
dd1efc5757 finish removing added date from summaries endpoint
ref #271
2018-08-15 14:43:48 -05:00
Collin M. Barrett
01538f2eb4 cleanup nullable dates from last 2018-08-15 13:51:32 -05:00
Collin M. Barrett
6ced620dc7 fix up timestamp issues with ef code-first 2018-08-15 12:53:05 -05:00
Collin M. Barrett
55d057c8cd disable sensitive data logging 2018-08-15 10:14:10 -05:00
Collin M. Barrett
f720f83bdb add in-memory caches to rules count endpoint 2018-08-15 10:12:24 -05:00
Collin M. Barrett
db09845c8a tweak snapshot LintRawRule 2018-08-15 09:32:57 -05:00
Collin M. Barrett
c35f1591c6 refactor CollectionExtensions 2018-08-15 08:09:07 -05:00
Collin M. Barrett
8ce576b93c Revert "misc SnapshotService cleanup"
This reverts commit 46dffec60a.
2018-08-15 06:27:52 -05:00
Collin M. Barrett
432fba63b4 misc SnapshotService cleanup
ref #343
2018-08-15 06:04:44 -05:00
Collin M. Barrett
e97bb95dbd continue setting snap as complete on 404
ref #343
2018-08-14 15:43:22 -05:00
Collin M. Barrett
e965bd302c try using EF transactions for snapshots
ref #343
2018-08-14 15:30:51 -05:00
Collin M. Barrett
d8760d9f42 Merge pull request #341 from DandelionSprout/patch-3
Some minor brushups
2018-08-14 17:23:59 +00:00
Imre Kristoffer Eilertsen
5af8ce886f Had forgot to update one list link to HTTPS 2018-08-14 19:11:05 +02:00
Imre Kristoffer Eilertsen
25aea54e7d Ascribed Nano Defender to Jspenguin 2018-08-14 19:09:46 +02:00
Imre Kristoffer Eilertsen
4c5f892a68 Correcting "protcool" typo, part 2 2018-08-14 18:59:35 +02:00