Commit graph

844 commits

Author SHA1 Message Date
Collin M. Barrett
2bfcecef01 Merge branch 'master' of https://github.com/collinbarrett/FilterLists 2018-01-31 07:17:36 -06:00
Collin M. Barrett
bbabe7c78a add PolicyUrl to FilterList model 2018-01-31 07:17:34 -06:00
Collin Barrett
69e4f00db0 extract lint rules to its own method
probly violating YAGNI atm, but, yeah...
2018-01-31 06:35:14 -06:00
Collin Barrett
e829f46782 strip single backslash from end of rule
throws MySQL exception since it thinks it is escaping closing single quote. may be temporary, should re-evaluate.
2018-01-30 18:17:50 -06:00
Collin M. Barrett
52c9c50452 widen Rule.Raw and tweak varhcar collation 2018-01-30 11:09:54 -06:00
Collin M. Barrett
b8669c1e1a more work on ScrapeService 2018-01-30 10:34:30 -06:00
Collin Barrett
2a9c666637 minor ScrapeService tweaks 2018-01-30 06:18:33 -06:00
Collin Barrett
a1f6783792 async AddOrUpdateRules() 2018-01-30 05:21:54 -06:00
Collin Barrett
5716c93409 rollforward previous work on AddOrUpdateRules() 2018-01-30 05:09:34 -06:00
Collin Barrett
bdfc8e1e20 minor ScrapeService refactors 2018-01-30 05:01:50 -06:00
Collin M. Barrett
308e5f0e6f separate exception handling from logic for GetContent() 2018-01-29 15:30:53 -06:00
Collin M. Barrett
3929298879 move rule parsing to Snapshot class 2018-01-29 15:24:02 -06:00
Collin M. Barrett
a2028cd463 Revert "work on ScrapeService (currently in broken state)"
This reverts commit d14c4f9518.
2018-01-29 15:02:37 -06:00
Collin Barrett
d14c4f9518 work on ScrapeService (currently in broken state) 2018-01-29 06:43:20 -06:00
Collin Barrett
92c004a60a adding rules shouldn't be async 2018-01-28 20:45:52 -06:00
Collin M. Barrett
da24b04804
Create CODE_OF_CONDUCT.md 2018-01-29 01:35:45 +00:00
Collin Barrett
33adbe16a4 work on ScrapeService, use Async suffix convention 2018-01-28 19:26:21 -06:00
Collin Barrett
a8a2e2982e reset migrations
seemed to be an EF bug in adding ModifiedDateUtc to Rules table (result of extracting base entity)
2018-01-28 14:49:50 -06:00
Collin Barrett
6c1c61d631 extract base entity types 2018-01-28 14:40:33 -06:00
Collin Barrett
51ece92f2c Merge branch 'master' of https://github.com/collinbarrett/FilterLists 2018-01-28 12:58:09 -06:00
Collin Barrett
1711171110 extract BaseJunction superclass 2018-01-28 12:58:05 -06:00
Collin M. Barrett
bb6dbac9a9
minor README tweaks 2018-01-28 14:16:45 +00:00
Collin Barrett
2fdb11ddcf make temp scrape endpoint available only on debug
so I don't have to comment/uncomment all the time...
2018-01-28 08:13:13 -06:00
Collin Barrett
2715e36722 more Scraper work 2018-01-27 20:14:46 -06:00
Collin Barrett
b2fb15a20b update README 2018-01-27 17:57:15 -06:00
Collin Barrett
4437655a75 further progress on ScrapeService 2018-01-27 17:35:51 -06:00
Collin Barrett
b9f5cbe148 re-do initial create (fix timestamps) 2018-01-27 12:37:08 -06:00
Collin Barrett
21705b5af9 major db re-design 2018-01-27 11:40:35 -06:00
Collin Barrett
41e5274693 remove not-currently-used memory caching nuget 2018-01-27 08:50:02 -06:00
Collin Barrett
288be2a6c4 hard re-do partialRemoveModDateAndMore migration 2018-01-27 06:52:29 -06:00
Collin Barrett
da18fd793b temp don't migrate/seed on prod 2018-01-27 06:32:58 -06:00
Collin Barrett
e2796fe71c scraper and db updates 2018-01-26 19:44:10 -06:00
Collin Barrett
085831895e got async scraper semi-working 2018-01-26 18:34:53 -06:00
Collin M. Barrett
d2532067ca further work on scraper 2018-01-26 14:13:51 -06:00
Collin M. Barrett
12e5c4e2ca Revert "add snapshot migration"
This reverts commit d15f0144af.
2018-01-26 12:59:40 -06:00
Collin M. Barrett
13fbfabdff begin work on ScrapeService 2018-01-26 12:59:31 -06:00
Collin M. Barrett
d15f0144af add snapshot migration 2018-01-26 11:56:20 -06:00
Collin M. Barrett
929a18ae1f use more descriptive generic type name 2018-01-26 09:59:38 -06:00
Collin M. Barrett
f162dd8f7f make read-only service method no track 2018-01-26 09:57:44 -06:00
Collin M. Barrett
13bda354b4 minor SeedService optimization
per: https://stackoverflow.com/a/48463802/2343739
2018-01-26 09:18:53 -06:00
Collin M. Barrett
1ee069b8a3 add Snapshot entity 2018-01-25 15:44:01 -06:00
Collin M. Barrett
e6d378286b strip out all caching for now (was leaking across endpoints) 2018-01-25 14:36:47 -06:00
Collin M. Barrett
6aeb16b57a update remaining seed data with new formatting 2018-01-25 11:52:27 -06:00
Collin M. Barrett
5ea1656c9d finish seed endpoints 2018-01-25 10:54:22 -06:00
Collin Barrett
45e470f831 simplify SeedService with generics
per: https://stackoverflow.com/questions/48441884/refactor-shared-net-core-api-action-using-generics-and-automapper-to-reduce-dup
2018-01-25 05:46:32 -06:00
Collin Barrett
3326fe0edf optimize async with automapper 2018-01-24 20:11:02 -06:00
Collin Barrett
810e015c4f optimize async with automapper 2018-01-24 20:09:49 -06:00
Collin Barrett
faee08f80d fix async json responses 2018-01-24 19:59:21 -06:00
Collin Barrett
5b99a61954 async all the things, add seed endpoints for entities 2018-01-24 19:30:01 -06:00
Collin M. Barrett
47afbbdaec extract middle level Entity controller for generic Seed method 2018-01-24 07:10:37 -06:00