ekultek
|
e1897912cc
|
parses the black list on multiple searches now as well, will prompt you or continue
|
2017-11-14 12:55:03 -06:00 |
|
ekultek
|
55b1285809
|
multiple tamper scripts now implemented (issue #149), checks if the status code is a 404 before saying it's XSS vulnerable (issue #147)
|
2017-11-14 11:46:14 -06:00 |
|
ekultek
|
c4af51be6d
|
created a blacklist, when a dork pulls no URLs it will add it to a blacklist, if the dork is in the blacklist and you use it again, it will prompt you if you want to continue or not
|
2017-11-13 20:45:32 -06:00 |
|
ekultek
|
d4c1e2dc1c
|
patch for an issue where the firefox profile would fail, will now specify the binary path if you hit this error (issue #143)
|
2017-11-13 09:48:02 -06:00 |
|
ekultek
|
1eb861ae16
|
patch for a reported issue (private) where if there are no URL's left it will keep going until it hits the max page, will now stop
|
2017-11-11 16:30:03 -06:00 |
|
ekultek
|
77bc6dc956
|
multiple page searching no longer requires Google's API, you can now perform as many requests as you want and get as many links as you want as long as it does not go over 500 pages. Removed a couple dependencies that needed to be there for Google's API
|
2017-11-11 15:11:06 -06:00 |
|
ekultek
|
c740eb6e74
|
full batch functionality added to the searching
|
2017-11-10 11:03:12 -06:00 |
|
ekultek
|
49cfc78d9e
|
patch for an issue where I rolled back a search setting
|
2017-11-09 08:31:29 -06:00 |
|
ekultek
|
e490a1903c
|
removed safe search enabled setting in Google API search
|
2017-11-09 08:26:50 -06:00 |
|
ekultek
|
7734f87e62
|
got rid a of a warning that never should of been there, added a comment:
|
2017-11-07 11:57:56 -06:00 |
|
ekultek
|
b28fd3eac4
|
minor edits to most information, some updates to intel scans verbosity, comment edits to sqlmap
|
2017-11-06 12:25:53 -06:00 |
|
ekultek
|
d1e4e18f80
|
minor edit to the proxy settings, you cannot run a proxy on tor, the latency would be ridiculous
|
2017-11-04 09:11:52 -05:00 |
|
ekultek
|
90ba39f3ed
|
patch for an issue where if the site refuses connection it would keep trying to crawl it (issue #134)
|
2017-11-03 09:49:58 -05:00 |
|
ekultek
|
69fd18d5a5
|
you are now able to use Tor to do the searching by passing the --tor flag, the firefox browser settings will mimic the tor browser settings and you will be able to connect via Tor, be careful, Google does not like Tor. You will also be able to connect to Tor to do the parsing
|
2017-11-02 10:27:08 -05:00 |
|
ekultek
|
bc335fa2d3
|
created a clickjacking scanner that will test a page for an X-Frame-Options header, if the header is not there, then it will create a basic HTML page with that URL as an iframe
|
2017-11-01 21:48:58 -05:00 |
|
ekultek
|
b26d29108c
|
fixes an issue where the geckodriver will not connect, usually means something happened during the installation of it, will now attempt to re-install the geckodriver (issue #132)
|
2017-11-01 10:07:15 -05:00 |
|
ekultek
|
e85c13b2b8
|
minor update to the search.py file, X-Forwarded instead of X-Forward
|
2017-10-31 14:11:05 -05:00 |
|
ekultek
|
3bc428dbd9
|
created a new flag called --x-forward that will add a header to the request called 'X-Forwarded-From' with three random IP addresses
|
2017-10-31 13:19:31 -05:00 |
|
ekultek
|
51db83833b
|
patch for a reported issue where it would fail with from a website with Unicode
|
2017-10-31 13:18:40 -05:00 |
|
ekultek
|
04cd49e722
|
added some new URL's to the skip schema, edited the DDG link to the HTML link, made sure that the URL is not just a protocol before adding to the file
|
2017-10-29 11:46:36 -05:00 |
|
ekultek
|
182e588774
|
patched a privately reported issue that would not allow you to run the blackwidow crawler behind a proxy, forgot a space in the README file
|
2017-10-28 16:53:13 -05:00 |
|
ekultek
|
f75cabb876
|
added a new requirement BeautifulSoup, fixed the crawler will pull all links with an 'a' tag and descriptor of 'href', bumped version number
|
2017-10-28 16:28:18 -05:00 |
|
ekultek
|
ecf067b6bb
|
patch for unicode errors, it appears that selenium isn't formatted to handle unicode errors (as far as I can tell) so the dork that causes the error will be skipped (issue #125)
|
2017-10-27 17:14:08 -05:00 |
|
ekultek
|
6ba7231e82
|
splitting the shell commands via shlex will make the commands more secure, and able to avoid most shell injection instances
|
2017-10-25 16:32:27 -05:00 |
|
ekultek
|
4587ec2c91
|
removed the oauth file, it is no longer needed by the program
|
2017-10-23 22:35:56 -05:00 |
|
ekultek
|
0c291d6d10
|
will now cleanup the leftover junk from being parsed, it seems that sometimes random tags get pulled with the URL
|
2017-10-23 22:27:01 -05:00 |
|
ekultek
|
d590ca22db
|
patch for an issue where when a proxy is passed without the protocol it will create an issue (issue #118), also fixes an issue with the sqlmap arguments you no longer need to pass 'true' or 'false' it will do it automatically for you (issue #123)
|
2017-10-22 19:59:31 -05:00 |
|
ekultek
|
e2287391c3
|
created a whois lookup search. Will either display it in human readable form with the correct flags, or save the found information to a log file
|
2017-10-21 10:16:16 -05:00 |
|
ekultek
|
b2ff3da457
|
the auto fix for program install error was in the wrong spot (issue #115), moved to correct spot. should work fine now
|
2017-10-19 18:30:17 -05:00 |
|
ekultek
|
a1426ea0a1
|
had some time so making some compatibility updates (issue #7). Also edited the auto issue, you'll have your own unique ID number now
|
2017-10-19 07:14:51 -05:00 |
|
ekultek
|
02a9f54544
|
created two new flags, one for parsing webcache, another for pulling all URLs. This will also produce more results per search.
|
2017-10-18 13:04:09 -05:00 |
|
ekultek
|
a17b2745d9
|
must pass a checksum verification before you can create a github issue
|
2017-10-17 15:12:32 -05:00 |
|
ekultek
|
1c24a4b4af
|
some minor edits done to the prorgam, grammar fixes, moved some functions, edited some things, nothing to major or important
|
2017-10-17 13:33:40 -05:00 |
|
ekultek
|
ea884a8138
|
some updates that include a script to re-install a dependency that tends to fail, and fix a proxy configuration issue
|
2017-10-17 09:05:10 -05:00 |
|
ekultek
|
a909ac6c74
|
updating some doc strings, will be updating them more in time. just wanted to go ahead and start on them for now
|
2017-10-16 10:03:35 -05:00 |
|
ekultek
|
fc782c71fb
|
patches an issue where zeus would only install one geckodriver version (issue #103)
|
2017-10-16 09:39:52 -05:00 |
|
ekultek
|
5375c15b9e
|
patches an issue where Zeus will always install the same geckodriver version (issue #102)
|
2017-10-15 09:10:51 -05:00 |
|
ekultek
|
65716493e7
|
added new geckodriver versions for different firefox versions, hoping this will help some what with issue #99 (at least until I can figure out a solid fix). will also now extract the gecko version installed for the auto-issues
|
2017-10-14 14:56:45 -05:00 |
|
ekultek
|
f3a5621d86
|
updated the auto issue to provide the firefox browser version as well
|
2017-10-14 09:26:33 -05:00 |
|
ekultek
|
37f1669596
|
update to the geckodriver versions, it will extract the one that is correct for your system
|
2017-10-13 13:39:09 -05:00 |
|
ekultek
|
24cdc14e9e
|
minor patch to catch the geckodriver error, happens when firefox is not compatible (issue #94)
|
2017-10-13 13:15:46 -05:00 |
|
ekultek
|
bef138e4a8
|
patch for an issue where there HTML could not be parsed due to fake div classes (issue #91)
|
2017-10-13 10:10:20 -05:00 |
|
ekultek
|
6383abf69a
|
patch for an issue where to many sessions would be open, will now auto clean the sessions (issue #92)
|
2017-10-13 10:06:57 -05:00 |
|
ekultek
|
307751e14f
|
patch for an issue where the current URL could not be pulled due to a present alert (issue #81)
|
2017-10-12 17:53:45 -05:00 |
|
ekultek
|
c35fddb4ce
|
just cleaning up the parameters a little bit, not as messy now
|
2017-10-12 11:59:59 -05:00 |
|
ekultek
|
80d9565585
|
files edited to reflect the move of the settings, errors, and tamper scripts folders
|
2017-10-10 17:01:13 -05:00 |
|
ekultek
|
5767f2e974
|
successfully extracts the URL from Google ban URL (issue #13)
|
2017-10-10 14:59:23 -05:00 |
|
ekultek
|
37cc3862a8
|
minor changes to the extraction schema
|
2017-10-09 16:45:37 -05:00 |
|
ekultek
|
e43ee8a0ca
|
skips google play and google maps, also extracts correctly from webcache with out error (issue #55)
|
2017-10-09 16:09:50 -05:00 |
|
ekultek
|
a10d8d5825
|
minor edit to search.py removed sqlmap_api_directions.txt
|
2017-10-09 10:56:25 -05:00 |
|