这是indexloc提供的服务,不要输入任何密码
Skip to content

Conversation

@forgedhallpass
Copy link
Contributor

@forgedhallpass forgedhallpass commented Aug 10, 2022

Improvements:

  1. Significant refactor around sources:
  • providers are now self-contained
  • the new interface and key storage makes adding and maintaining sources more straight forward
  1. Improved filtering:
  • combining different filtering options are now working together. This enables more advanced selection of sources (e.g. use all the recursive sources except a specified sub-list)
  1. Added debug messages to make troubleshooting easier:
  • display correctly configured and requested API keys
  • display error message when a source requiring an API key was selected, without providing a key
  • display error messages from providers (e.g. bad API key)
  • display which exact sources were selected for the current scan
  1. Go version update to 1.18

Bug fixes:

  • Assign default resolvers to resolvers instead of recursive sources
  • Also include the chinaz source when all the sources are requested
  • Change the fullhunt provider key to expect YAML instead of JSON
  • Handle source name case sensitivity issues

This could have been a problem if the application was used as a library.
@forgedhallpass forgedhallpass marked this pull request as ready for review August 11, 2022 14:44
# Conflicts:
#	v2/go.sum
#	v2/pkg/runner/enumerate.go
#	v2/pkg/runner/options.go
* includes newer version of gologger that support MsgFunc
* removed unused sliceutil dependency
Copy link
Member

@ehsandeep ehsandeep left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@forgedhallpass

echo example.com | ./subfinder -s DNSDB -v
echo example.com | ./subfinder -s dnsdb -v

Both results into

[WRN] There is no source with the name: 'dnsdb'

* Sources are now lower cased to prevent such issues happening in the future
* DNSDB was also manually lower cased
* Warn about missing keys
* Displaying the response body of failed request
@forgedhallpass
Copy link
Contributor Author

@forgedhallpass

echo example.com | ./subfinder -s DNSDB -v
echo example.com | ./subfinder -s dnsdb -v

Both results into

[WRN] There is no source with the name: 'dnsdb'

Good catch. That was the only source that was not lower case. The issue is now fixed and I've also added extra debug information to help with the troubleshooting.

Case 1 - Missing API key for the selected source:

image

Case 2 - Bad API key:

image

forgedhallpass and others added 4 commits August 22, 2022 21:02
* If the user has the provider API keys saved in the config.yaml, but doesn't have a provider-config.yaml, then the logic will migrate those keys to the new location.
* BeVigil Source Added

* updated readme.md

* updated .gitignore

* fmt sources

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
* reasoning: the performance penalty is not that notable, hence it was rather preferred to make it future-proof by preventing potential data races with maps in closures
@forgedhallpass forgedhallpass merged commit fdb883a into dev Aug 25, 2022
@forgedhallpass forgedhallpass deleted the refactor branch August 25, 2022 10:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants