Making the sources self-contained: information related to whether a source is default, recursive or if it requires API keys

Move provider keys into sources

This could have been a problem if the application was used as a library.

* added match/filter

* updated readme

* stored  regexes in private slice

* go mod update

* misc update

* conclude merge

* added unit tests for match/filter regex

* added more test cases

* added (^ and $) while compiling regex

* renaming test

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>

# Conflicts:
#	v2/go.sum
#	v2/pkg/runner/enumerate.go
#	v2/pkg/runner/options.go

Bumps alpine from 3.16.1 to 3.16.2.

---
updated-dependencies:
- dependency-name: alpine
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps golang from 1.18.4-alpine to 1.19.0-alpine.

---
updated-dependencies:
- dependency-name: golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* includes newer version of gologger that support MsgFunc
* removed unused sliceutil dependency

* Sources are now lower cased to prevent such issues happening in the future
* DNSDB was also manually lower cased

* Warn about missing keys
* Displaying the response body of failed request

* If the user has the provider API keys saved in the config.yaml, but doesn't have a provider-config.yaml, then the logic will migrate those keys to the new location.

* BeVigil Source Added

* updated readme.md

* updated .gitignore

* fmt sources

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>

* reasoning: the performance penalty is not that notable, hence it was rather preferred to make it future-proof by preventing potential data races with maps in closures

Sources refactor and bug fixes

Bumps [github.com/projectdiscovery/chaos-client](https://github.com/projectdiscovery/chaos-client) from 0.2.0 to 0.3.0.
- [Release notes](https://github.com/projectdiscovery/chaos-client/releases)
- [Changelog](https://github.com/projectdiscovery/chaos-client/blob/master/.goreleaser.yml)
- [Commits](projectdiscovery/chaos-client@v0.2.0...v0.3.0)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/chaos-client
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* [+] add quake api for subfinder

* syntax improvements

* Update quake.go

* [+] fix status_code field bugs on different operating systems

* Update quake.go

* Update config.go

* quake: reducing the pagination size to the maximum allowed of 500

Co-authored-by: zeroyu <zeroyu.xyz@gmail.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Ice3man <nizamulrana@gmail.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: forgedhallpass <13679401+forgedhallpass@users.noreply.github.com>

…into dev

Bumps [github.com/lib/pq](https://github.com/lib/pq) from 1.10.6 to 1.10.7.
- [Release notes](https://github.com/lib/pq/releases)
- [Commits](lib/pq@v1.10.6...v1.10.7)

---
updated-dependencies:
- dependency-name: github.com/lib/pq
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…_#594

Add integration test for alienvault

…st_#600

Add integration test for hackertarget

Bumps [github.com/projectdiscovery/dnsx](https://github.com/projectdiscovery/dnsx) from 1.1.0 to 1.1.1.
- [Release notes](https://github.com/projectdiscovery/dnsx/releases)
- [Changelog](https://github.com/projectdiscovery/dnsx/blob/master/.goreleaser.yml)
- [Commits](projectdiscovery/dnsx@v1.1.0...v1.1.1)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dnsx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

…re an API key #649

There is no need to check for empty domains, because that is validated at CLI flag validation time.

 * the site now requires a captcha

 * the whole site is down

* the service is down

Remove non-functional "archiveis" source #654

 Remove non-functional "threatcrowd" source #654

…2/dev/github.com/projectdiscovery/dnsx-1.1.1

chore(deps): bump github.com/projectdiscovery/dnsx from 1.1.0 to 1.1.1 in /v2

* CommonCrawl is slow

Create/aggregate tests for providers that do NOT require an API key

…tring per subdomain (#662)

Co-authored-by: Víctor Zamanillo <victor.zamanillo@cifraeducacion.com>

Bumps golang from 1.19.1-alpine to 1.19.2-alpine.

---
updated-dependencies:
- dependency-name: golang
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Bumps [github.com/projectdiscovery/goflags](https://github.com/projectdiscovery/goflags) from 0.1.0 to 0.1.1.
- [Release notes](https://github.com/projectdiscovery/goflags/releases)
- [Commits](projectdiscovery/goflags@v0.1.0...v0.1.1)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/goflags
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

…2/dev/github.com/projectdiscovery/goflags-0.1.1

chore(deps): bump github.com/projectdiscovery/goflags from 0.1.0 to 0.1.1 in /v2

…olang-1.19.2-alpine

chore(deps): bump golang from 1.19.1-alpine to 1.19.2-alpine

…rary

ratelimit library