Subfinder often missing results from crtsh #666
Description
Describe the bug
Subfinder often fails to retrieve results from crtsh. This doesn't happen all the time, and can sometimes be tricky to reproduce.
Subfinder version
v2.5.3
Complete command you used to reproduce this
subfinder -d keyloop.com -json -silent
Screenshots
Results with crtsh
{"host":"backstage.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"securemail.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"www.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"taf.eu-stage.keyloop.com\ntaf.eu-stage.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"taf-api.eu-dev.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"online-de.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"jira.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"service.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"www2.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"careers.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"ns2.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"backstage-dev.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"host185-59-148-117.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"taf.eu-dev.keyloop.com\ntaf.eu-dev.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"smtp.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"service-dev.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"ns1.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"mail.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"jobs.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"keyloop.com\nwww.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"sip1-eu.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"_netblocks.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"host185-59-148-189.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"host185-59-148-113.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"host185-59-148-196.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"jetbrains-licence.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"service-uat.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"online.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"taf-reports.eu-stage.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"taf-reports.eu-dev.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"backstage-stage.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"associate.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"host185-59-148-178.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"autodiscover.keyloop.com\nmail.keyloop.com\nsmtp.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"sip2-eu.keyloop.com","input":"keyloop.com","source":"crtsh"}
{"host":"taf-api.eu-stage.keyloop.com","input":"keyloop.com","source":"crtsh"}
Results without crtsh
{"host":"securemail.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"ns1.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"online.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"mail.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"host185-59-148-117.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"smtp.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"sip2-eu.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"service.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"associate.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"host185-59-148-113.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"www2.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"jira.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"sip1-eu.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"service-dev.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"ns2.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"taf-reports.eu-stage.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"service-uat.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"jetbrains-licence.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"host185-59-148-189.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"jobs.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"taf-api.eu-dev.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"careers.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"host185-59-148-178.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"www.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"taf-reports.eu-dev.keyloop.com","input":"keyloop.com","source":"alienvault"}
{"host":"host185-59-148-196.in-arpa.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}
{"host":"online-de.keyloop.com","input":"keyloop.com","source":"hackertarget"}
{"host":"_netblocks.keyloop.com","input":"keyloop.com","source":"dnsdumpster"}