SpiderFoot is an OSINT based automatic reconnaissance tool which is capable to gather information about an IP address, Name, Email address and Domain name. SpiderFoot will automatically gather information from over 100 OSINT data source. SpiderFoot is available for both Windows and Linux. you can use SpiderFoot in both ways CLI and GUI, To install SpiderFoot simply follow the steps.


Linux Installation 

SpiderFoot required 2.7 to run it. You can install the python 2.7 with 

apt-get install python2.7

Once you have everything set up you can install the SpiderFoot from its GitHub page. To download and install it open your terminal and type the following command.

git clone https://github.com/smicallef/spiderfoot
cd spiderfoot
pip install -r requirements.txt
python sf.py
After all the command you can use SpiderFoot in GUI version on your localhost with port 5001. Open your browser and type the following address.

http://127.0.0.1:5001
Now Spiderfoot doesn't have API key set for some website like shodan, virus total and hunter. Click on the setting option and it will display all the OSINT data source it uses to gather information if you scroll down you will see a lock icon which means it won't scan with this particular source to remove this lock or to use this source during the scan you need an API key from that sites to get the API keys you have to go the all the site manually and create an account and you can find an API key from settings, for example, you will need an API key for virus total to get your API Key from virus total go to the virus total website and create an account and login to the virus total and click on your username (Top of the right side) and it will show you the option for API key copy the virus total API key and paste it in setting (Find Virus total in setting of spider foot). In the same way, you have to create accounts for all the site and get your API key.

Some most important API key you will need 
Virus total, Hunter.io, Censys, malwarepatrol, shodan, honeypot checker. This is some important website you must have an API key for spider foot.


Honeypot Checker

  1. Go to http://www.projecthoneypot.org
  2. Sign up (free) and log in
  3. Click Services -> HTTP Blacklist
  4. An API key should be listed
  5. Copy and paste that key into the Settings -> Honeypot Checker section in SpiderFoot

SHODAN

  1. Go to http://www.shodanhq.com
  2. Sign up (free) and log in
  3. Click ‘Developer Center’
  4. On the far right, your API key should appear in a box
  5. Copy and paste that key into the Settings -> SHODAN section in SpiderFoot

VirusTotal

  1. Go to http://www.virustotal.com
  2. Sign up (free) and log in
  3. Click your username in the far right and select ‘My API Key’
  4. Copy and paste the key in the grey box into the Settings -> VirusTotal section in SpiderFoot

IBM X-Force Exchange

  1. Go to https://exchange.xforce.ibmcloud.com/new
  2. Create an IBM ID (free) and log in
  3. Go to your account settings
  4. Click API Access
  5. Generate the API key and password (you need both)
  6. Copy and paste the key and password into the Settings -> X-Force section in SpiderFoot

MalwarePatrol

  1. Go to http://www.malwarepatrol.net
  2. Create an account (free) and log in
  3. Click “Open Source” and scroll down to the bottom
  4. Click the “Free” link in the subscription pricing table
  5. Click the free block lists link
  6. You will receive a receipt ID
  7. Copy and paste the receipt ID into the Settings -> MalwarePatrol section in SpiderFoot

BotScout

  1. Go to http://www.botscout.com
  2. Create an account (free) and log in
  3. Under Account Info, your API key will be there
  4. Copy and paste the API key into the Settings -> BotScout section in SpiderFoot

Cymon.io

  1. Go to http://www.cymon.io
  2. Create an account (free) and log in
  3. Under “My API Dashboard”, your API key will be there
  4. Copy and paste the API key into the Settings -> Cymon section in SpiderFoot

Censys.io

  1. Go to http://www.censys.io
  2. Create an account (free) and log in
  3. Click “My Account” (bottom right)
  4. Copy and paste the API Credentials values into the Settings -> Censys section in SpiderFoot

Hunter.io

  1. Go to http://www.hunter.io
  2. Create an account (free) and log in
  3. Click “API” in the top menu-base
  4. Copy and paste the API key into the Settings -> Hunter.io section in SpiderFoot

AlienVault OTX

  1. Go to https://otx.alienvault.com/ and sign up
  2. Log in and click your account on the top right, go to Settings
  3. Scroll down and copy and paste the OTX Key value into the Settings -> AlienVault OTX section in SpiderFoot

Clearbit

  1. Go to https://dashboard.clearbit.com/login and sign up
  2. Log in and click the API link on the left
  3. Copy and paste the “secret” API key into the Settings -> Clearbit section in SpiderFoot

BuiltWith

  1. Go to https://www.builtwith.com and sign up. You get 50 queries for free before having to pay (it’s totally worth it though)
  2. Log in and click on the “Domain API” tab. No other API key type will work with SpiderFoot!
  3. Your API key will appear on the right
  4. Copy and paste it into the Settings -> BuiltWith section in SpiderFoot

FraudGuard

  1. Go to https://fraudguard.io
  2. Register with the plan you choose. The free plan is also available
  3. Click to ‘Create’ an API key, in the form of a username and password
  4. Copy and paste both into the Settings -> Fraudguard section in SpiderFoot

IPinfo.io

  1. Go to https://ipinfo.io
  2. Click on Pricing and select the plan you choose. They offer a very generous free plan with 1,000 queries per day
  3. Click Subscribe, enter your details and follow the registration process
  4. Copy and paste the ‘Access token’ in your Profile to the Settings -> ipinfo.io section in SpiderFoot

CIRCL.LU

  1. Contact CIRCL.LU and ask for Passive DNS and Passive SSL. They are very responsive and will provide you credentials
  2. Enter the credentials into the Settings -> CIRCL.LU section in SpiderFoot

SeccurityTrails

  1. Go to the SecurityTrails pricing page
  2. Select the plan you want and click Sign-up, complete the sign-up process
  3. Enter the provided API key into the Settings -> SecurityTrails section in SpiderFoot

FullContact.com

  1. Go to https://fullcontact.com and follow the sign-up process
  2. Log in to the dashboard and create an API key
  3. Copy and paste the API key into the Settings -> FullContact.com section in SpiderFoot

RiskIQ

  1. Go to https://riskiq.com and click the “Sign up for the Free Edition” link up top
  2. Click Register for the Free Edition
  3. Fill out your details and complete the registration process
  4. Log in
  5. Click your account icon in the top right and go to Account Settings
  6. Go to the “API Access” section and click the “Show” link next to User
  7. Copy the key and secret into the Settings -> RiskIQ section in SpiderFoot


Once you are finished with the API key you can start scanning click on the new scan. give your scan a name and target address (domain, IP, Email)

 You can see all the four option available for scanning you can also see the use of that scan on the right side choice the option according to you and click on the run scan and it will begin scanning. once it's done you can see the result click on the Browse option to see all the gathered information.

Windows Installation

To install the Spider Foot For windows you need to download all the requirements.

1. Git 
3. Pip saves the file with pip.py and runs it with python2.7 installed (python pip.py)

Once you have all the requirements installed in your windows pc you can install the Spiderfoot in your windows pc. open your command prompt and change your current directory where you want to install the Spiderfoot (Desktop) and type the following command in your cmd.

git clone https://github.com/smicallef/spiderfoot
cd spiderfoot
pip install -r requirements.txt
python sf.py
Once it's done you can open your browser with localhost5001.


Click here to join us on Telegram for the latest updatesand share it if you like the post.