netlas-cookbook

The goal of this guide is very simple - to teach anyone interested in cyber security, regardless of their knowledge level, how to make the most of Netlas.io.
https://github.com/netlas-io/netlas-cookbook

Last synced: about 21 hours ago
JSON representation

Search Query Syntax
- Regular Expressions
- Looking for Websites That Contain a Certain Word in Their Title
  - Elasticsearch - based databases.
  - Netlas.io
- Filters (Fields)
- Fuzziness
  - Fuzzines
  - Try in Netlas
- Other Netlas.io Search Features
- Logical Operators
- Ranges
  - Try in Netlas
  - Try in Netlas
- Wildcards
  - Try in Netlas
  - Try in Netlas
Re package
- Bash
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
Simple Usage Examples
- Getting Information About IP or Domain
  - Domain information gathering
  - Netlas.io IP/Domain info
- Search for Non-Latin Domains
  - Punycode convert
  - Charset.org
- Looking for Websites That Contain a Certain Word in Their Title
  - Search by http title
  - Try in Netlas
- - →
API Requests
- Other Netlas.io Search Features
  - API Documentation →
- How to Find the API-key?
  - Profile page
  - profile page
- Tools for Debugging API Requests
- Structure of Netlas API JSON Response
  - JSON API response
- Tools for Working with Data in JSON Format
  - JSON Eveluator
  - JSON Path Online Evaluator
- Netlas Python Library
  - Netlas-Python library Github repo
  - Netlas Github
- Netlas Python Response Datatypes
- Netlas CLI Tools
  - Netlas CLI Tools
  - Netlas Scripts
- Examples for Other Programming Languages
- JQ Utility
  - JQ utility documentation
- AI Tools for Writing Code
  - You.com
  - ChatGPT
  - Code Llama
  - You.com
  - You.com
- Code Checkers
Using Netlas.io for OSINT (Open Source Intelligence)
- Code Checkers
  - OSINT Flowchart
- Search Person's Nickname or Email in WHOIS Contacts
- Search for Person's Nickname or Email in Title and Body of Web Page
- Search for "Juicy Info Files" on Subdomains of the Company's Website
- Phone Number Mentions Search
- Search File Mentions (Looking for Content That May be Infringing on Copyrights)
- Domain WHOIS Information Gathering
- Search Location in \<address\> Tag
- Search Author Name in Meta Tags
- Search by FTP Server's Banners Text
- Search for Contact Information in SSL Certificates
- Using Netlas as an Alternative to the WayBack Machine
- 9 Ways to Search Related Websites
Scraping (Extract Data from Web Page Body)
- Beatifulsoup Package
  - Beatiful soup scraping
  - Beatifulsoup
- Re Package
  - Re scraping
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - UI Bakery Regex Library
  - Regex 101
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Regex Lib
  - Re - installed Python package for searching and retrieving data using regular expressions. It is useful for extracting contact information from web pages and many other tasks. Let's look at an example of how it works.
- Other Python Packages for Scraping
  - Scrapy
  - PDFtoText - tool for extracting text content from PDF files.
  - pyChatGPT - unofficial package for interaction with CHATGP (does not require OpenAI API key), which allows analyzing text information with AI.
  - Selenium
Using Netlas.io for Crypto Investigations
- Search Mining Farms
- Search for Websites Infected with Cryptominers
  - Search website injected with miners
  - Maining farms search Python
- Search Vulnerable Bitcoin Nodes
  - Search bitcoin nodes
  - Search bitcoin nodes Python
Using Neltas for Pentest
- Subdomain Search
- Search for Sites with Specific Vulnerabilities
- Search for Sites with Vulnerabilities That Contain a Certain Word in Their Descriptions
- Search by Server HTTP Header
- Search for Vulnerable Servers by Favicon Hash
- Search for Vulnerable Servers by Tag Name
- Search for Vulnerable Servers and Devices Near You (or Any Other Location)
- Search for Login/Admin Panels
  - Admin panels search
- Search for Vulnerable Database Admin Panels
- Search for Sites Vulnerable to SQL Injection
- Search Vulnerable Bitcoin Nodes
  - OpenCVE
  - VulDB
  - OpenCVE
  - CVE Details
  - Twitter - io/netlas-dorks) Github repository.
IoT Search: 9 Basic Ways
- Search by Title
- Search Inside Body
  - Iot Body Search
- Search by Port Number
- Search by Banner
- Search by Favicon
  - Iot favicon search
  - Try in Netlas
- Search by Server Headers
  - Iot headers search
  - Try in Netlas
- Search by Cookies
  - Iot cookie search
  - Try in Netlas
- Search by Tag
- Additional Search Filters
  - Netlas Dorks
Using Netlas.io for Darknet Research
- Tor Exit Nodes Search
  - Tor exit nodes information gathering
  - Tor Project's list of exit nodes
- Collecting Links to .onion Sites
  - Onion links collecting
Files, Backups and Logs Directories Search
- Collecting Links to .onion Sites
  - Directory search
Using Netlas.io for Digital Forensics and Incident Response
- SMTP Servers Information Gathering
  - SMTP banner search
  - SMTP banner search Python
- Search for Domains That Could Potentially Be Used for Phishing
- Favicon Search
- Search for Domains Associated with a Specific Subnet
- Search for Servers with Malicious Software
  - Malware search
  - Malware search Python
Search for Technologies and Code Examples
- Search for Servers with Malicious Software
  - Netlas for web designers
Using Netlas.io for Fun or Netstalking
- Search for Servers with Malicious Software
  - Telnet banner
Common Problems
- Error 429 - Too Frequent Requests
- KeyError
  - Key error
- Saving Data in CSV Format
  - Save data in CSV
  - CSV
- Decoding Punycode Domains
  - Decoding Punycode domains
- Removing HTML Tags from HTTP Body
  - Certificates search
- Saving Data in Other Formats
  - PyPDF - generate PDF files.
  - PythonPPTX - generate Microsoft Power Point Presentations.
  - PythonDOCX - generate Microsoft Word files.
  - XLSXWriter - generate Microsoft Excel files.
Working with Very Large Amounts of Data
- Removing HTML Tags from HTTP Body
  - Datastore
  - Netlas Datastore
Regular expressions
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
- How regular expressions can be useful in OSINT. Theory and some practice using Google Sheets
Uncategorized
- Uncategorized
Looking for websites that contain a certain word in their title
- Try in Netlas
Filters (Fields)
- Try in Netlas
Logical operators
- Try in Netlas
- Try in Netlas
Ranges
- Try in Netlas
- Try in Netlas
Wildcards
- Try in Netlas
- Try in Netlas
Fuzziness
- Try in Netlas
Tools for debugging API requests
- Search history
  - ExtendClass Online Rest Client
Tools for working with data in JSON format
- Search history
  - JSON Path Finder
AI tools for writing code
- Bash
  - ChatGPT
Code checkers
- Bash
  - PythonChecker
Search person's nickname or email in WHOIS contacts
- Bash
  - Try in Netlas
Search person's nickname or email in title and body of web page
- Bash
  - Try in Netlas
Search links to "juicy info files" on subdomains of the company's website
- Bash
  - Try in Netlas
Phone number mentions search
- Bash
  - Try in Netlas
Search file mentions (looking for content that may be infringing on copyrights)
- Bash
  - Try in Netlas
Search location in \<address\> tag
- Bash
  - Try in Netlas
Search author name in meta tags
- Bash
  - Try in Netlas
Search by FTP server's banners text
- Bash
  - Try in Netlas
Search for contact information in SSL certificates
- Bash
  - Try in Netlas
9 ways to search related websites
- Bash
To be contininued... Stay tuned!
- Default logins and passwords
  - Medium
  - Medium
  - Medium
  - Telegram
  - Medium
  - Linkedin
  - @cyb_detective
  - Medium
  - Medium
  - Medium
  - Medium
Search mining farms
- Bash
  - Try in Netlas
Search vulnerable Bitcoin nodes
- Bash
  - Twitter - io/netlas-dorks) Github repository.
Search subdomains
- Bash
  - Try in Netlas
Search for sites with specific vulnerabilities
- Bash
  - Try in Netlas
Search for sites with vulnerabilities that contain a certain word in their descriptions
- Bash
  - Try in Netlas
Search by server http header
- Bash
  - Try in Netlas
Search servers with CVEs by favicon hash
- Default logins and passwords
  - Try in Netlas
Search servers with CVEs by tag name
- Default logins and passwords
  - Try in Netlas
Search vulnerable servers and devices near you (or any other location)
- Default logins and passwords
  - Try in Netlas
Search for sites vulnerable to SQL injection
- Default logins and passwords
  - Try in Netlas
Search by http.title
- Default logins and passwords
  - Try in Netlas
  - Try in Netlas
Search by port
- Default logins and passwords
  - Try in Netlas
  - Try in Netlas
Search by banner
- Default logins and passwords
  - Try in Netlas
  - Try in Netlas
Search by favicon
- Default logins and passwords
  - Try in Netlas
Search by server headers
- Default logins and passwords
  - Try in Netlas
Search by cookies
- Default logins and passwords
  - Try in Netlas
Search by tag
- Default logins and passwords
  - Try in Netlas
Search for domains that could potentially be used for phishing
- Default logins and passwords
  - Try in Netlas
Favicon search
- Default logins and passwords
Search for domains associated with a specific subnet
- Default logins and passwords
  - Try in Netlas
Attack Surface Management
- Removing HTML Tags from HTTP Body
  - Complete Guide on Attack Surface Discovery
  - Best Attack Surface Visualization Tools
Acknowledgments
- Removing HTML Tags from HTTP Body
  - @cyb_detective

Programming Languages

Python 3 C 1 Java 1

Categories

Search Query Syntax 86 Scraping (Extract Data from Web Page Body) 64 Using Netlas.io for OSINT (Open Source Intelligence) 46 Using Neltas for Pentest 39 API Requests 32 IoT Search: 9 Basic Ways 21 Using Netlas.io for Digital Forensics and Incident Response 15 Common Problems 12 To be contininued... Stay tuned! 11 Uncategorized 9 Regular expressions 8 Re package 8 Using Netlas.io for Crypto Investigations 7 Simple Usage Examples 7 Using Netlas.io for Darknet Research 3 Favicon search 3 9 ways to search related websites 3 Wildcards 2 Search by http.title 2 Search by banner 2 Working with Very Large Amounts of Data 2 Search by port 2 Attack Surface Management 2 Ranges 2 Logical operators 2 Files, Backups and Logs Directories Search 1 Looking for websites that contain a certain word in their title 1 Tools for debugging API requests 1 Search vulnerable Bitcoin nodes 1 Search for Technologies and Code Examples 1 Search mining farms 1 Using Netlas.io for Fun or Netstalking 1 Search for sites vulnerable to SQL injection 1 AI tools for writing code 1 Search location in \<address\> tag 1 Search by server headers 1 Search servers with CVEs by tag name 1 Search for sites with vulnerabilities that contain a certain word in their descriptions 1 Search by FTP server's banners text 1 Search by server http header 1 Search for contact information in SSL certificates 1 Search by cookies 1 Acknowledgments 1 Search person's nickname or email in WHOIS contacts 1 Phone number mentions search 1 Search for domains associated with a specific subnet 1 Fuzziness 1 Search vulnerable servers and devices near you (or any other location) 1 Search by tag 1 Search for sites with specific vulnerabilities 1 Search servers with CVEs by favicon hash 1 Search author name in meta tags 1 Tools for working with data in JSON format 1 Search for domains that could potentially be used for phishing 1 Search file mentions (looking for content that may be infringing on copyrights) 1 Search links to "juicy info files" on subdomains of the company's website 1 Search person's nickname or email in title and body of web page 1 Code checkers 1 Filters (Fields) 1 Search subdomains 1 Search by favicon 1

Sub Categories

Regular Expressions 68 Re Package 58 Default logins and passwords 30 Bash 28 Uncategorized 9 9 Ways to Search Related Websites 9 Search by Server HTTP Header 8 Search Vulnerable Bitcoin Nodes 7 Removing HTML Tags from HTTP Body 6 Other Netlas.io Search Features 5 AI Tools for Writing Code 5 Netlas Python Response Datatypes 5 Favicon Search 4 Search for Domains That Could Potentially Be Used for Phishing 4 Other Python Packages for Scraping 4 Search File Mentions (Looking for Content That May be Infringing on Copyrights) 4 Code Checkers 4 Using Netlas as an Alternative to the WayBack Machine 4 Examples for Other Programming Languages 4 Looking for Websites That Contain a Certain Word in Their Title 4 Search for "Juicy Info Files" on Subdomains of the Company's Website 4 Search for Servers with Malicious Software 4 Tools for Debugging API Requests 4 Search for Sites with Specific Vulnerabilities 4 Search by Tag 4 Saving Data in Other Formats 4 Search by FTP Server's Banners Text 3 Search by Banner 3 Search for Domains Associated with a Specific Subnet 3 Search Person's Nickname or Email in WHOIS Contacts 3 Search for Vulnerable Servers by Tag Name 3 Error 429 - Too Frequent Requests 3 Phone Number Mentions Search 3 Subdomain Search 3 Search Mining Farms 3 Search for Sites Vulnerable to SQL Injection 3 Logical Operators 3 Search for Vulnerable Database Admin Panels 3 Search by Port Number 3 Search Location in \<address\> Tag 3 Search for Contact Information in SSL Certificates 3 Search for Person's Nickname or Email in Title and Body of Web Page 3 Search Author Name in Meta Tags 3 Search for Vulnerable Servers and Devices Near You (or Any Other Location) 3 Filters (Fields) 3 Search for Vulnerable Servers by Favicon Hash 3 Domain WHOIS Information Gathering 3 Search by Title 3 Search for Sites with Vulnerabilities That Contain a Certain Word in Their Descriptions 3 Fuzziness 2 SMTP Servers Information Gathering 2 Netlas Python Library 2 Search history 2 Search by Cookies 2 Ranges 2 Wildcards 2 Search for Websites Infected with Cryptominers 2 Search by Favicon 2 Tools for Working with Data in JSON Format 2 Tor Exit Nodes Search 2 Saving Data in CSV Format 2 How to Find the API-key? 2 Getting Information About IP or Domain 2 Search for Non-Latin Domains 2 Collecting Links to .onion Sites 2 Search by Server Headers 2 Beatifulsoup Package 2 Netlas CLI Tools 2 KeyError 1 Additional Search Filters 1 Search Inside Body 1 Search for Login/Admin Panels 1 Decoding Punycode Domains 1 JQ Utility 1 Structure of Netlas API JSON Response 1

Keywords

osint 3 security-tools 3 elasticsearch 1 java 1 search-engine 1 netlas 1 penetration-testing-tools 1 jq 1 cybersecurity 1 exif 1 exif-data-extraction 1 exif-metadata 1 metadata 1 metadata-information 1 metadata-parser 1 metagoofil 1 osint-email 1 osint-reconnaissance 1 osint-tool 1 osint-tools 1 python 1 python3 1 scraping 1 scraping-python 1 scraping-web 1 security-tool 1 penetration-testing 1