https://github.com/link-wolf/arachnida

42 project - Web scrapper and metadta/ExIF extractor
https://github.com/link-wolf/arachnida

42 42born2code 42school cybersecurity javascript js linux

Last synced: about 2 months ago
JSON representation

42 project - Web scrapper and metadta/ExIF extractor

• Host: GitHub
• URL: https://github.com/link-wolf/arachnida
• Owner: Link-Wolf
• Created: 2023-07-24T15:19:14.000Z (almost 3 years ago)
• Default Branch: master
• Last Pushed: 2024-09-24T13:24:55.000Z (almost 2 years ago)
• Last Synced: 2025-01-27T12:49:39.722Z (over 1 year ago)
• Topics: 42, 42born2code, 42school, cybersecurity, javascript, js, linux
• Language: JavaScript
• Homepage:
• Size: 607 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          




 

 

 

 

 

 








  
Arachnida


  


   spider..scorpion..or both


    A web scrapper that extract images and a metadata/ExIF extractor

    


    


    Report Bug

    ·

    Request Feature

  



  Table of Contents

  


    


      Goal

    

    


      Getting Started

      


        
Prerequisites

        
Installation

      

    

    
Usage examples

    
Contributing

  


## Goal



  

	

  



This cybersecurity project is composed by two differents executables.

The first one, spider, is a web scrapper that extract and download images (jpeg, png, gif and bpm) from a website, and is able to act recursively on the links found in the website.

The second one, scorpion, is an ExIF tool that extract metadata from images (jpeg, png, gif and bpm)

> Both are written using NodeJS and use a minimal amount of external libraries, the logic is mostly homemade.

(back to top)


## Getting Started

### Prerequisites

-   [NodeJS](https://nodejs.org/en/download/)

### Installation

1. Clone the repo

    ```sh

    $> git clone https://github.com/Link-Wolf/arachnida.git

    ```

2. Launch one of the two executables

    ```sh

    $> cd arachnida

    $> ./spider [-r] [-l level] [-p path] url

    ```

    > -r : recursive mode

    > -l : level of recursion

    > -p : path to save images

    > url : url to scrap

    ***

    ```sh

    $> cd arachnida

    $> ./scorpion FILE1 [FILE2 ...]

    ```

    > FILE : path to image

(back to top)


## Usage examples

#### Spider

![spider](assets/spider_example.png)

#### Scorpion

![scorpion](assets/scorpion_example.png)

(back to top)


## Contributing

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".

Don't forget to give the project a star! Thanks again!

1. Fork the Project

2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)

3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)

4. Push to the Branch (`git push origin feature/AmazingFeature`)

5. Open a Pull Request

(back to top)