https://github.com/bterone/g-searcher

G-Searcher is a dedicated Google Web Crawler! You can upload a CSV containing all your words and let G-Searcher do the rest!
https://github.com/bterone/g-searcher

elixir phoenix phoenix-framework

Last synced: 8 months ago
JSON representation

G-Searcher is a dedicated Google Web Crawler! You can upload a CSV containing all your words and let G-Searcher do the rest!

• Host: GitHub
• URL: https://github.com/bterone/g-searcher
• Owner: bterone
• Created: 2020-10-13T12:35:07.000Z (over 5 years ago)
• Default Branch: develop
• Last Pushed: 2023-03-05T18:28:28.000Z (over 3 years ago)
• Last Synced: 2025-03-13T19:15:54.216Z (over 1 year ago)
• Topics: elixir, phoenix, phoenix-framework
• Language: Elixir
• Homepage:
• Size: 6.07 MB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 21
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# GSearcher

![Build Status](https://github.com/bterone/g-searcher/actions/workflows/test.yml/badge.svg)

  
Table of Contents

  


    


      About The Project

      


        
Built With

      

    

    


      Getting Started

      


        
Prerequisites

        
Installation

      

    

  


## About The Project

G-Searcher is a Google Web Scraper. You upload a CSV with all the keywords you want searched, and let G-Searcher handle the rest!

- Upload CSV files for massive queries 📝

- Google Authentication 👮‍♀️

- Dedicated API endpoints 🎯

- Advanced filters to search through all your queries 🔎

- Sleek modern dashboard for your data needs 👩‍🏫

### Built With

* [Erlang/OTP 23.2.4](https://www.erlang.org/)

* [Elixir 1.11.3](https://elixir-lang.org/)

* [Phoenix Framework 1.5.5](https://phoenixframework.org/)

## Getting Started

### Prerequisites

You will require

* Docker

* [OAuth 2.0 Credentials](https://developers.google.com/identity/protocols/oauth2)

### Installation

To start G-Searcher:

  * Clone the repo

    ```sh

    git clone https://github.com/bterone/g-searcher

    ```

  * Install dependencies 

    ```sh

    mix deps.get

    ```

  * Start docker container

    ```sh

    docker compose -f docker-compose.dev.yml up -d

    ```

  * Create and migrate your database 

    ```sh

    mix ecto.setup

    ```

  * Install Node.js dependencies with `npm install` inside the `assets` directory

  * Fill in Oauth credientials to `dev.exs`

    ```elixir

    config :ueberauth, Ueberauth.Strategy.Google.OAuth,

      client_id: "",

      client_secret: ""

    ```

  * Start Phoenix endpoint with 

    ```sh

    mix phx.server

    ```

Now you can visit [`localhost:4000`](http://localhost:4000) from your browser.