https://github.com/dresnite/web-crawler-frontend

⛓ Frontend of a web crawler to extract URLs from other websites
https://github.com/dresnite/web-crawler-frontend

Last synced: 6 days ago
JSON representation

⛓ Frontend of a web crawler to extract URLs from other websites

• Host: GitHub
• URL: https://github.com/dresnite/web-crawler-frontend
• Owner: dresnite
• Created: 2024-02-19T08:13:59.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-02-20T04:27:37.000Z (10 months ago)
• Last Synced: 2024-11-01T13:40:34.672Z (about 2 months ago)
• Language: TypeScript
• Size: 85.9 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Web Crawler Frontend

This project provides the user interface for interacting with the web crawler backend, allowing users to input URLs and extract links from websites. It's built using Next.js, TypeScript, Tailwind CSS, and Redux for state management.

## Installation

To install the project, follow these steps:

1. **Clone the Repository**: Clone the project repository to your local machine using the following command:

    > git clone https://github.com/dresnite/web-crawler-frontend

2. **Install Dependencies**: Navigate into the project directory and install the necessary dependencies using npm:

    > npm install

3. **Set Environment Variables**: Before running the project, you need to set up the `BACKEND_URL` environment variable. This variable should point to the URL of the backend server. 

4. **Start the Development Server**: Once the environment variable is set, you can start the development server using the following command:

    > npm run dev

## Dependencies

The frontend project relies on the following technologies and libraries:

- **Next.js**: Framework for building React applications with server-side rendering.

- **TypeScript**: Typed superset of JavaScript.

- **Tailwind CSS**: Utility-first CSS framework for styling the application.

- **Redux**: State management library for managing application state.

## Backend Dependency

Please note that this frontend project requires the web crawler backend (https://github.com/dresnite/web-crawler-backend) to be running properly. Ensure that the backend server is set up and running before using the frontend application.

Feel free to reach out if you have any questions or need further assistance!

---

**Note**: For detailed information on how to use the backend server, refer to the [backend README](https://github.com/dresnite/web-crawler-backend).