https://github.com/dms-codes/scrape-rigpix

RigPix Icom Radio Data Scraper This Python script is a web scraping tool that extracts information about Icom radios from the RigPix website. It parses the HTML content of the webpage, retrieves data from specific tables, and organizes it into a dictionary for further analysis.
https://github.com/dms-codes/scrape-rigpix

python radio radioamateur rigpix scrape

Last synced: 2 days ago
JSON representation

RigPix Icom Radio Data Scraper This Python script is a web scraping tool that extracts information about Icom radios from the RigPix website. It parses the HTML content of the webpage, retrieves data from specific tables, and organizes it into a dictionary for further analysis.

• Host: GitHub
• URL: https://github.com/dms-codes/scrape-rigpix
• Owner: dms-codes
• Created: 2022-12-24T05:41:39.000Z (about 2 years ago)
• Default Branch: main
• Last Pushed: 2023-09-30T02:53:08.000Z (over 1 year ago)
• Last Synced: 2023-09-30T05:00:46.758Z (over 1 year ago)
• Topics: python, radio, radioamateur, rigpix, scrape
• Language: Python
• Homepage: https://github.com/dms-codes/scrape-rigpix
• Size: 2.93 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# RigPix Icom Radio Data Scraper

This Python script is a web scraping tool that extracts information about Icom radios from the [RigPix](http://www.rigpix.com/icom/icomselect.htm) website. It parses the HTML content of the webpage, retrieves data from specific tables, and organizes it into a dictionary for further analysis.

## Prerequisites

Before you begin, make sure you have the following:

- Python installed on your system.

- Required Python libraries, including `pandas`, `requests`, and `BeautifulSoup (bs4)`. You can install them using the following command:

   ```bash

   pip install pandas requests beautifulsoup4

   ```

## Usage

1. Clone this repository or download the script.

2. Open the script and make the following adjustments as needed:

   - Set the `url` variable to the URL of the RigPix webpage containing Icom radio data.

3. Run the script using the following command:

   ```bash

   python rigpix_icom_scraper.py

   ```

4. The script will fetch the HTML content of the specified webpage and parse it to extract data from tables.

5. It retrieves information about Icom radios and organizes it into a dictionary, where each key represents a category (e.g., "HF Transceivers," "VHF/UHF Transceivers") and the corresponding value is a DataFrame containing the radio models and details within that category.

6. The extracted data is printed to the console as a dictionary.

## Example

Here's an example of what the script's output might look like (simplified for brevity):

```python

{

    'HF Transceivers':              ...,

    'VHF/UHF Transceivers':         ...,

    'Professional Transceivers':    ...,

    'Receivers':                    ...,

    'Accessories':                  ...,

    ...

}

```

Each category contains a DataFrame with radio model details, such as model name, bands, and modes.

## Note

- The script is tailored to extract data from the specific RigPix webpage provided in the `url` variable. If you want to scrape data from a different webpage or website, you may need to adapt the script to the HTML structure of that page.

- Depending on your use case, you can customize the script to save the extracted data to a file, perform further data analysis, or integrate it into other projects as necessary.

Feel free to explore and customize the script to meet your specific requirements or integrate it into other projects as necessary.