An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with datacollection

A curated list of projects in awesome lists tagged with datacollection .

https://github.com/HuantWang/FUNDED_NISL

FUNDED is a novel learning framework for building vulnerability detection models.

datacollection graphneuralnetwork machine-learning vulnerability-detection

Last synced: 07 May 2025

https://github.com/sfu-db/apiconnectors

A curated list of example code to collect data from Web APIs using DataPrep.Connector.

configfile connector datacollection dataconnector dataprep example webapis webdata

Last synced: 05 Jul 2025

https://github.com/microsoft/sdndiagnostics

SdnDiagnostics is a PowerShell module that is designed to simplify the diagnostic troubleshooting and data collection process when troubleshooting issues related to Microsoft Software Defined Network.

21h2 22h2 23h2 azure-stack-hci datacollection diagnostics microsoft network powershell sdn sdn-diagnostics sdn-network sdndiagnostics windows windows-server-2016 windows-server-2019 windows-server-2022 windows-server-2025

Last synced: 04 Aug 2025

https://github.com/amadeus4dev/data-collection

Amadeus for Developers APIs Testing Data Collection

amadeus amadeus-api apis datacollection flights hotels travel

Last synced: 16 Jan 2026

https://github.com/victordibia/cocoafrica

A Curation Tool and Dataset of Common Objects in the Context of Africa

artificial artificial-intelligence datacollection dataset

Last synced: 02 Mar 2026

https://github.com/akimosi/moneycontrolpy

A python API to Money Control forum.

api bs4 datacollection python python3 selenium-python webscraping

Last synced: 14 Dec 2025

https://github.com/nafisalawalidris/fraud-detection-with-supervised-learning

This repository contains a basic fraud detection system utilising supervised learning techniques to identify potentially fraudulent credit card transactions. The project establishes a baseline model that addresses the challenges of credit card fraud in financial institutions.

datacollection datapreprocessing fastapi finance frauddetection machine-learning modeltraining python random-forest-classifier scikitlearn-machine-learning supervisedlearning

Last synced: 14 Jul 2025

https://github.com/nelsonwenner/python-data-sampling-app

:package: The module that allows the collection of data sampling, which is transmitted with WebSocket via WIFI or serial port for CSV file.

arduino csv datacollection pysimplegui python sampling sensors sensors-data-collection serialport thread websocket wifi

Last synced: 25 Apr 2026

https://github.com/alvinkuruvilla/kmlog

A sleek and lightweight Python TUI application to collect typing dynamics data from real people

datacollection keylogging python3 sql yaml

Last synced: 12 Apr 2025

https://github.com/johnbdfilio/bitget-data-collector-10ma

A Python script that collects and stores cryptocurrency price data from the Bitget API into MongoDB time-series collections. This tool is designed to maintain a rolling window of the latest UNLIMITED records for specified trading pairs.

aitrading bitget bitget-api candles crypto cryptocurrency datacollection datacollector timeseries timeseries-forecasting trading-algorithms tradingbot unlimited

Last synced: 13 Aug 2025

https://github.com/willmo103/home-assistant-litedb

A lightweight database solution to store and manage Home Assistant data with support for extended data collection and web-based visualization.

automation datacollection homeassistant iot python sqlite

Last synced: 04 Jan 2026

https://github.com/shuklayash02/personal_finance_analysis

Using power BI, I displayed my peronal finance data savings ,expense and my income

analysis datacollection dataset datavisualization powerbi powerbi-visuals

Last synced: 20 Jan 2026

https://github.com/chouaib-629/webscraping

A collection of web scraping projects using Beautiful Soup, Selenium, and mixed approaches. Each project includes Python scripts and CSV files of the scraped data. Perfect for learning and experimenting with static and dynamic web scraping techniques.

automation beautifulsoup beautifulsoup4 browser-automation csv datacollection dataextraction dynamicwebsite html-parser jupyter-notebook python python-script python3 selenium staticwebsite webscraping

Last synced: 08 May 2026

https://github.com/mishaa931/web-scraping-dot-report-and-saving-data-to-csv

A script to scrap/extract articles about customers from a website . The data is then preprocessed to store in the database for further analysis.

datacollection pythonscript webscraping

Last synced: 07 Jun 2026

https://github.com/binjewarkunal/top-10-worlds-largest-economy-analysis

Top 10 Largest Economies by GDP and GDP Per Capita. Data Collection: Forbes India, Data Visualization: Created a Horizontal Bar Chart and Documention.

data-visualization datacollection microsoft-excel notion

Last synced: 27 Mar 2026

https://github.com/rishikesh-jadhav/track_deep_learning

Data collected from the Udacity simulator comprising RGB images with steering and throttle annotations for each frame, specifically gathered for behavioral cloning purposes.

data datacollection udacity-self-driving-car

Last synced: 03 Jan 2026

https://github.com/binjewarkunal/instagram-market-and-competitor-analysis

In my analysis, I’ve focused on a few key points: ↳ Instagram's position in the social media market, ↳ Identifying key competitors, ↳ Conducting a SWOT analysis, ↳ And suggest new areas of research to further enhance Instagram's market strategy.

data-visualization datacollection microsoft-excel notion

Last synced: 21 Mar 2025

https://github.com/raghavendranhp/youtube_data_harvesting

The "YouTube Data Analyzer" is a versatile tool for businesses and content creators, enabling them to gather, analyze, and harness valuable insights from multiple YouTube channels. With streamlined data collection, storage in MongoDB, migration to SQL, and a user-friendly Streamlit interface, it empowers users to make data-driven decisions

apiintegration data datacollection eda googleapi googleapiclient matplotlib mongodb mysql mysqlconnector numpy oops pandas pymongo python pythonoops sql sqlalchemy streamlit youtube-api

Last synced: 13 Apr 2026

https://github.com/sadratehranian/data-collection-and-machine-learning

create a model using logistic regression to predict whether the fire alarm of a smoke detector should sound or not. Second, predicts whether an electric drive in a production plant may be faulty or not.

data data-analysis data-science datacollection logistic-regression machine-learning ml nn

Last synced: 05 Jan 2026

https://github.com/analyticalnahid/data-acquation

Gather the data from different sources like API, Database, Excel Sheets, Kaggle etc

dataacquisition dataanalysis datacollection datagather

Last synced: 21 Aug 2025

https://github.com/mulaza/billboard-top-100-web-scraper

A web-scraping script that scrapes the🎸 Billboard Top 100 Songs list for song rank🎶, title and artist🎤 and saves them to a .json

datacollection python python3 webscraper webscraping webscrapper

Last synced: 18 May 2026

https://github.com/mchenryspagg/wrangle-and-analyze-data

This project which is known as 'wrangle and analyze data' involves the wrangling of WeRateDogs twitter archive data from the period of 2015 to 2017

api data dataanalysis datacollection datawrangling datetime json numpy os pandas pil python requests tweepy-api visualization

Last synced: 09 Apr 2026

https://github.com/harmanveer-2546/chatgpt-reviews-eda

The data in this EDA consists of daily-updated user reviews and ratings for the ChatGPT Android App. It also contains data on the relevancy of these reviews and the dates they were posted.

calendar chatgpt correlation datacollection droppingirrelevantcolumns eda exploration exploratory-data-analysis insights-data matplotlib mticker pandas python removingduplicates reviews-eda seaborn

Last synced: 14 Apr 2026

https://github.com/rahul-404/image-scraper

This project features an image scraper built with Python, designed to extract images from websites efficiently. Using libraries like BeautifulSoup and Requests, it automates the process, making it easy to gather images for various applications, from data analysis to creative projects.

automation beautifulsoup datacollection datascience imagescraper jupyternotebook opensource python requests techprojects webscraping

Last synced: 01 May 2026

https://github.com/musadiq071/hacker-news_scraper

CLI scraper for Hacker News — get top stories, filter by keyword, save to CSV, or open in browser.

automation cli csv datacollection hacker-news open-source python selenium webscraping

Last synced: 17 May 2026