Projects in Awesome Lists tagged with datacollection
A curated list of projects in awesome lists tagged with datacollection .
https://github.com/HuantWang/FUNDED_NISL
FUNDED is a novel learning framework for building vulnerability detection models.
datacollection graphneuralnetwork machine-learning vulnerability-detection
Last synced: 07 May 2025
https://github.com/sfu-db/apiconnectors
A curated list of example code to collect data from Web APIs using DataPrep.Connector.
configfile connector datacollection dataconnector dataprep example webapis webdata
Last synced: 05 Jul 2025
https://github.com/microsoft/sdndiagnostics
SdnDiagnostics is a PowerShell module that is designed to simplify the diagnostic troubleshooting and data collection process when troubleshooting issues related to Microsoft Software Defined Network.
21h2 22h2 23h2 azure-stack-hci datacollection diagnostics microsoft network powershell sdn sdn-diagnostics sdn-network sdndiagnostics windows windows-server-2016 windows-server-2019 windows-server-2022 windows-server-2025
Last synced: 04 Aug 2025
https://github.com/amadeus4dev/data-collection
Amadeus for Developers APIs Testing Data Collection
amadeus amadeus-api apis datacollection flights hotels travel
Last synced: 16 Jan 2026
https://github.com/victordibia/cocoafrica
A Curation Tool and Dataset of Common Objects in the Context of Africa
artificial artificial-intelligence datacollection dataset
Last synced: 02 Mar 2026
https://github.com/akimosi/moneycontrolpy
A python API to Money Control forum.
api bs4 datacollection python python3 selenium-python webscraping
Last synced: 14 Dec 2025
https://github.com/banaankiamanesh/dl-for-navigation
Implementation of Regression Models on Navigation with IMUs.
9-axis-imu ahrs bno055 bosch cpp datacollection deeplearning imu knn-regression navigation neural-networks python python3 raspberry-pi recurrent-neural-network recurrent-neural-networks regression-models support-vector-regression tensorflow2
Last synced: 13 Apr 2025
https://github.com/nafisalawalidris/fraud-detection-with-supervised-learning
This repository contains a basic fraud detection system utilising supervised learning techniques to identify potentially fraudulent credit card transactions. The project establishes a baseline model that addresses the challenges of credit card fraud in financial institutions.
datacollection datapreprocessing fastapi finance frauddetection machine-learning modeltraining python random-forest-classifier scikitlearn-machine-learning supervisedlearning
Last synced: 14 Jul 2025
https://github.com/nelsonwenner/python-data-sampling-app
:package: The module that allows the collection of data sampling, which is transmitted with WebSocket via WIFI or serial port for CSV file.
arduino csv datacollection pysimplegui python sampling sensors sensors-data-collection serialport thread websocket wifi
Last synced: 25 Apr 2026
https://github.com/alvinkuruvilla/kmlog
A sleek and lightweight Python TUI application to collect typing dynamics data from real people
datacollection keylogging python3 sql yaml
Last synced: 12 Apr 2025
https://github.com/Muralikrishnan-r14/Food_Order_Management_System
Food Ordering Management System with Python & SQL Integration
crud-operation crudretrieval database-management databaseintegration datacollection datamanagement mysql mysqlintegration python3 sqlqueriesinpython userinputhandling
Last synced: 01 May 2025
https://github.com/sayantikabanik/data_collection_worldcup
Web scrapping (bs4/selenium/scrappy)
datacollection python scrapping selenium worldcup2019
Last synced: 06 Mar 2026
https://github.com/johnbdfilio/bitget-data-collector-10ma
A Python script that collects and stores cryptocurrency price data from the Bitget API into MongoDB time-series collections. This tool is designed to maintain a rolling window of the latest UNLIMITED records for specified trading pairs.
aitrading bitget bitget-api candles crypto cryptocurrency datacollection datacollector timeseries timeseries-forecasting trading-algorithms tradingbot unlimited
Last synced: 13 Aug 2025
https://github.com/willmo103/home-assistant-litedb
A lightweight database solution to store and manage Home Assistant data with support for extended data collection and web-based visualization.
automation datacollection homeassistant iot python sqlite
Last synced: 04 Jan 2026
https://github.com/shuklayash02/personal_finance_analysis
Using power BI, I displayed my peronal finance data savings ,expense and my income
analysis datacollection dataset datavisualization powerbi powerbi-visuals
Last synced: 20 Jan 2026
https://github.com/chouaib-629/webscraping
A collection of web scraping projects using Beautiful Soup, Selenium, and mixed approaches. Each project includes Python scripts and CSV files of the scraped data. Perfect for learning and experimenting with static and dynamic web scraping techniques.
automation beautifulsoup beautifulsoup4 browser-automation csv datacollection dataextraction dynamicwebsite html-parser jupyter-notebook python python-script python3 selenium staticwebsite webscraping
Last synced: 08 May 2026
https://github.com/muralikrishnan-r14/food_order_management_system
Food Ordering Management System with Python & SQL Integration
crud-operation crudretrieval database-management databaseintegration datacollection datamanagement mysql mysqlintegration python3 sqlqueriesinpython userinputhandling
Last synced: 17 Apr 2026
https://github.com/mishaa931/web-scraping-dot-report-and-saving-data-to-csv
A script to scrap/extract articles about customers from a website . The data is then preprocessed to store in the database for further analysis.
datacollection pythonscript webscraping
Last synced: 07 Jun 2026
https://github.com/i-am-nolan25/python-for-data-science-ai-development
Jupyter Notebooks from Python for Data Science, AI & Development Course
api beautifulsoup data-science data-visualization datacollection datastructures matplotlib numpy pandas python rest-api webscraping
Last synced: 06 Mar 2025
https://github.com/binjewarkunal/top-10-worlds-largest-economy-analysis
Top 10 Largest Economies by GDP and GDP Per Capita. Data Collection: Forbes India, Data Visualization: Created a Horizontal Bar Chart and Documention.
data-visualization datacollection microsoft-excel notion
Last synced: 27 Mar 2026
https://github.com/pradeepchegur/image_classification_python
Here, classified three category of images using inception v3 model.
datacollection image-classification inception-v3 ipynb-jupyter-notebook jupyter-notebook python tensorflow
Last synced: 04 Mar 2026
https://github.com/rishikesh-jadhav/track_deep_learning
Data collected from the Udacity simulator comprising RGB images with steering and throttle annotations for each frame, specifically gathered for behavioral cloning purposes.
data datacollection udacity-self-driving-car
Last synced: 03 Jan 2026
https://github.com/binjewarkunal/instagram-market-and-competitor-analysis
In my analysis, I’ve focused on a few key points: ↳ Instagram's position in the social media market, ↳ Identifying key competitors, ↳ Conducting a SWOT analysis, ↳ And suggest new areas of research to further enhance Instagram's market strategy.
data-visualization datacollection microsoft-excel notion
Last synced: 21 Mar 2025
https://github.com/raghavendranhp/youtube_data_harvesting
The "YouTube Data Analyzer" is a versatile tool for businesses and content creators, enabling them to gather, analyze, and harness valuable insights from multiple YouTube channels. With streamlined data collection, storage in MongoDB, migration to SQL, and a user-friendly Streamlit interface, it empowers users to make data-driven decisions
apiintegration data datacollection eda googleapi googleapiclient matplotlib mongodb mysql mysqlconnector numpy oops pandas pymongo python pythonoops sql sqlalchemy streamlit youtube-api
Last synced: 13 Apr 2026
https://github.com/gayathri2200/space-race-projects
Winning the Space race with Data Science
data-science data-visualization datacollection datawrangling exploratory-data-analysis machine-learning
Last synced: 16 Mar 2025
https://github.com/sadratehranian/data-collection-and-machine-learning
create a model using logistic regression to predict whether the fire alarm of a smoke detector should sound or not. Second, predicts whether an electric drive in a production plant may be faulty or not.
data data-analysis data-science datacollection logistic-regression machine-learning ml nn
Last synced: 05 Jan 2026
https://github.com/analyticalnahid/data-acquation
Gather the data from different sources like API, Database, Excel Sheets, Kaggle etc
dataacquisition dataanalysis datacollection datagather
Last synced: 21 Aug 2025
https://github.com/mulaza/billboard-top-100-web-scraper
A web-scraping script that scrapes the🎸 Billboard Top 100 Songs list for song rank🎶, title and artist🎤 and saves them to a .json
datacollection python python3 webscraper webscraping webscrapper
Last synced: 18 May 2026
https://github.com/mchenryspagg/wrangle-and-analyze-data
This project which is known as 'wrangle and analyze data' involves the wrangling of WeRateDogs twitter archive data from the period of 2015 to 2017
api data dataanalysis datacollection datawrangling datetime json numpy os pandas pil python requests tweepy-api visualization
Last synced: 09 Apr 2026
https://github.com/harmanveer-2546/chatgpt-reviews-eda
The data in this EDA consists of daily-updated user reviews and ratings for the ChatGPT Android App. It also contains data on the relevancy of these reviews and the dates they were posted.
calendar chatgpt correlation datacollection droppingirrelevantcolumns eda exploration exploratory-data-analysis insights-data matplotlib mticker pandas python removingduplicates reviews-eda seaborn
Last synced: 14 Apr 2026
https://github.com/rahul-404/image-scraper
This project features an image scraper built with Python, designed to extract images from websites efficiently. Using libraries like BeautifulSoup and Requests, it automates the process, making it easy to gather images for various applications, from data analysis to creative projects.
automation beautifulsoup datacollection datascience imagescraper jupyternotebook opensource python requests techprojects webscraping
Last synced: 01 May 2026
https://github.com/musadiq071/hacker-news_scraper
CLI scraper for Hacker News — get top stories, filter by keyword, save to CSV, or open in browser.
automation cli csv datacollection hacker-news open-source python selenium webscraping
Last synced: 17 May 2026