Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
awesome-public-real-time-datasets
A list of publicly available datasets with real-time data maintained by the team at bytewax.io
https://github.com/bytewax/awesome-public-real-time-datasets
Last synced: about 17 hours ago
JSON representation
-
Free
-
Transportation
- Open Glider Network - The OGN provides real-time traffic for gliders and other light aircraft. You can use an OGN client like [python-ogn-client](https://github.com/glidernet/python-ogn-client) to connect to OGN servers, parse the APRS messages and push them to a broker like Kafka for streaming processing.
- Open Rail Data - A collection of APIs that provide data relating to the UK rail network, including reference data, train timetables, and live service updates. The live data is streamed using the STOMP protocol.
- GBFS New York - GBFS is the standard for bike share data with many locations around the world. Find more information [here](https://github.com/MobilityData/gbfs/blob/master/gbfs.md)
- Open Sky Flight - Data from Open Sky Api via HTTP endpoint. Supports real-time, but not streaming. Need to continually poll.
- MTA GTFS Feed - Transit data in [GTFS format](https://developers.google.com/transit/gtfs-realtime/) for transit systems like NYC subway and Caltrain.
- NY 511 live camera data - This live camera data requires some scraping to use. From this list of cameras you can then source the individual camera id and then request the timestamped image or most recent image by building the url like - `https://511ny.org/map/Cctv/<image-id-goes-here>`
- Transport for London (TfL) - live data about the tube, buses, and more
- Norwegian Coastal Administration - AIS data from vessels within the Norwegian economic zone and the protection zones off Svalbard and Jan Mayen.
- German Traffic Data - German real-time traffic information
- Swiss Traffic & Public Transport Data - Various real-time transport data from Switzerland such road traffic, status of EV charging stations, shared mobility services and live arrivals/departures of public transport
-
Information
- US Energy Grid Data - Real-time grid information for the US energy grid
- Wikimedia SSE
- Seismic Data - time seismic events.
- Open Weather API - Current weather data available free at rate of 1 request per second.
- Clima Cell - Real-time weather data in a free or paid API.
- NOAA Buoy Data - Real-time buoy data from NOAA
- NOAA Weather Data - Live Weather Data API from NOAA
- EPA Airnow data - Air quality data hosted by the EPA.
- UK Flood Data - UK government real-time API for flood data.
- USGS Earthquake Real-time Feed - Live seismological data feed to know about earthquakes as they happen
-
Finance/Crypto
- Coinbase Market Data - Coinbase websocket to market data including level 2 orderbook data.
- Yahoo Finance - This is not advertised in developer documentation, but discoverable as the websocket is used to update their website.
- Finnhub - Limited free usage with a premium data sources also available.
- CoinCheck - a cryptocurrency API that has a WebSocket interface (in beta)
- Alpaca Markets - Time and historical market data via HTTP and Websocket.
- Blockchain transactions - Provides real-time notifications about new transactions and blocks.
-
IoT
- ThingSpeak IoT Public Channels - Crowdsourced IoT channels of users publishing various IoT sensor data in real-time. Accessible via REST API or MQTT API.
-
Other
- Live Satellite Positions - N2YO.COM allows tracking of satellites through REST API with the NORAD catalog number assigned by the United States Space Command
-
-
Paid
-
Finance/Crypto
- Twitter - Twitter provides a streaming interface for research or enterprise. It is unknown what support will be post Twitter purchase in 2022.
- Alpha Vantage Market News & Sentiment - Live market news & sentiment data from selected news outlets covering stocks, cryptocurrencies, forex, and a wide range of topics such as fiscal policy, mergers & acquisitions, IPOs, etc.
- NYSE Cloud Streaming - Provides real-time access to high-quality NYSE exchange data feeds, streaming directly in the cloud using Kafka format.
-
Transportation
-
Information
- PurpleAir Air Quality Data - Developer API for accessing purple air sensor data.
- NewsAPI - NewsAPI tracks headlines in 7 categories across over 50 countries, and at over a hundred top publications and blogs, in near real time. Free developer version with 24 delays available.
-
Sports
- Sports Livescores - Developer API of TheSportsDB that gives you access to livescores
- Sportradar Sports Data - Global live data of 80 sports, 500 sport leagues and 750k events a year (free 30 day trial available)
-
Sub Categories