Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jwc20/fcisapi
A scraper API for fetching workplace fatality and catastrophe reports from the United States Department of Labor website.
https://github.com/jwc20/fcisapi
accidents-analysis beautifulsoup beautifulsoup4 fatality labor python requests scraper scraper-api workplace
Last synced: 27 days ago
JSON representation
A scraper API for fetching workplace fatality and catastrophe reports from the United States Department of Labor website.
- Host: GitHub
- URL: https://github.com/jwc20/fcisapi
- Owner: jwc20
- License: mit
- Created: 2022-06-15T00:29:53.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-08-26T13:40:29.000Z (4 months ago)
- Last Synced: 2024-08-26T16:04:33.789Z (4 months ago)
- Topics: accidents-analysis, beautifulsoup, beautifulsoup4, fatality, labor, python, requests, scraper, scraper-api, workplace
- Language: Python
- Homepage:
- Size: 97.7 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# fcis-api
**Update: osha.org is blocking traffic from scrapers.**
**TODO: Use splash headless browser and/or implement proxy to circumvent block.**
A scraper API for Fatality and Catastrophe Investigation Summaries
## Installation
To install, you can clone the project:
```
git clone [email protected]:jwc20/fcis-api.git
cd fcis-api
pip install -r requirement.txt
```
## Usage
### Create client for searching accident reports
You can use description, abstract, and keyword words to search the reports.\
Note that "abstract" served the same purpose as "description" for older reports.
```
import fcis
desc = ["employee"]
abst = ["employee"]
keyw = ["fire"]
client = fcis.FCIS(descriptions=desc, keywords=keyw)
```
### Scrape accident reports
To search workplace accident report, type:
```
reports = client.get_accidents(p_show=100)
print(reports)
```
and you will get:
```
[{'accident_id': '141245.015',
'summary_url': 'https://www.osha.gov/pls/imis/accidentsearch.accident_detail?id=141245.015',
'summary_nr': '141245.01',
'event_date': '11/17/2021',
'report_id': '0213900',
'fatality': None,
'sic_url': None,
'sic_number': None,
'event_description': 'Employee Is Killed After Falling Through Elevator Shaft',
'fatility': 'X'},
...
```
### Create client for getting details
To get details of individual report, type:
```
import fcis
client = fcis.FCIS()
```
### Scrape accident details
You can use use the id of the accident details (found in searching the results) to get the details.
```
details = client.get_accident_details(ids=["570341"])
print(details)
```
To get:
```
{'accident_number': '570341',
'report_id': '0522300',
'event_date': '08/15/1984',
'inspection_url': 'establishment.inspection_detail?id=1667450',
'inspection_number': '1667450',
'open_date': '08/16/1984',
'sic_number': '4741',
'establishment_name': 'Mobile Tank Car Services',
'detail_description': 'THREE EMPLOYEES WERE CLEANING A RAILROAD TANK CAR CONTAINING RESIDUES OF COAL TAR LIGHT OIL, A FLAMMABLE LIQUID. ONE WAS ON TOP OF THE CAR, THE OTHER TWO WERE INSIDE. THEY WERE USING STEEL SHOVELS AND A NON EXPLOSION-PROOF LIGHT INSIDE THE CAR. THE VAPORS IGNITED, KILLING THE TWO EMPLOYEES INSIDE AND BURNING THE ONE ON TOP. THE OTHER EMPLOYEES WERE INJURED IN THE RESCUE ATTEMPT.',
'keywords': ['burn',
' coal tar light oil',
' flammable vapors',
' railroad tank car',
' cleaning',
' explosion'],
'Employee': [{'Employee #': '1',
'Inspection': '1667450',
'Age': '',
'Sex': '',
'Degree': 'Fatality',
'Nature': 'Asphyxia',
'Occupation': 'Occupation not reported',
'': ''},
{'Employee #': '2',
'Inspection': '1667450',
'Age': '',
'Sex': '',
'Degree': 'Fatality',
'Nature': 'Asphyxia',
'Occupation': 'Occupation not reported',
'': ''},
...
}
```
### Requirements:
- beautifulsoup4
- lxml
- requests
### Links
[Accident Search](https://www.osha.gov/pls/imis/accidentsearch.html)
[Accident Investigation Search Help](https://www.osha.gov/help/accident-investigation)