Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bbc-data-unit/facebook-food
Homemade food: The home cooks selling hot dinners on Facebook
https://github.com/bbc-data-unit/facebook-food
facebook food fsa scraping
Last synced: 7 days ago
JSON representation
Homemade food: The home cooks selling hot dinners on Facebook
- Host: GitHub
- URL: https://github.com/bbc-data-unit/facebook-food
- Owner: BBC-Data-Unit
- Created: 2020-01-29T09:34:24.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2020-01-29T12:46:57.000Z (almost 5 years ago)
- Last Synced: 2024-11-07T05:29:47.872Z (about 2 months ago)
- Topics: facebook, food, fsa, scraping
- Language: HTML
- Homepage: https://www.bbc.co.uk/news/uk-england-50821122
- Size: 3.78 MB
- Stars: 0
- Watchers: 5
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Homemade food: The home cooks selling hot dinners on Facebook
In December 2019 **Rob England** and **Paul Bradshaw** [reported](https://www.bbc.co.uk/news/uk-england-50821122) on the people using Facebook to sell hot food prepared in home kitchens - and how campaigners want this emerging market regulated and subject to council hygiene inspections.
BBC analysis found more than 3,000 listings across the UK on Facebook Marketplace for "homemade food" on one day.
In order to analyse listings, we had to download Facebook Marketplaces pages in Safari's 'web archive' format, then [use command line to extract this into a HTML file](https://github.com/BBC-Data-Unit/facebook-food/blob/master/convertwebarchive.sh), and then extract data from those files. The dynamic nature of the pages meant that information could not be extracted using other browsers or methods.
Once downloaded, we used deduplication techniques to remove entries that appeared in Marketplace sections for different cities.
## Get the data
* CSVs: [scraped data for each city's Marketplace listings](https://github.com/BBC-Data-Unit/facebook-food/tree/master/scrapeddata)
* CSV: [combined data, with duplicate entries removed](https://github.com/BBC-Data-Unit/facebook-food/blob/master/scrape_dedup.csv)
* CSV: [words used and counts](https://github.com/BBC-Data-Unit/facebook-food/blob/master/keywordcount.csv)
* CSV: [place names appearing most often](https://github.com/BBC-Data-Unit/facebook-food/blob/master/topplaces.csv)
* XLSX: [most common foods by area](https://github.com/BBC-Data-Unit/facebook-food/blob/master/foodbyregionCHECK.xlsx)
## Quotes and interviews
* Annise Middleton, home cook from Stoke-on-Trent
* Nasrin Rehmanwala, home cook from Cheltenham
* Johelis Zambrano, home cook from Birmingham
* Emma Rose, spokeswoman, campaign group Unchecked
* Spokeswoman, Food Standards Agency (FSA)
* Spokesman, Facebook
## Visualisation
* Bar chart: 10 most common words in 'homemade food' listings on Facebook Marketplace
## Scripts
A shell script was used in command line to convert Safari's .webarchive format into HTML. R was used to clean and analyse the data.
* Shell script: [convert .webarchive to HTML](https://github.com/BBC-Data-Unit/facebook-food/blob/master/convertwebarchive.sh)
* XML: [OutWit Hub scraper](https://github.com/BBC-Data-Unit/facebook-food/blob/master/FB%20marketplace%20scraper.xml)
* R notebook: [import and combine data](https://github.com/BBC-Data-Unit/facebook-food/blob/master/00codecheck.Rmd)
* R notebook: [import and combine data, generate regional breakdown](https://github.com/BBC-Data-Unit/facebook-food/blob/master/01importfbmkt.Rmd)
* R notebook: [remove duplicates](https://github.com/BBC-Data-Unit/facebook-food/blob/master/02fbmarketanaly.Rmd)
* R notebook: [extract and count words, identify variations](https://github.com/BBC-Data-Unit/facebook-food/blob/master/03fbmarket_text.Rmd)
* R notebook: [identify food-related listings](https://github.com/BBC-Data-Unit/facebook-food/blob/master/04fbmarket_textafterclean.Rmd)
Subsequent analysis was performed in Excel.