https://github.com/shuyib/teaching_data_collection

Learn data collection by putting a couple of things into consideration
https://github.com/shuyib/teaching_data_collection

best-practices data-collection data-science data-structures data-visualization makefile matplotlib pandas-dataframe polars-dataframe

Last synced: 3 days ago
JSON representation

Learn data collection by putting a couple of things into consideration

• Host: GitHub
• URL: https://github.com/shuyib/teaching_data_collection
• Owner: Shuyib
• License: cc0-1.0
• Created: 2024-04-01T10:07:43.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2024-05-23T02:42:26.000Z (8 months ago)
• Last Synced: 2024-11-28T19:25:57.474Z (2 months ago)
• Topics: best-practices, data-collection, data-science, data-structures, data-visualization, makefile, matplotlib, pandas-dataframe, polars-dataframe
• Language: Makefile
• Homepage:
• Size: 42 KB
• Stars: 4
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# teaching_data_collection

Learn how to do data collection putting a couple of things into consideration. Such as:    

1. [Tidy data principles](https://vita.had.co.nz/papers/tidy-data.pdf) including short and long dataframes.     

2. Error handling while calling [APIs.](https://blog.postman.com/best-practices-for-api-error-handling/)       

3. Keeping your secrets safe with [OS module.](https://www.geeksforgeeks.org/python-os-getenv-method/)   

4. [Retrying](https://medium.com/@API4AI/best-practice-implementing-retry-logic-in-http-api-clients-0b5469c08ced) API request incase of failure.   

You will learn how to query the newsAPI and scrape information from Wikipedia. These are common applications of 

collecting data in data science. NB: You'll need an [API key](https://newsapi.org/) for the newsAPI. Here we go!!!  

Check out the folders for more information

[Getting Data off an API](API)    

[Webscraping](Webscrape)