https://github.com/fghso/camps-dct

CAMPS Data Collection Tool
https://github.com/fghso/camps-dct

data-science python ufmg

Last synced: about 1 month ago
JSON representation

CAMPS Data Collection Tool

• Host: GitHub
• URL: https://github.com/fghso/camps-dct
• Owner: fghso
• License: mit
• Created: 2014-10-18T02:00:54.000Z (over 11 years ago)
• Default Branch: master
• Last Pushed: 2015-10-14T00:46:53.000Z (over 10 years ago)
• Last Synced: 2026-05-21T11:37:15.077Z (about 2 months ago)
• Topics: data-science, python, ufmg
• Language: Python
• Homepage: http://fghso.github.io/camps-dct/
• Size: 734 KB
• Stars: 1
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
CAMPS Data Collection Tool

=====

A Python program for distributed (client-server) data collection. The code to do the actual crawling is written by the user and the tool takes care of all management needed to distribute resources to be collected. 

Documentation:

* [General information and usage instructions](https://github.com/fghso/camps-dct/wiki)

* [Modules documentation](http://fghso.github.io/camps-dct/)

This project is the result of improvements over past efforts made by [our research group](http://www.camps.dcc.ufmg.br/) in collecting data for scientific analysis. Although performance was always a concern during the development of the tool, the main goals were (re)usability, flexibility and extensibility, what explains many of the design and implementation decisions.

The author thanks very much everyone who contributed somehow with ideias, suggestions, observations and corrections. New contributions are still welcome and will be much appreciated.