{"id":13714451,"url":"https://github.com/PokemonGoers/PokeData","last_synced_at":"2025-05-07T01:34:21.461Z","repository":{"id":67357971,"uuid":"65527826","full_name":"PokemonGoers/PokeData","owner":"PokemonGoers","description":" In this project you will scrape as much data as you can get about the *actual* sightings of Pokemons. As it turns out, players all around the world started reporting sightings of Pokemons and are logging them into a central repository (i.e. a database). We want to get this data so we can train our machine learning models. You will of course need to come up with other data sources not only for sightings but also for other relevant details that can be used later on as features for our machine learning algorithm (see Project B). Additional features could be air temperature during the given timestamp of sighting, location close to water, buildings or parks. Consult with Pokemon Go expert if you have such around you and come up with as many features as possible that describe a place, time and name of a sighted Pokemon. Another feature that you will implement is a twitter listener: You will use the twitter streaming API (https://dev.twitter.com/streaming/public) to listen on a specific topic (for example, the #foundPokemon hashtag). When a new tweet with that hashtag is written, an event will be fired in your application checking the details of the tweet, e.g. location, user, time stamp. Additionally, you will try to parse formatted text from the tweets to construct a new “seen” record that consequently will be added to the database. Some of the attributes of the record will be the Pokemon's name, location and the time stamp. Additional data sources (here is one: https://pkmngowiki.com/wiki/Pok%C3%A9mon) will also need to be integrated to give us more information about Pokemons e.g. what they are, what’s their relationship, what they can transform into, which attacks they can perform etc.","archived":false,"fork":false,"pushed_at":"2017-01-03T12:58:08.000Z","size":5788,"stargazers_count":9,"open_issues_count":2,"forks_count":6,"subscribers_count":13,"default_branch":"develop","last_synced_at":"2024-10-31T17:26:40.296Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/PokemonGoers.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2016-08-12T06:07:22.000Z","updated_at":"2024-08-29T12:00:03.000Z","dependencies_parsed_at":"2024-01-19T06:08:50.951Z","dependency_job_id":"e74da5a0-484f-4e55-8ebe-1272b44a8165","html_url":"https://github.com/PokemonGoers/PokeData","commit_stats":null,"previous_names":[],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PokemonGoers%2FPokeData","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PokemonGoers%2FPokeData/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PokemonGoers%2FPokeData/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/PokemonGoers%2FPokeData/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/PokemonGoers","download_url":"https://codeload.github.com/PokemonGoers/PokeData/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":224551302,"owners_count":17330120,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-02T23:01:59.804Z","updated_at":"2024-11-14T01:31:18.738Z","avatar_url":"https://github.com/PokemonGoers.png","language":"JavaScript","readme":"# PokeData\n\n[![Build Status](https://travis-ci.org/PokemonGoers/PokeData.svg?branch=develop)](https://travis-ci.org/PokemonGoers/PokeData)[![Join the chat at https://gitter.im/pokemongoers/PokeData](https://badges.gitter.im/pokemongoers/PokeData.svg)](https://gitter.im/pokemongoers/PokeData?utm_source=badge\u0026utm_medium=badge\u0026utm_campaign=pr-badge\u0026utm_content=badge)\n\n## API Documentation\n A detailed documentation of the API is available [here](http://pokedata.c4e3f8c7.svc.dockerapp.io:65014/doc/).\n \n## API Demo\n A demo of our API can also be found [here](http://pokedata.c4e3f8c7.svc.dockerapp.io:65014/doc/).\n \n## Data Sources\n Data accessible through the API has been extracted from these sources:\n  - [Twitter](https://twitter.com/)\n  - [PokeSniper](https://pokesnipers.com)\n  - [PokeRadar](https://www.pokeradar.io)\n  - [Skiplagged](https://skiplagged.com/catch-that)\n  - [PokeCrew](https://www.pokecrew.com)\n  - [PokeZZ](http://pokezz.com/)\n  - [PokeDexs](https://pokedexs.com/)\n  - [FastPokeMap](https://fastpokemap.se/)\n  - [PokeMap](https://www.pokemap.net/)\n\n## Build pokemon database and listen for pokemon sightings\n\n## To run locally without docker\n\n- Clone this repo\n- To run locally, mongodb is required, use 'mongod' to do so (standard port 27017, no credentials)\n- change the script part of package.json to the following\n- then start listeners to fill the DB, build the pokemon collection (see below) and run \"npm start\" to expose the API on `localhost:8080`\n```\n\"scripts\": {\n    \"start\" : \"node app.js\",\n    \"listen\": \"node scripts/listen.js\",\n    \"build\" : \"node scripts/build.js\",\n    \"test\"  : \"node test/main.js\"\n  }\n```\n## Build pokemon database\n```\nnpm run build --collection=pokemon\n```\n\n## Listen for PokemonSightings\n\n- Listen for pokemon sightings\n\n```\n// data-source-name - rarePokemon, pokeRadar, skiplagged, pokecrew, fastpokemap, pokezz, pokedexs, pokemap\nnpm run listen -collection=\u003cdata-source-name\u003e\n```\n\n- Listen for Twitter pokemon sightings:\n\n```\nCONSUMER_KEY=\u003cCONSUMER_KEY\u003e CONSUMER_SECRET=\u003cCONSUMER_SECRET\u003e ACCESS_TOKEN=\u003cACCESS_TOKEN\u003e ACCESS_TOKEN_SECRET=\u003cACCESS_TOKEN_SECRET\u003e NODE_ENV=\u003cNODE_ENV\u003e npm run listen -collection=twitter\n```\n\n- CONSUMER_KEY, CONSUMER_SECRET, ACCESS_TOKEN, ACCESS_TOKEN_SECRET - keys provided by twitter (https://apps.twitter.com/)\n\n## To run in production\n- To use mlab as a database, get the username, password, uri and the collection name.\n\n## Build pokemon database\n\n```\nMLAB_USERNAME=\u003cMLAB_USERNAME\u003e MLAB_PASSWORD=\u003cMLAB_PASSWORD\u003e MLAB_URI=\u003cMLAB_URI\u003e MLAB_COLLECTION=\u003cMLAB_COLLECTION\u003e npm run build -collection=pokemon\n```\n## Listen for PokemonSightings\n\n- Listen for pokemon sightings\n\n```\n// data-source-name - rarePokemon, pokeRadar, skiplagged, pokecrew, fastpokemap, pokezz, pokedexs, pokemap\nMLAB_USERNAME=\u003cMLAB_USERNAME\u003e MLAB_PASSWORD=\u003cMLAB_PASSWORD\u003e MLAB_URI=\u003cMLAB_URI\u003e MLAB_COLLECTION=\u003cMLAB_COLLECTION\u003e npm run listen -collection=\u003cdata-source-name\u003e\n```\n\n- Listen for Twitter pokemon sightings:\n\n```\nMLAB_USERNAME=\u003cMLAB_USERNAME\u003e MLAB_PASSWORD=\u003cMLAB_PASSWORD\u003e MLAB_URI=\u003cMLAB_URI\u003e MLAB_COLLECTION=\u003cMLAB_COLLECTION\u003e CONSUMER_KEY=\u003cCONSUMER_KEY\u003e CONSUMER_SECRET=\u003cCONSUMER_SECRET\u003e ACCESS_TOKEN=\u003cACCESS_TOKEN\u003e ACCESS_TOKEN_SECRET=\u003cACCESS_TOKEN_SECRET\u003e NODE_ENV=\u003cNODE_ENV\u003e npm run listen -collection=twitter\n```\n\n- CONSUMER_KEY, CONSUMER_SECRET, ACCESS_TOKEN, ACCESS_TOKEN_SECRET - keys provided by twitter (https://apps.twitter.com/)\n\n## Docker Build\n\n To build the project using Docker, follow these steps.\n \n 1. Execute the following commands in the terminal.\n\n  \n  ```bash\n  #!/bin/bash\n  \n  # Stop all containers\n  docker stop $(docker ps -a -q)\n  \n  # Delete all containers\n  docker rm $(docker ps -a -q)\n  \n  # Delete all images\n  docker rmi $(docker images -q)\n  \n  # Run the latest build from the develop branch\n  docker run --env-file \u003cPATH_TO_ENV_FILE\u003e -p 49160:8080 --name \u003cCONTAINER_NAME\u003e \n             -d pokemongoers/pokedata:develop npm start\n  \n  # Check the status of the container\n  docker ps\n  \n  ```\n\n 2. The application can be accessed at the URL `HOST_IP:49160`.\n\n##Config\nThere is a configuration file `config.js` in the root folder.\nIf you don't want to pass parameters for DB connection and twitter credentials everytime you can adapt it.\nJust replace the `process.env.*` with the desired value. The `\"database\"` key is  development mode, `\"shared_database\"` for production mode and `\"twitter\"` holds the twitter information.\n\n##Contributors\n- swathi-ssunder\n- samitsv\n- vivek-sethia\n- jonas-he\n- fabe85\n","funding_links":[],"categories":["Unofficial Links","Repositories"],"sub_categories":["Unofficial Software"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FPokemonGoers%2FPokeData","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FPokemonGoers%2FPokeData","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FPokemonGoers%2FPokeData/lists"}