{"id":18639288,"url":"https://github.com/monksy/datagenerator-sensorweather","last_synced_at":"2025-10-10T19:36:03.846Z","repository":{"id":146296463,"uuid":"131556575","full_name":"monksy/datagenerator-sensorweather","owner":"monksy","description":"The goal of this simple script/app is to generate a large set of data where it can show that sensors reported in a typical yearly fashion. (Starting cold at the beginning of each day and start of the year), peaking midway through, and falling back to where it started.","archived":false,"fork":false,"pushed_at":"2018-05-01T02:22:31.000Z","size":5,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-05-17T15:11:40.972Z","etag":null,"topics":["bigdata","generator","sample-data","scala"],"latest_commit_sha":null,"homepage":null,"language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/monksy.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-04-30T04:45:25.000Z","updated_at":"2018-05-01T02:22:32.000Z","dependencies_parsed_at":null,"dependency_job_id":"409d0183-a1c4-4494-bad9-f7918efe01c6","html_url":"https://github.com/monksy/datagenerator-sensorweather","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monksy%2Fdatagenerator-sensorweather","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monksy%2Fdatagenerator-sensorweather/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monksy%2Fdatagenerator-sensorweather/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monksy%2Fdatagenerator-sensorweather/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/monksy","download_url":"https://codeload.github.com/monksy/datagenerator-sensorweather/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/monksy%2Fdatagenerator-sensorweather/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259265856,"owners_count":22831270,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bigdata","generator","sample-data","scala"],"created_at":"2024-11-07T05:47:58.962Z","updated_at":"2025-10-10T19:35:58.803Z","avatar_url":"https://github.com/monksy.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Data Generator- Sensor Weather\n\nThe goal of this simple script/app is to generate a large set of data where it can show that sensors reported in a typical yearly fashion. (Starting cold at the beginning of each day and start of the year), peaking midway through, and falling back to where it started.\n\nTHis should generate a large enough dataset to work with big data systems. \n\nThis allows for intraday variations and for yearly variations. Also, this produces unique patterns for each of the ids that you give it as well.\n\nThis is intented to produce a CSV file that can be directly injested into a database.\n\n## How to compile\nThis is using the maven build system so\n\n    mvn clean package \n    \nThis will produce a full jar, with all of it's dependencies in target. \n\n## Example Run\n\n     java -jar datagenerator-sensorweather-1.0-SNAPSHOT-allinone.jar a,b,c,d,e,f 3000 6000 \n\n## Inputs \n\n| Parameter | Description | Example |\n| --------- | ----------- | ------- |\n| ids       | The ids for the temperature probes to report back on | a,b,c | \n| every-seconds | For every one of these seconds of the day, a report will be made from each probe | 30 (every thirty seconds of the day a report will be made) | \n| days | This is for how many days that reports will be made | 30 (30 days of reports + intraday reports will be made) | \n\n\n## Output \n\nA CSV output will come out of standard out ready to be consumed. \n\n### Example\n\n    checkintime,id,temperature\n    1525179480523,a,69.54\n    1525209480523,a,81.59\n    1525239480523,a,69.54\n    1525179480523,b,65.47\n    1525209480523,b,82.06\n    1525239480523,b,65.47\n    1525265880523,a,67.71\n    1525295880523,a,85.04\n    1525325880523,a,67.71\n    1525265880523,b,67.10\n    1525295880523,b,81.94\n    1525325880523,b,67.10\n\n\n## SQL Table to import the data into \n\nNote: The timestamp type will not accept epoch. \n\n    create table sesnordata\n    (\n      checkintime bigint not null,\n      sensor varchar(10) not null,\n      temperature double precision\n    );\n    \n\n## Improvements that could be made\n\n * Refactoring for clarity \n * Injection of occasional bad data (to simulate bad sensors)\n * Configurability to show when a sensor may have failed to report in\n * Better date handling to start at the beginning of the year rather than the current day.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmonksy%2Fdatagenerator-sensorweather","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmonksy%2Fdatagenerator-sensorweather","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmonksy%2Fdatagenerator-sensorweather/lists"}