{"id":16726331,"url":"https://github.com/brunobonacci/pig-riak","last_synced_at":"2025-10-28T08:46:53.828Z","repository":{"id":9605991,"uuid":"11528840","full_name":"BrunoBonacci/pig-riak","owner":"BrunoBonacci","description":"Apache Pig custom store function for Riak","archived":false,"fork":false,"pushed_at":"2013-07-31T16:27:51.000Z","size":156,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-22T05:28:32.025Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/BrunoBonacci.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2013-07-19T13:52:16.000Z","updated_at":"2013-12-12T15:22:31.000Z","dependencies_parsed_at":"2022-08-30T10:10:25.132Z","dependency_job_id":null,"html_url":"https://github.com/BrunoBonacci/pig-riak","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BrunoBonacci%2Fpig-riak","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BrunoBonacci%2Fpig-riak/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BrunoBonacci%2Fpig-riak/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BrunoBonacci%2Fpig-riak/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/BrunoBonacci","download_url":"https://codeload.github.com/BrunoBonacci/pig-riak/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243747701,"owners_count":20341547,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-12T22:52:54.651Z","updated_at":"2025-10-28T08:46:53.768Z","avatar_url":"https://github.com/BrunoBonacci.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# RiakStorer\n\nA [UDF StoreFunc](http://pig.apache.org/docs/r0.8.0/udf.html#Store+Functions) for [Apache Pig](http://pig.apache.org/) designed to bulk-load data into [Riak](http://basho.com/riak/). Inspired by [pig-redis](https://github.com/mattb/pig-redis) store function.\n\n## Please note: The loader uses the REST APIs, therefore it is increbibly slow for large datasets. \nTo improve performances (not included in this release):\n  - Use ProtBuf Apis\n  - Batch writes\n\n## Compiling and running\n\nCompile:\n\nDependencies are automatically retrieved using [gradle](http://www.gradle.org/). Gradle itself is automatically retrieved using the gradle wrapper.\n\n    $ ./gradlew jar\n\nUse:\n\n    $ pig\n    grunt\u003e REGISTER build/libs/pig-riak.jar;\n    grunt\u003e a = LOAD 'somefile.tsv' USING PigStorage('\\t');\n    grunt\u003e STORE a INTO 'bucket-name' USING com.brunobonacci.pig.riak.RiakStorer('text/plain', 'localhost');\n\nThe build process produces a jar with all necessary dependencies.\n\n## Loading strategy\n\nRiakStorer uses the HTTP/Rest interface of Riak to load data.\nIt expects a two column table where the first column is the **key** and the second column is the **content** to be uploaded.\nThe Content-Type can be defined on the RiakStorer constructor, together with the destination host and port.\nThe destination **bucket** must be set as destination location for the STORE function.\n\nIf the table contains more than two columns they are simply ignored. Use additional steps and UDF function to transform your table into the desired string content before the final upload.\n\nIf the key upload fails an Exception is raised.\n\n## License\n\nDistributed under [Apache Lincense 2.0](http://www.apache.org/licenses/LICENSE-2.0.html)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrunobonacci%2Fpig-riak","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbrunobonacci%2Fpig-riak","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrunobonacci%2Fpig-riak/lists"}