{"id":15038708,"url":"https://github.com/nathanmarz/cascalog","last_synced_at":"2025-05-14T14:09:56.981Z","repository":{"id":707189,"uuid":"587626","full_name":"nathanmarz/cascalog","owner":"nathanmarz","description":"Data processing on Hadoop without the hassle.","archived":false,"fork":false,"pushed_at":"2023-05-18T22:49:55.000Z","size":2416,"stargazers_count":1376,"open_issues_count":40,"forks_count":176,"subscribers_count":79,"default_branch":"develop","last_synced_at":"2025-04-11T18:23:56.540Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Clojure","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nathanmarz.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2010-03-31T00:40:07.000Z","updated_at":"2025-04-10T03:07:35.000Z","dependencies_parsed_at":"2023-07-05T19:02:53.124Z","dependency_job_id":null,"html_url":"https://github.com/nathanmarz/cascalog","commit_stats":{"total_commits":1093,"total_committers":57,"mean_commits":19.17543859649123,"dds":0.6816102470265325,"last_synced_commit":"deaad977aa98985f68f3d1cc3e081d345184c0c8"},"previous_names":[],"tags_count":20,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nathanmarz%2Fcascalog","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nathanmarz%2Fcascalog/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nathanmarz%2Fcascalog/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nathanmarz%2Fcascalog/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nathanmarz","download_url":"https://codeload.github.com/nathanmarz/cascalog/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254160546,"owners_count":22024571,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-09-24T20:39:48.985Z","updated_at":"2025-05-14T14:09:51.961Z","avatar_url":"https://github.com/nathanmarz.png","language":"Clojure","funding_links":[],"categories":["大数据","Clojure"],"sub_categories":["微服务框架"],"readme":"# Cascalog\n\n[![Build Status](https://secure.travis-ci.org/nathanmarz/cascalog.png?branch=develop)](http://travis-ci.org/nathanmarz/cascalog)\n\n[Cascalog](http://cascalog.org/) is a fully-featured data processing and querying library for Clojure or Java. The main use cases for Cascalog are processing \"Big Data\" on top of Hadoop or doing analysis on your local computer. Cascalog is a replacement for tools like Pig, Hive, and Cascading and operates at a significantly higher level of abstraction than those tools.\n\nFollow the getting started steps, check out the tutorial, and you'll be running Cascalog queries on your local computer within 5 minutes.\n\n# Getting Started with JCascalog\n\nTo get started with JCascalog, Cascalog's pure-Java API, see [this wiki page](https://github.com/nathanmarz/cascalog/wiki/JCascalog). The jcascalog.Playground class has in-memory datasets that you can play with to learn the basics.\n\n# Latest Version\n\nThe latest release version of Cascalog is hosted on [Clojars](https://clojars.org):\n\n[![Current Version](https://img.shields.io/clojars/v/cascalog/cascalog-core.svg)](https://clojars.org/cascalog/cascalog-core)\n\n# Getting started with Clojure Cascalog\n\nThe best way to get started with Cascalog is experiment with the toy datasets that ship with the project. These datasets are served from memory and can be played with purely from the REPL. Just follow these steps and you'll be on your way:\n\n1. Install [leiningen](http://github.com/technomancy/leiningen)\n2. Make sure you have Java 1.6 (run `java -version`)\n3. Start a new leiningen project with `lein new \u003cproject name\u003e`, replacing `\u003cproject name\u003e`\n4. Include dependency on Cascalog in your project by adding `[cascalog/cascalog-core \"2.1.0\"]` into your project's `project.clj` file.\n5. Work through the examples in the [Getting Started Guide](http://cascalog.org/articles/getting_started.html).\n\n# Using Cascalog within a project\n\nCascalog is hosted at [Clojars](http://clojars.org/cascalog), and some of its dependencies are hosted at [Conjars](http://conjars.org/). Both Clo/Con-jars are maven repos that's easy to use with maven or leiningen.\n\nTo include Cascalog in your leiningen or cake project, add the following to your `project.clj`:\n\nGeneral\n\n    [cascalog/cascalog-core \"3.0.0\"] ;; under :dependencies\n    [org.apache.hadoop/hadoop-core \"1.2.1\"] ;; under :dev-dependencies\n\nLeiningen 2.0\n\n    :repositories {\"conjars\" \"http://conjars.org/repo\"}\n    :dependencies [cascalog/cascalog-core \"3.0.0\"]\n    :profiles { :provided {:dependencies [[org.apache.hadoop/hadoop-core \"1.2.1\"]]}}\n\nLeiningen \u003c 2.0\n\n    :dependencies [cascalog/cascalog-core \"3.0.0\"]\n    :dev-dependencies [[org.apache.hadoop/hadoop-core \"1.2.1\"]]\n\nNote that Cascalog is compatible with Clojure 1.2.0, 1.2.1, 1.3.0, 1.4.0, and 1.5.1.\n\n# Documentation and Issue Tracker\n\n- The [Cascalog website](http://cascalog.org/) contains more information and links to Various articles and tutorials.\n- API documentation can be found at http://nathanmarz.github.io/cascalog/.\n- [Issue Tracker on Github](https://github.com/nathanmarz/cascalog/issues).\n\nCome chat with us in the Google group: [cascalog-user](http://groups.google.com/group/cascalog-user)\n\nOr in the #cascalog or #cascading rooms on freenode!\n\n# Priorities for Cascalog development\n\n1. Replicated and bloom joins\n2. Cross query optimization: push constants and filters down into subqueries when possible\n\n# Acknowledgements\n\nYourKit is kindly supporting open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of innovative and intelligent tools for profiling Java and .NET applications. Take a look at YourKit's leading software products: [YourKit Java Profiler](http://www.yourkit.com/java/profiler/index.jsp) and [YourKit .NET Profiler](http://www.yourkit.com/.net/profiler/index.jsp).\n\nCascalog is based off of a very early branch of cascading-clojure project (http://github.com/clj-sys/cascading-clojure). Special thanks to Bradford Cross and Mark McGranaghan for their work on that project. Much of that code appears within Cascalog in either its original form or a modified form.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnathanmarz%2Fcascalog","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnathanmarz%2Fcascalog","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnathanmarz%2Fcascalog/lists"}