Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/johnynek/cascading-fields
Learning Clojure.
https://github.com/johnynek/cascading-fields
Last synced: about 1 month ago
JSON representation
Learning Clojure.
- Host: GitHub
- URL: https://github.com/johnynek/cascading-fields
- Owner: johnynek
- Created: 2013-07-26T06:06:30.000Z (over 11 years ago)
- Default Branch: master
- Last Pushed: 2013-07-26T06:21:24.000Z (over 11 years ago)
- Last Synced: 2024-10-13T13:28:15.099Z (2 months ago)
- Language: Java
- Size: 43 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# cascading-fields
The Scalding Fields API in Clojure!
## Hints
Fire up a clojure REPL with:
```bash
lein repl
```
Test that everything is working by running a few commands:
```clojure
REPL-y 0.1.9
Clojure 1.5.1
Exit: Control+D or (exit) or (quit)
Commands: (user/help)
Docs: (doc function-name-here)
(find-doc "part-of-name-here")
Source: (source function-name-here)
(user/sourcery function-name-here)
Javadoc: (javadoc java-object-or-class-here)
Examples from clojuredocs.org: [clojuredocs or cdoc]
(user/clojuredocs name-here)
(user/clojuredocs "ns-here" "name-here")
user=> (use 'cascading.core)
nil
user=> (memory-tap [1 2 3])
#[ALL]]"]["/177e2fa8-8a5c-47c4-b99c-9ad0531202ad"]"]>
```
The `cascading.core` namespace has the basic commands you'll need to get started.
I've also included the basic `ClojureMap`, `ClojureFilter` and `ClojureMapCat` java classes so you won't have to worry about Clojure function serialization. Instantiate them like this:
```clojure
user=> (import 'cascalog.ClojureMap)
cascalog.ClojureMap
user=> (ClojureMap. (fields "face") +)
#
```
Once you build your `JobConf`, you'll need to include `"cascalog.hadoop.ClojureKryoSerialization"` in your `"io.serializations"` entry, just like Scalding.
## Tests
This project uses [Midje](https://github.com/marick/Midje) for testing. Run the tests in the background with
```bash
lein midje :autotest
```
This will watch the test directory for changes (and new files) and run the tests every time it sees a change. I've included a couple of tests to get you started.