https://github.com/aamend/pathogen

The rooster crows immediately before sunrise, the rooster causes the sun to rise
https://github.com/aamend/pathogen

big-data bigdata causation contagion correlation datascience fcm graph graphx machine-learning spark

Last synced: about 1 month ago
JSON representation

The rooster crows immediately before sunrise, the rooster causes the sun to rise

• Host: GitHub
• URL: https://github.com/aamend/pathogen
• Owner: aamend
• License: apache-2.0
• Created: 2017-07-09T23:11:22.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2022-01-10T06:21:56.000Z (almost 3 years ago)
• Last Synced: 2024-04-17T10:54:26.758Z (8 months ago)
• Topics: big-data, bigdata, causation, contagion, correlation, datascience, fcm, graph, graphx, machine-learning, spark
• Language: Scala
• Homepage:
• Size: 316 KB
• Stars: 10
• Watchers: 7
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
![Pathogen](/images/logo.png)

_The rooster crows immediately before sunrise, the rooster causes the sun to rise._

[![Maven Central](https://maven-badges.herokuapp.com/maven-central/io.pathogen.spark/pathogen-core/badge.svg)](https://maven-badges.herokuapp.com/maven-central/com.aamend.spark/pathogen)

[![Build Status](https://travis-ci.org/aamend/pathogen.svg?branch=master)](https://travis-ci.org/aamend/pathogen) 

Using GraphX to detect possible causes and effects between time related events. We observe a true 

causation signal by generating random correlations over same events at different time and back propagate 

these scores to their most connected events. Finally, we extract the most probable causes and effects 

together with a score of aggressiveness (how likely an event could explain downstream effects) and 

sensitivity (how likely an event results from an upstream cause).

### Getting Started

_Pathogen_ project is built for __Scala 2.11.x__ and __Spark 2.1.0__. 

#### Maven

_Pathogen_ is available on Maven Central. Add below dependency to your `pom.xml` file

```xml

  io.pathogen.spark

  pathogen-core

  x.y.z

```

#### SBT

If you are using SBT, simply add the following to your `build.sbt` file

```scala

libraryDependencies ++= Seq(

  "io.pathogen.spark" % "pathogen-core" % "x.y.z"

)

```

#### Spark Packages

Available as a [spark package](https://spark-packages.org/package/aamend/pathogen), include this package in your Spark Applications as follows

```bash

> $SPARK_HOME/bin/spark-shell --packages io.pathogen.spark:pathogen-core:x.y.z

```

## Authors

Antoine Amend - [[[email protected]]]([email protected])

## License

Apache License, version 2.0