{"id":13417636,"url":"https://github.com/sryza/spark-timeseries","last_synced_at":"2025-05-15T10:01:27.082Z","repository":{"id":28489675,"uuid":"32005904","full_name":"sryza/spark-timeseries","owner":"sryza","description":"A library for time series analysis on Apache Spark","archived":false,"fork":false,"pushed_at":"2020-10-13T04:36:27.000Z","size":1995,"stargazers_count":1193,"open_issues_count":85,"forks_count":420,"subscribers_count":131,"default_branch":"master","last_synced_at":"2025-05-14T21:53:41.080Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sryza.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-03-11T08:14:49.000Z","updated_at":"2025-04-21T13:57:26.000Z","dependencies_parsed_at":"2022-07-28T20:10:03.652Z","dependency_job_id":null,"html_url":"https://github.com/sryza/spark-timeseries","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sryza%2Fspark-timeseries","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sryza%2Fspark-timeseries/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sryza%2Fspark-timeseries/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sryza%2Fspark-timeseries/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sryza","download_url":"https://codeload.github.com/sryza/spark-timeseries/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254319715,"owners_count":22051072,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-30T22:00:46.358Z","updated_at":"2025-05-15T10:01:26.210Z","avatar_url":"https://github.com/sryza.png","language":"Scala","funding_links":[],"categories":["Table of Contents","大数据"],"sub_categories":["Tools"],"readme":"[![Build Status](https://travis-ci.org/sryza/spark-timeseries.svg)](https://travis-ci.org/sryza/spark-timeseries)\n\nTime Series for Spark (The `spark-ts` Package)\n=============\n\nA Scala / Java / Python library for interacting with time series data on Apache Spark.\n\nPost questions and comments to the [Google group](https://groups.google.com/forum/#!forum/spark-ts),\nor email them directly to \u003cmailto:spark-ts@googlegroups.com\u003e.\n\n### Note: The spark-ts library is no longer under active development by me (Sandy).  I unfortunately no longer have bandwidth to develop features, answer all questions on the mailing list, or fix all bugs that are filed.\n\n### That said, I remain happy to review pull requests and do whatever I can to aid others in advancing the library.\n\n\nDocs are available at http://sryza.github.io/spark-timeseries.\n\nOr check out the [Scaladoc](http://sryza.github.io/spark-timeseries/0.3.0/scaladocs/index.html), [Javadoc](http://sryza.github.io/spark-timeseries/0.3.0/apidocs/index.html), or [Python doc](http://sryza.github.io/spark-timeseries/0.3.0/pydoc/py-modindex.html).\n\nThe aim here is to provide\n\n* A set of abstractions for manipulating large time series data sets, similar to\n  what's provided for smaller data sets in\n  [Pandas](http://pandas.pydata.org/pandas-docs/dev/timeseries.html),\n  [Matlab](http://www.mathworks.com/help/matlab/time-series.html), and R's\n  [zoo](http://cran.r-project.org/web/packages/zoo/index.html) and \n  [xts](http://cran.r-project.org/web/packages/xts/index.html) packages.\n* Models, tests, and functions that enable dealing with time series from a statistical perspective,\n  similar to what's provided in [StatsModels](http://statsmodels.sourceforge.net/devel/tsa.html)\n  and a variety of Matlab and R packages.\n\nThe library sits on a few other excellent Java and Scala libraries.\n\n* [Breeze](https://github.com/scalanlp/breeze) for NumPy-like, BLAS-able linear algebra.\n* [java.time](https://docs.oracle.com/javase/8/docs/api/index.html?java/time/package-summary.html) for dates and times. \n* [Apache Commons Math](https://commons.apache.org/proper/commons-math/) for general math and\n  statistics functionality.\n* [Apache Spark](https://spark.apache.org/) for distributed computation with in-memory\n  capabilities.\n\nUsing this Repo\n---------------\n\n### Building\n\nWe use [Maven](https://maven.apache.org/) for building Java / Scala. To compile, run tests, and build\njars:\n\n    mvn package\n\nTo run Python tests (requires [nose](https://nose.readthedocs.org/en/latest/)):\n\n    cd python\n    export SPARK_HOME=\u003clocation of local Spark installation\u003e\n    nosetests\n\n### Running\n    \nTo run a spark-shell with spark-ts and its dependencies on the classpath:\n\n    spark-shell --jars target/sparkts-$VERSION-SNAPSHOT-jar-with-dependencies.jar\n    \n### Releasing\n\nTo publish docs, easiest is to clone a separate version of this repo in some location we'll refer\nto as DOCS_REPO.  Then:\n\n    # Build main doc\n    mvn site -Ddependency.locations.enabled=false\n    \n    # Build scaladoc\n    mvn scala:doc\n    \n    # Build javadoc\n    mvn javadoc:javadoc\n\n    # Build Python doc\n    cd python\n    export SPARK_HOME=\u003clocation of local Spark installation\u003e\n    export PYTHONPATH=$PYTHONPATH::$SPARK_HOME/python:$SPARK_HOME/python/lib/*\n    make html\n    cd ..\n    \n    cp -r target/site/* $DOCS_REPO\n    cp -r python/build/html/ $DOCS_REPO/pydoc\n    cd $DOCS_REPO\n    git checkout gh-pages\n    git add -A\n    git commit -m \"Some message that includes the hash of the relevant commit in master\"\n    git push origin gh-pages\n\nTo build a Python source distribution, first build with Maven, then:\n\n    cp target/sparkts-$VERSION-SNAPSHOT-jar-with-dependencies.jar python/sparkts/\n    cd python\n    python setup.py sdist\n\nTo release Java/Scala packages (based on http://oryxproject.github.io/oryx/docs/how-to-release.html):\n\n    mvn -Darguments=\"-DskipTests\" -DreleaseVersion=$VERSION \\\n        -DdevelopmentVersion=$VERSION-SNAPSHOT release:prepare\n\n    mvn -s private-settings.xml -Darguments=\"-DskipTests\" release:perform\n\nTo release Python packages (based on http://peterdowns.com/posts/first-time-with-pypi.html):\n\n    python setup.py register -r pypi\n    python setup.py sdist upload -r pypi\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsryza%2Fspark-timeseries","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsryza%2Fspark-timeseries","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsryza%2Fspark-timeseries/lists"}