{"id":23118543,"url":"https://github.com/sparkling-graph/sparkling-graph","last_synced_at":"2025-04-24T03:48:29.730Z","repository":{"id":57736803,"uuid":"49857081","full_name":"sparkling-graph/sparkling-graph","owner":"sparkling-graph","description":"SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.","archived":false,"fork":false,"pushed_at":"2020-07-31T08:54:37.000Z","size":10222,"stargazers_count":152,"open_issues_count":9,"forks_count":34,"subscribers_count":18,"default_branch":"master","last_synced_at":"2025-04-24T03:48:23.047Z","etag":null,"topics":["approximation","big-data","coarsing","comunity-detection-methods","dsl","graph","graph-algorithms","heuristics","link-predication","machine-learning","measure","network-analysis","spark","vertex"],"latest_commit_sha":null,"homepage":"http://sparkling.ml","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-2-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sparkling-graph.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-01-18T06:37:49.000Z","updated_at":"2024-11-02T23:16:11.000Z","dependencies_parsed_at":"2022-08-24T02:51:02.874Z","dependency_job_id":null,"html_url":"https://github.com/sparkling-graph/sparkling-graph","commit_stats":null,"previous_names":[],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sparkling-graph%2Fsparkling-graph","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sparkling-graph%2Fsparkling-graph/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sparkling-graph%2Fsparkling-graph/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sparkling-graph%2Fsparkling-graph/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sparkling-graph","download_url":"https://codeload.github.com/sparkling-graph/sparkling-graph/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250560006,"owners_count":21450168,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["approximation","big-data","coarsing","comunity-detection-methods","dsl","graph","graph-algorithms","heuristics","link-predication","machine-learning","measure","network-analysis","spark","vertex"],"created_at":"2024-12-17T05:18:14.518Z","updated_at":"2025-04-24T03:48:29.693Z","avatar_url":"https://github.com/sparkling-graph.png","language":"Scala","readme":"# sparkling-graph\n[![Build Status](https://travis-ci.org/sparkling-graph/sparkling-graph.svg?branch=master)](https://travis-ci.org/sparkling-graph/sparkling-graph) [![codecov](https://codecov.io/gh/sparkling-graph/sparkling-graph/branch/master/graph/badge.svg)](https://codecov.io/gh/sparkling-graph/sparkling-graph) [![Documentation Status](https://readthedocs.org/projects/sparkling-graph/badge/?version=latest\u0026cache=1234)](http://sparkling-graph.readthedocs.org/en/latest/?badge=latest) [![Codacy Badge](https://api.codacy.com/project/badge/grade/9ddff907e39a431485fecaf0f612a528)](https://www.codacy.com/app/riomus/sparkling-graph) [![Maven Central](https://maven-badges.herokuapp.com/maven-central/ml.sparkling/sparkling-graph-examples_2.12/badge.svg)](https://maven-badges.herokuapp.com/maven-central/ml.sparkling/sparkling-graph-examples_2.12) [![MLOSS](https://img.shields.io/badge/MLOSS-0.0.7-brightgreen.svg)](https://mloss.org/software/view/650/) [![Spark Packages](https://img.shields.io/badge/Spark%20Packages-0.0.7-brightgreen.svg)](http://spark-packages.org/package/sparkling-graph/sparkling-graph) [![API](https://img.shields.io/badge/API-latest-brightgreen.svg)](http://sparkling-graph.github.io/sparkling-graph/latest/api/) [![Gitter](https://badges.gitter.im/sparkling-graph/sparkling-graph.svg)](https://gitter.im/sparkling-graph/sparkling-graph?utm_source=badge\u0026utm_medium=badge\u0026utm_campaign=pr-badge)\n[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fsparkling-graph%2Fsparkling-graph.svg?type=shield)](https://app.fossa.io/projects/git%2Bgithub.com%2Fsparkling-graph%2Fsparkling-graph?ref=badge_shield)\n\nSparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.\n\n# Requirements\n\n - Scala 2.11 or 2.12\n - Spark 2.4.0  (or compatible)\n\n# Versioning\n\nSince commit `3246714` project is using git versioning (for example `0.0.7+140-32467140` or `0.0.7+140-32467140+20190402-2057-SNAPSHOT`). All artifacts from now one will be published to snapshot without version overriding. New approach will also add abbility to reproduce each version. Release versions will use normal tag based approach.\n\n# Dependencies\n\nSince commit `3246714` you can get artifacts for any master branch commits using `git describe` command. \n\n## Snapshot\n```\nresolvers +=  \"Sonatype OSS Snapshots\" at \"https://oss.sonatype.org/content/repositories/snapshots\"\n```\n```\n// one or all from:\nlibraryDependencies += \"ml.sparkling\" %% \"sparkling-graph-examples\" % \"0.0.8-SNAPSHOT\"\nlibraryDependencies += \"ml.sparkling\" %% \"sparkling-graph-loaders\" % \"0.0.8-SNAPSHOT\"\nlibraryDependencies += \"ml.sparkling\" %% \"sparkling-graph-operators\" % \"0.0.8-SNAPSHOT\"\n```\n## Release\n\n```\n// one or all from:\nlibraryDependencies += \"ml.sparkling\" %% \"sparkling-graph-examples\" % \"0.0.7\"\nlibraryDependencies += \"ml.sparkling\" %% \"sparkling-graph-loaders\" % \"0.0.7\"\nlibraryDependencies += \"ml.sparkling\" %% \"sparkling-graph-operators\" % \"0.0.7\"\n```\n\n# Current features\n\n* Loading\n  * Formats: \n    * CSV\n    * GraphML\n  * DSL\n* Measures -  measures can be configured to treat graphs as directed and undirected\n  * Measures DSL - easy to use domain specific language that boost productivity of library\n  * Graph\n    * Modularity\n    * Freeman's network centrality\n  * Vertex\n    *  Closeness\n    *  Local clustering\n    *  Eigenvector\n    *  Hits\n    *  Neighbor connectivity\n    *  Vertex embeddedness\n    * Betweenness\n      * Edmonds\n      * Flow\n      * Hua\n  * Edges\n    * Adamic/Adar\n    * Common neighbours\n* Comunity detection methods\n  * PSCAN (SCAN)\n* Graph coarsening\n  * Label Propagation based\n* Link prediction\n  * Similarity measure based\n* Generators\n  * Ring\n  * Watts And Strogatz\n* Experiments\n  *  Describe graph using all measures to CSV files\n\n# Planned features\n* Loading\n  *  GML\n* Measures\n  * Katz\n* Comunity detection methods\n  * Modularity maximization\n  * Infomap\n* More Generators\n* API\n  *  Random walk\n  *  BFS\n* ML\n  *  Vertex classification\n \n# Used by\n\n\u003ca href=\"http://www.miniclip.com\"\u003e\u003cimg src=\"http://vignette2.wikia.nocookie.net/logopedia/images/d/d3/Miniclip.svg/revision/latest?cb=20140406121232\" width=250px/\u003e\u003c/a\u003e \u003ca href=\"http://datasciencegroup.pl/\"\u003e\u003cimg src=\"http://datasciencegroup.pl/assets/images/logo-dsg.png\" width=250px/\u003e\u003c/a\u003e \u003ca href=\"http://pwr.edu.pl\"\u003e\u003cimg src=\"https://iwa-ywp.eu/wp-content/uploads/2015/11/%E2%80%8Ewww.portal.pwr_.wroc_.pl-files-prv-id24-logotypy-LogotypPWr-logo-PWr-pion-poziom_wszystkie_pl-en_2016.pdf-Safari-Today-at-18.17.03.png\" width=250px /\u003e\u003c/a\u003e\n\n# Supported by:\n\n\u003ca href=\"https://www.jetbrains.com/buy/opensource/\"\u003e\u003cimg src=\"https://sos-software.com/wp-content/uploads/Jetbrains_logo.png\" width=100px /\u003e\u003c/a\u003e provides us awesome IDE\n \n# How to\n\nPlease check [API](http://sparkling-graph.github.io/sparkling-graph/latest/api/), [examples](https://github.com/sparkling-graph/sparkling-graph/tree/master/examples/src/main/scala/ml/sparkling/graph/examples) or [docs](http://sparkling-graph.readthedocs.org/en/latest/)\n\n\n\n# Citation\nIf you use SparklingGraph in your research and publish it, please consider citing us, it will help us get funding for making the library better.\nCurrently manuscript is in preparation, so please us following references:\n\n ``` Bartusiak et al. (2017). SparklingGraph: large scale, distributed graph processing made easy. Manuscript in preparation. ```\n \n ```\n@unpublished{sparkling-graph\ntitle={SparklingGraph: large scale, distributed graph processing made easy},\nauthor={Bartusiak R., Kajdanowicz T.},\nnote = {Manuscript in preparation},\nyear = {2017}\n}\n```\n\n\n## License\n[![FOSSA Status](https://app.fossa.io/api/projects/git%2Bgithub.com%2Fsparkling-graph%2Fsparkling-graph.svg?type=large)](https://app.fossa.io/projects/git%2Bgithub.com%2Fsparkling-graph%2Fsparkling-graph?ref=badge_large)\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsparkling-graph%2Fsparkling-graph","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsparkling-graph%2Fsparkling-graph","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsparkling-graph%2Fsparkling-graph/lists"}