{"id":21482836,"url":"https://github.com/ibmstreams/streamsx.clickstream","last_synced_at":"2025-03-17T09:22:42.990Z","repository":{"id":74839461,"uuid":"103659537","full_name":"IBMStreams/streamsx.clickstream","owner":"IBMStreams","description":"Provide the basic functions and operators to build an application for click or tap stream analytic","archived":false,"fork":false,"pushed_at":"2020-07-10T12:21:11.000Z","size":43054,"stargazers_count":0,"open_issues_count":1,"forks_count":1,"subscribers_count":5,"default_branch":"develop","last_synced_at":"2025-01-23T18:50:34.287Z","etag":null,"topics":["clickstream","ibmstreams","streamanalytics"],"latest_commit_sha":null,"homepage":"https://ibmstreams.github.io/streamsx.clickstream/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/IBMStreams.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-09-15T13:20:09.000Z","updated_at":"2017-12-20T10:20:00.000Z","dependencies_parsed_at":null,"dependency_job_id":"e29c00b5-8fd4-43ec-96a5-5670c4ca1b07","html_url":"https://github.com/IBMStreams/streamsx.clickstream","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IBMStreams%2Fstreamsx.clickstream","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IBMStreams%2Fstreamsx.clickstream/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IBMStreams%2Fstreamsx.clickstream/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IBMStreams%2Fstreamsx.clickstream/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/IBMStreams","download_url":"https://codeload.github.com/IBMStreams/streamsx.clickstream/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244006303,"owners_count":20382443,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["clickstream","ibmstreams","streamanalytics"],"created_at":"2024-11-23T12:38:03.361Z","updated_at":"2025-03-17T09:22:42.985Z","avatar_url":"https://github.com/IBMStreams.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Note:\nThis page is a work in progress. Comments, criticisms, additions, and alternatives are all welcome. Please contribute to the discussion. Please [contribute to the discussion](https://github.com/IBMStreams/streamsx.clickstream/issues).\n\n# streamsx.clickstream\nThe IBMStreams/streamsx.clickstream repository is an open source Streams project focused on the development of a toolkit of basic functions and operators to build an application for click or tap stream analytics. It also provides a streaming architecture based sample application for clickstream analytics.\n\n# Overview\nThe real-time streaming analytics of click or tap streams bears an indispensable significance for digital transformation of all growing enterprises. It provides a way to monitor, qualitatively and quantitatively, the effectiveness of web or mobile applications. In the large scale mobile enterprises environemnt, a real-time clickstreams analytics is imperative to:\n\n- Continously improve customer experience\n- Monitor the effectiveness of the web or mobile applications\n- Remove frictions from customer journeys\n- Positively impact business growth\n- Clinch the points of inflection impacting the revenue streams\n\n# General Architecture\nA typical IBM Streams based clickstream applicaion is built around several microservice applicaitons as following:\n\n1. Acqusition and Enrichment\n    * Clickstreams log/data acqusition\n    * Decryption and sterilization\n    * Sessions or user level enrichment\n2. Hierarchical identification of the events\n    * Hierarchical categorization of service flows\n    * Events identification and classification\n    * Deduplication of events with various hirarcies\n    * Transition detection at various hirarcical levels\n3. Aggregations and sequencing of events\n    * Primary and secondary aggregation\n    * Sequancing of event transitions into hirarcical graph\n    * Statistical data analytics\n4. Common subsequence analytics\n    * Dectection and extraction of common subsequences\n    * Detection of frictions from customer journeys \n\n# Toolkit Components\n### Clickstream Classification Operator\nA scalable and dynamically updated set of classification rules are defined in a JSON file. Each JSON rule specifies string attribute of the input stream, to be matched against a specified string, partial string, or regex. When a rule is matched the specified attributes of the output stream are updated as per the given classification by that rule. \n### Custom aggregate functions for progressive and cascaded aggregates\nInstead of “sliding windows aggregates”, cascaded “tumbing window aggregates” are used to produce Count-By-Distinct function.\n### Graph generator operator\nA custom SPL operator to produce a graph JSON for:\n- Customer journey visualization\n- Path analytics, e.g. Visit count, abandon count, etc.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fibmstreams%2Fstreamsx.clickstream","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fibmstreams%2Fstreamsx.clickstream","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fibmstreams%2Fstreamsx.clickstream/lists"}