{"id":21884072,"url":"https://github.com/mongoexpuser/aws-keyspaces-cassandra-iot-drilling-app","last_synced_at":"2026-04-15T06:35:33.880Z","repository":{"id":134452598,"uuid":"361018133","full_name":"MongoExpUser/AWS-Keyspaces-Cassandra-IOT-Drilling-App","owner":"MongoExpUser","description":"AWS-Keyspaces-Cassandra-IOT-Drilling-App","archived":false,"fork":false,"pushed_at":"2023-01-03T20:05:01.000Z","size":39,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-22T01:31:09.122Z","etag":null,"topics":["aws","boto3","cassandra","cassandra-driver","cloudformation","cql","cqlsh","drilling","iot","keyspaces","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/MongoExpUser.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-04-23T22:19:08.000Z","updated_at":"2021-10-10T14:14:32.000Z","dependencies_parsed_at":null,"dependency_job_id":"d07621ac-508d-4090-9cf7-bd36ec8ac73c","html_url":"https://github.com/MongoExpUser/AWS-Keyspaces-Cassandra-IOT-Drilling-App","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/MongoExpUser/AWS-Keyspaces-Cassandra-IOT-Drilling-App","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MongoExpUser%2FAWS-Keyspaces-Cassandra-IOT-Drilling-App","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MongoExpUser%2FAWS-Keyspaces-Cassandra-IOT-Drilling-App/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MongoExpUser%2FAWS-Keyspaces-Cassandra-IOT-Drilling-App/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MongoExpUser%2FAWS-Keyspaces-Cassandra-IOT-Drilling-App/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/MongoExpUser","download_url":"https://codeload.github.com/MongoExpUser/AWS-Keyspaces-Cassandra-IOT-Drilling-App/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MongoExpUser%2FAWS-Keyspaces-Cassandra-IOT-Drilling-App/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31830151,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-14T18:05:02.291Z","status":"online","status_checked_at":"2026-04-15T02:00:06.175Z","response_time":63,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","boto3","cassandra","cassandra-driver","cloudformation","cql","cqlsh","drilling","iot","keyspaces","python"],"created_at":"2024-11-28T10:12:08.549Z","updated_at":"2026-04-15T06:35:33.859Z","avatar_url":"https://github.com/MongoExpUser.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AWS-Keyspaces-Cassandra-IOT-Drilling-App\n\n### This repo contains source code for a real-time well data drilling application.\nThe application can be used to deliver real-time well drilling operation data into Amazon Keyspaces (for Apache Cassandra) for\nsubsequent use in \u003cstrong\u003e\u003cfont\u003eAIML applications\u003c/font\u003e\u003c/strong\u003e, including:\u003cbr\u003e\n\n(1) \u003cstrong\u003e Anonamly Detections\u003c/strong\u003e. \u003cbr\u003e\n(2) \u003cstrong\u003e Classifications\u003c/strong\u003e. \u003cbr\u003e\n\n### The drilling operation could be any of the followings: \n 1) \u003cstrong\u003eOil\u003c/strong\u003e and \u003cstrong\u003egas\u003c/strong\u003e drilling operation (For shale, conventional, and heavy oil/bitumen reservoirs).\n 2) \u003cstrong\u003eWater\u003c/strong\u003e well drilling operation.\n 3) \u003cstrong\u003eGeothermal\u003c/strong\u003e well drilling operation for \u003cstrong\u003erenewable energy\u003c/strong\u003e.\n \nThe data can be streamed by the application directly or through an intermediate file (.CSV) that is offloaded to S3 bucket at set intermittent interval.\n\n\n### The source code files include:\n1) \u003cstrong\u003ekeyspaces_drlling_client.py\u003c/strong\u003e - Main Python client application code for: \u003cbr\u003e\n   a) Connecting to the DBaaS. \u003cbr\u003e\n   b) Querying (DML, DQL and DDL queries) DBaaS. \u003cbr\u003e\n   \n2) \u003cstrong\u003ekeyspaces_connection_options.json\u003c/strong\u003e - json file for specifying all connection options, which include: \u003cbr\u003e\n    a) Amazon Keyspaces service-specific credentials. \u003cbr\u003e\n    b) Connection port. \u003cbr\u003e\n    c) The DBaaS endpoint. \u003cbr\u003e\n    d) SSL certificate path. \u003cbr\u003e\n   \n3) \u003cstrong\u003ekeyspaces_drilling_cfn.yaml\u003c/strong\u003e - AWS Cloud Formation IaC stack for: \u003cbr\u003e\n   a) Creating the NoSQL DBaaS (Amazon Keystore). \u003cbr\u003e\n   b) Defining (ddl) the Data Model (keyspaces, tables and parametized unique tags). \n   \n4) \u003cstrong\u003eddl_timeseries_keyspace.cql\u003c/strong\u003e and \u003cstrong\u003eddl_drilling_table.cql\u003c/strong\u003e - Cassandra Query Language - CQL's DDL equivalent of of the \u003cstrong\u003ekeyspaces_drilling_cfn.yaml\u003c/strong\u003e file.\n   These can be used to define the DBaaS' keyspace and table via:\u003cbr\u003e\n   a) AWS Management Console's CQL Editor or \u003cbr\u003e\n   b) CQLSH (CSL Shell) using Amazon Keyspaces service-specific credentials.\u003cbr\u003e\n   \n5) \u003cstrong\u003edml_insert.cql\u003c/strong\u003e - sample dml for inserting data into the DBaaS.\n\n6) \u003cstrong\u003edml_update.cql\u003c/strong\u003e - sample dml for updating data on the DBaaS.\n\n7) \u003cstrong\u003edml_delete.cql\u003c/strong\u003e - sample dml for deleting data on the DBaaS.\n\n8) \u003cstrong\u003edql_select.cql\u003c/strong\u003e - sample dql for selecting data from the DBaaS.\n\n9) \u003cstrong\u003eddl_alter.cql\u003c/strong\u003e - sample ddl for altering table capacity units on the DBaaS.\n\n\n### The repo is based on the following languages, frameworks, packages and database servers:\n1) Python v3.8 - (https://www.python.org/downloads/release/python-380/)\n2) Java 8 - Java-8-openjdk (https://openjdk.java.net/)\n3) AWS SDK for Python - Boto3 (https://boto3.amazonaws.com/v1/documentation/api/latest/index.html)\n4) Python Driver for Apache Cassandra  (https://github.com/datastax/python-driver)\n5) CQL Language Reference for Amazon Keyspaces (for Apache Cassandra) - (https://docs.aws.amazon.com/keyspaces/latest/devguide/cql.html)\n6) Amazon Keyspaces (for Apache Cassandra) - (https://docs.aws.amazon.com/keyspaces/latest/devguide/what-is-keyspaces.html)\n7) Apache Cassandra (includes CQLSH) - (https://cassandra.apache.org/)\n\n\n\n# License\n\nCopyright © 2015 - present. MongoExpUser\n\nLicensed under the MIT license.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmongoexpuser%2Faws-keyspaces-cassandra-iot-drilling-app","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmongoexpuser%2Faws-keyspaces-cassandra-iot-drilling-app","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmongoexpuser%2Faws-keyspaces-cassandra-iot-drilling-app/lists"}