Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/cqllum/cqllum


https://github.com/cqllum/cqllum

Last synced: about 2 months ago
JSON representation

Awesome Lists containing this project

README

        

## Hi there 👋


🚀 About Me


Hello! I'm a well rounded Data Engineer and Business Intelligence Developer from the United Kingdom, with a strong focus on real-time and batch data processing, full stack development, database administration, and building efficient data pipelines. I specialize in transforming raw data into actionable insights through the development of robust and efficient data pipelines, engaging web applications, and comprehensive dashboards for data visualization.





🎨 My Background


Since the age of 10, I have gained a background in IT, data engineering, web/software development and data analytics.
My expertise includes creating sophisticated data processing scripts and pipelines, developing both frontend and backend web applications, and implementing advanced scripting and automation. I am also adept at designing advanced dashboards that offer deep insights and clear visualizations. I am dedicated to delivering high-quality, scalable solutions and continuously exploring innovative ways to leverage data. I am very sophisticated in my approaches relevant to anything IT, focusing on efficiency and unlocking true potential from systems with my indepth knowledge and eagerness to learn new tech. I am also a heavy supporter of documentation.



💡 Industry Exposure


I have worked in, or have been heavily exposed in to the following industries:


  • Gambling (iGaming), Ecommerce, Warehousing and Logistics, Cyber Security, Cloud Hosting, SaaS, Insurance, Construction, Telecommunications

  • ---


    🦾 What am I currently working on?


    A real time CDC Data Replication process written in
    to speedup data replication from traditional OLTP databases to a ClickHouse Data Warehouse.


    View it here


    ----


    🖊️ Some things I've made


    A real time web page classification and threat analysis application built with
    and

    View it here



    A data warehouse schema creation tool powered by AI and
    to quickly create data structures using your databases Information schema & Google's

    View it here



    A business website generator with full backend control, completely databaseless written in
    to speedup creation of a website using pure PHP and JSON. Including themes, SEO and content control

    View it here


    A secure single note sharing application written in Python (flask)
    to help share sensitive one time note data, allowing you to skip out on 3rd party solutions and avoid compromise.

    View it here


    ----


    💻 Technical Skillset


    Take a look below and learn a bit more about my skillset


    #### **🔑 Key Skills Overview**
    Data Engineering, Frontend+Backend Web Development, API Development, ETL Development, Data Services, Business Intelligence, Data Warehousing, Database Administration, DB Backup/Restore Data Analytics, Dashboarding, Reporting, Query Writing/Optimisation, Stored Procedure/Function Development, Web Scraping, Data Collection, Data Cleansing, Automation, Monitor/Alert Development, Generative AI Development, IoT Development (Cameras Data), Excel Macros/Google Apps Script

    #### **👨‍💻 Programming**
    ![SQL](https://img.shields.io/badge/-SQL-black?style=flat-square&logo=t-sql)
    ![Python](https://img.shields.io/badge/Python-black?logo=python)
    ![PHP](https://img.shields.io/badge/PHP-black?logo=php)
    ![Javascript](https://img.shields.io/badge/JavaScript-black?logo=javascript)
    ![Flask](https://img.shields.io/badge/Flask-black?logo=flask)
    ![Django](https://img.shields.io/badge/Django-black?logo=django)
    ![jQuery](https://img.shields.io/badge/jQuery-black?logo=jQuery)
    ![HTML5](https://img.shields.io/badge/HTML5-black?logo=HTML5)
    ![CSS3](https://img.shields.io/badge/CSS3-black?logo=CSS3)
    ![Bootstrap](https://img.shields.io/badge/Bootstrap-black?logo=Bootstrap)
    ![Bash](https://img.shields.io/badge/Bash-black?logo=gnubash)
    ![PowerShell](https://img.shields.io/badge/PowerShell-black?logo=powershell)
    ![Java](https://img.shields.io/badge/Java-black?logo=openjdk)
    ![React](https://img.shields.io/badge/React-black?logo=react)
    ![Go](https://img.shields.io/badge/Go-black?logo=go)
    ![Perl](https://img.shields.io/badge/Perl-black?logo=perl)
    ![Lua](https://img.shields.io/badge/Lua-black?logo=lua)
    ![C#](https://img.shields.io/badge/C%23-black?logo=csharp)
    ![R](https://img.shields.io/badge/R-black?logo=r)
    ![Google Apps Script](https://img.shields.io/badge/Google%20Apps%20Script-black?logo=google)
    ![GraphQL](https://img.shields.io/badge/-GraphQL-black?style=flat-square&logo=graphql)
    ![Markdown](https://img.shields.io/badge/Markdown-black?logo=markdown)
    ![LaTeX](https://img.shields.io/badge/LaTeX-black?logo=latex)
    ![Jinja](https://img.shields.io/badge/Jinja-black?logo=jinja)
    ![JSON](https://img.shields.io/badge/JSON-black?logo=json)

    #### **💿 Database - SQL/NoSQL - (OLTP/OLAP)**
    ![Postgres](https://img.shields.io/badge/PostgreSQL-black?logo=postgresql)
    ![MicrosoftSQLServer](https://img.shields.io/badge/SQL%20Server-black?logo=microsoft%20sql%20server)
    ![MySQL](https://img.shields.io/badge/MySQL-black?logo=mysql&logoColor=fff)
    ![Mariadb](https://img.shields.io/badge/-Mariadb-black?style=flat-square&logo=mariadb)
    ![SQLite](https://img.shields.io/badge/-SQLite-black?style=flat-square&logo=sqlite)
    ![Oracle](https://img.shields.io/badge/Oracle-black?logo=oracle&logoColor=fff)
    ![ClickHouse](https://img.shields.io/badge/-ClickHouse-black?style=flat-square&logo=clickhouse)
    ![Singlestore](https://img.shields.io/badge/-Singlestore-black?style=flat-square&logo=singlestore)
    ![BigQuery](https://img.shields.io/badge/-BigQuery-black?style=flat-square&logo=googlebigquery)
    ![Redis](https://img.shields.io/badge/-Redis-black?style=flat-square&logo=redis)
    ![MongoDB](https://img.shields.io/badge/-MongoDB-black?style=flat-square&logo=mongodb)
    ![ElasticSearch](https://img.shields.io/badge/-ElasticSearch-black?style=flat-square&logo=elasticsearch)
    ![InfluxDB](https://img.shields.io/badge/-InfluxDB-black?style=flat-square&logo=influxdb)

    #### **🏃 Data Pipelines / Processing (ETL)**
    ![Apache Kafka](https://img.shields.io/badge/-Kafka-black?style=flat-square&logo=apachekafka)
    ![Apache Spark](https://img.shields.io/badge/-Spark-black?style=flat-square&logo=apachespark)
    ![Apache Airflow](https://img.shields.io/badge/-Airflow-black?style=flat-square&logo=apacheairflow)
    ![Zookeeper](https://img.shields.io/badge/-Zookeeper-black?style=flat-square&logo=zookeeper)
    ![Mirrormaker](https://img.shields.io/badge/-Mirrormaker-black?style=flat-square&logo=mirrormaker)
    ![Selenium](https://img.shields.io/badge/-Selenium-black?style=flat-square&logo=selenium)
    ![Chromedriver](https://img.shields.io/badge/-Chromedriver-black?style=flat-square&logo=googlechrome)
    ![Pandas](https://img.shields.io/badge/Pandas-black?style=flat-square&logo=pandas)
    ![NumPy](https://img.shields.io/badge/NumPy-black?style=flat-square&logo=numpy)
    ![SciPy](https://img.shields.io/badge/SciPy-black?style=flat-square&logo=scipy)
    ![Scikit Learn](https://img.shields.io/badge/Scikit%20Learn-black?style=flat-square&logo=scikit-learn)
    ![OpenCV](https://img.shields.io/badge/OpenCV-black?style=flat-square&logo=opencv)
    ![Tensorflow](https://img.shields.io/badge/Tensorflow-black?style=flat-square&logo=tensorflow)
    ![dbt](https://img.shields.io/badge/-dbt-black?style=flat-square&logo=dbt)
    ![Airbyte](https://img.shields.io/badge/-Airbyte-black?style=flat-square&logo=Airbyte)
    ![Seaborn](https://img.shields.io/badge/Seaborn-black?style=flat-square&logo=seaborn)
    ![Matplotlib](https://img.shields.io/badge/-Matplotlib-black?style=flat-square&logo=matplotlib)
    ![NLTK](https://img.shields.io/badge/-NLTK-black?style=flat-square&logo=nltk)

    #### **📊 Business Intelligence (BI) + Monitoring**
    ![Looker](https://img.shields.io/badge/-Looker-black?style=flat-square&logo=looker)
    ![PowerBi](https://img.shields.io/badge/-PowerBi-black?style=flat-square&logo=powerbi)
    ![Tableau](https://img.shields.io/badge/-Tableau-black?style=flat-square&logo=tableau)
    ![Metabase](https://img.shields.io/badge/-Metabase-black?style=flat-square&logo=metabase)
    ![Grafana](https://img.shields.io/badge/-Grafana-black?style=flat-square&logo=grafana)
    ![DataDog](https://img.shields.io/badge/-DataDog-black?style=flat-square&logo=datadog)
    ![Excel](https://img.shields.io/badge/-Excel-black?style=flat-square&logo=microsoftexcel)
    ![Amazon Quicksight](https://img.shields.io/badge/-Amazon%20QuickSight-black?style=flat-square&logo=amazon)
    ![Jaspersoft Studio](https://img.shields.io/badge/-Jaspersoft-black?style=flat-square&logo=jaspersoftstudio)

    #### **☁️ Cloud**
    ![Google Cloud](https://img.shields.io/badge/-Google%20Cloud-black?style=flat-square&logo=google-cloud)
    ![AWS](https://img.shields.io/badge/-Amazon%20Web%20Service-black?style=flat-square&logo=amazon)
    ![Azure](https://img.shields.io/badge/-Microsoft%20Azure-black?style=flat-square&logo=microsoftazure)
    ![DigitalOcean](https://img.shields.io/badge/-Digital%20Ocean-black?style=flat-square&logo=digitalocean)
    ![OVH](https://img.shields.io/badge/-OVH-black?style=flat-square&logo=ovh&logoColor=blue)
    ![IONOS](https://img.shields.io/badge/-IONOS-black?style=flat-square&logo=ionos&logoColor=blue)
    ![Vultr](https://img.shields.io/badge/-Vultr-black?style=flat-square&logo=vultr&logoColor=blue)
    ![Vercel](https://img.shields.io/badge/-Vercel-black?style=flat-square&logo=vercel)

    #### **🎫 OS Exposure**
    ![Windows](https://img.shields.io/badge/-Windows-black?style=flat-square&logo=windows)
    ![iOS](https://img.shields.io/badge/-iOS-black?style=flat-square&logo=apple)
    ![MacOS](https://img.shields.io/badge/-MacOS-black?style=flat-square&logo=apple)
    ![Ubuntu](https://img.shields.io/badge/-Ubuntu-black?style=flat-square&logo=ubuntu)
    ![Debian](https://img.shields.io/badge/-Debian-black?style=flat-square&logo=debian)
    ![CentOs](https://img.shields.io/badge/-CentOS-black?style=flat-square&logo=centos)
    ![Rocky Linux](https://img.shields.io/badge/-Rocky%20Linux-black?style=flat-square&logo=rockylinux)
    ![Red Hat](https://img.shields.io/badge/-Red%20Hat-black?style=flat-square&logo=redhat)
    ![ChromeOS](https://img.shields.io/badge/-ChromeOS-black?style=flat-square&logo=google-chrome)
    ![Android](https://img.shields.io/badge/-Android-black?style=flat-square&logo=android)

    #### **🧉 Virtualisation**
    ![Proxmox](https://img.shields.io/badge/-Proxmox-black?style=flat-square&logo=proxmox)
    ![VMWare](https://img.shields.io/badge/-VMWare-black?style=flat-square&logo=vmware)
    ![VirtualBox](https://img.shields.io/badge/-VirtualBox-black?style=flat-square&logo=virtualbox)
    ![HyperV](https://img.shields.io/badge/-HyperV-black?style=flat-square&logo=microsoft)
    ![Nutanix](https://img.shields.io/badge/-Nutanix-black?style=flat-square&logo=nutanix)
    ![Docker](https://img.shields.io/badge/-Docker-black?style=flat-square&logo=docker)
    ![Kubernetes](https://img.shields.io/badge/-Kubernetes-black?style=flat-square&logo=kubernetes)
    ![Qemu](https://img.shields.io/badge/-Qemu-black?style=flat-square&logo=qemu)

    #### **🤖 AI**
    ![ChatGPT](https://img.shields.io/badge/-ChatGPT-black?style=flat-square&logo=openai)
    ![Google Gemini](https://img.shields.io/badge/-Gemini-black?style=flat-square&logo=googlegemini)
    ![Copilot](https://img.shields.io/badge/-Copilot-black?style=flat-square&logo=microsoft)

    #### **🕒 Version Control**
    ![Git](https://img.shields.io/badge/-Git-black?style=flat-square&logo=git)
    ![GitHub](https://img.shields.io/badge/-GitHub-black?style=flat-square&logo=github)
    ![GitLab](https://img.shields.io/badge/-GitLab-black?style=flat-square&logo=gitlab)

    #### **🤝 Collaboration**
    ![Jira](https://img.shields.io/badge/Jira-black?logo=jira)
    ![Asana](https://img.shields.io/badge/Asana-black?logo=asana)
    ![Manage Engine SD+](https://img.shields.io/badge/Manage%20Engine%20ServiceDesk-black?logo=zoho)
    ![Monday](https://img.shields.io/badge/Monday-black?logo=monday)
    ![Microsoft Teams](https://img.shields.io/badge/Microsoft%20Teams-black?logo=microsoftteams)
    ![Miro](https://img.shields.io/badge/Miro-black?logo=miro)
    ![Slack Badge](https://img.shields.io/badge/Slack-black?logo=slack)
    ![Skype](https://img.shields.io/badge/Skype-black?logo=skype)

    #### **🛠️ Other**
    ![NGINX](https://img.shields.io/badge/-NGINX-black?style=flat-square&logo=nginx)
    ![Apache2](https://img.shields.io/badge/-Apache2-black?style=flat-square&logo=apache)
    ![Lightspeed](https://img.shields.io/badge/-Lightspeed-black?style=flat-square&logo=lightspeed)
    ![Linux](https://img.shields.io/badge/-Linux-black?style=flat-square&logo=Linux)
    ![Microsoft Office](https://img.shields.io/badge/-Microsoft%20Office-black?style=flat-square&logo=microsoft)
    ![Libre Office](https://img.shields.io/badge/-Libre%20Office-black?style=flat-square&logo=libreoffice)
    ![Cloudflare](https://img.shields.io/badge/Cloudflare-black?logo=Cloudflare&logoColor=white)
    ![Heroku](https://img.shields.io/badge/-Heroku-black?style=flat-square&logo=heroku)
    ![Vim](https://img.shields.io/badge/-vim-black?style=flat-square&logo=vim)
    ![Adobe](https://img.shields.io/badge/-Adobe-black?style=flat-square&logo=adobe)
    ![Adobe Photoshop](https://img.shields.io/badge/-Adobe%20Photoshop-black?style=flat-square&logo=adobe-photoshop)
    ![Gimp](https://img.shields.io/badge/-Gimp-black?style=flat-square&logo=gimp)
    ![Adobe XD](https://img.shields.io/badge/-Adobe%20XD-black?style=flat-square&logo=adobe-xd)
    ![Figma](https://img.shields.io/badge/-Figma-black?style=flat-square&logo=figma)
    ![Adobe Illustrator](https://img.shields.io/badge/-Adobe%20Illustrator-black?style=flat-square&logo=adobe-illustrator)