{"id":22845192,"url":"https://github.com/kolia1985/kolia1985","last_synced_at":"2025-03-31T05:26:46.677Z","repository":{"id":263605183,"uuid":"890911919","full_name":"mykolamelnykml/mykolamelnykml","owner":"mykolamelnykml","description":"Mykola Melnyk profile","archived":false,"fork":false,"pushed_at":"2025-03-19T11:32:48.000Z","size":22,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-19T12:31:03.004Z","etag":null,"topics":["data-engineering","data-science","spark"],"latest_commit_sha":null,"homepage":"https://stabrise.com","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mykolamelnykml.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-11-19T11:57:30.000Z","updated_at":"2025-03-19T11:32:51.000Z","dependencies_parsed_at":"2024-12-13T07:28:19.465Z","dependency_job_id":"fb971525-6174-4e94-9540-90a78e52d870","html_url":"https://github.com/mykolamelnykml/mykolamelnykml","commit_stats":null,"previous_names":["kolia1985/kolia1985","mykolamelnykml/mykolamelnykml"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mykolamelnykml%2Fmykolamelnykml","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mykolamelnykml%2Fmykolamelnykml/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mykolamelnykml%2Fmykolamelnykml/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mykolamelnykml%2Fmykolamelnykml/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mykolamelnykml","download_url":"https://codeload.github.com/mykolamelnykml/mykolamelnykml/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246421034,"owners_count":20774428,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-engineering","data-science","spark"],"created_at":"2024-12-13T03:16:01.248Z","updated_at":"2025-03-31T05:26:46.671Z","avatar_url":"https://github.com/mykolamelnykml.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"Greetings! 👋 \n\nMy name is Mykola Melnyk, and I'm an ML expert with two decades of experience in the software development. I specialize in transforming *complex business ideas into scalable, secure, and efficient AI-driven products*. I have expert knowledge in various areas, enabling me to *deliver cutting-edge, top-tier AI solutions* that drive business growth and improve efficiency.\n\n### Key Areas of My Specialization:\n\n📄 **Natural Language Processing (NLP), Computer Vision (CV), and Optical Character Recognition (OCR):** 5+ years of experience in document processing, understanding, and anonymization. Led the development of Spark OCR (Visual NLP) using technologies such as Python/Scala, PySpark, PyTorch, LLMs, LLama 3, Mini Gemini, LangChain, and Hugging Face Transformers.\n\n⚡ **Big Data Processing with Apache Spark:** 7+ years of experience designing and optimizing large-scale data pipelines for high-performance processing. In-depth knowledge of Spark internals, Spark Structured Streaming, and creator/contributor to the open-source spark-pdf datasource project written in Scala, enhancing Spark’s capabilities.\n\n🔒 **Data De-identification \u0026 Anonymization:** Expert in anonymizing sensitive data from text, images, PDFs, and DICOM files. I ensure privacy, security, and compliance with GDPR and HIPAA standards using NLP, OCR, and computer vision to remove or mask personal information, safeguarding data confidentiality.\n\n🧬 **Healthcare, Pharma, MedTech, BioTech Expertise:** Over 5 years of experience in the healthcare and life sciences sectors, with a strong understanding of formats like DICOM, and expertise in delivering solutions specifically tailored to meet the unique needs of these industries.\n\n### TOP 5 Reasons to Work With Me\n✅ End-to-End Expertise\n\n✅ Complex Problem-Solving Ability\n\n✅ Timely Delivery\n\n✅ Transparent Communication\n\n✅ Scalable Solutions\n\n### Professional Skills\n\n🛠️ **Programming Languages:** Python, Scala\n\n📊 **Data Science \u0026 Machine Learning:** NLP, Computer Vision, Large Language Models (LLMs), Optical Character Recognition (OCR), Model Productionalization, Deep Learning (PyTorch, TensorFlow, Hugging Face Transformers, ONNX, Pandas, CLIP)\n\n💡 **LLMs and Related Tools:** OpenAI GPT, Gemini, Llama 3, FLUX, Together.ai, Ollama, Hugging Face, Langchain, LlamaIndex, LangServe, LangGraph, QLORA, Streamlit, Gradio\n\n⚡ **Big Data \u0026 Distributed Systems:** Big Data Processing, ETL, Stream Processing, Real-Time Aggregation, Apache Spark (PySpark, Spark ML, Spark Structured Streaming), Kinesis, Kafka, Databricks\n\n🚀 **Cloud Computing \u0026 Infrastructure:** Amazon Web Services (AWS), Distributed Systems, CI/CD Pipelines, Docker, Jenkins, Graphite, Grafana, Elasticsearch, Kibana\n\n⚙️ **Databases:** PostgreSQL, MongoDB, Redis, DynamoDB\n\n💼 **CRMs:** Hubspot, ZohoCRM\n\n### Availability\nCommitted to long-term collaborations. Available full-time for your next project.\n\n## My Projects\n\n## Spark PDF DataSource\n\n\u003ca href=\"https://stabrise.com/spark-pdf/\"\u003e\u003ca href=\"https://stabrise.com/spark-pdf/\"\u003e\u003cimg alt=\"Spark Pdf\" src=\"https://stabrise.com/static/images/projects/sparkpdf.webp\" height=\"120\"\u003e\u003c/a\u003e\n\n---\n\n**Source Code**: [https://github.com/StabRise/spark-pdf](https://github.com/StabRise/spark-pdf)\n\n**Home page**: [https://stabrise.com/spark-pdf/](https://stabrise.com/spark-pdf/)\n\n**Quick Start Jupyter Notebook**: [PdfDataSource.ipynb](https://github.com/StabRise/spark-pdf/blob/main/examples/PdfDataSource.ipynb)\n\n---\n\nThe project provides a custom data source for the Apache Spark that allows you to read PDF files into the Spark DataFrame.\n\n### Key features:\n\n- Read PDF documents to the Spark DataFrame\n- Support read PDF files lazy per page\n- Support big files, up to 10k pages\n- Support scanned PDF files (call OCR)\n- No need to install Tesseract OCR, it's included in the package\n\n\n## ScaleDP\n\n\u003ca href=\"https://stabrise.com/scaledp/\"\u003e\u003cimg alt=\"ScaleDP\" src=\"https://stabrise.com/static/images/projects/scaledp.webp\" height=\"120\" /\u003e\u003c/a\u003e\n\n---\n\n**Source Code**: [https://github.com/StabRise/scaledp](https://github.com/StabRise/scaledp)\n\n**Home page**: [https://stabrise.com/scaledp/](https://stabrise.com/scaledp/)\n\n**Quick Start Jupyter Notebook**: [https://github.com/StabRise/ScaleDP-Tutorials/blob/master/1.QuickStart.ipynb](https://github.com/StabRise/ScaleDP-Tutorials/blob/master/1.QuickStart.ipynb)\n\n---\n\nScaleDP is an Open-Source Library for processing documents using Apache Spark.\n\n### Key features:\n\n- Load PDF documents/Images\n- Extract text from PDF documents/Images\n- Extract images from PDF documents\n- OCR Images/PDF documents\n- Run NER on text extracted from PDF documents/Images\n- Visualize NER results\n\n\n## Github\n\n[![Mykola's GitHub stats](https://github-readme-stats-sigma-five.vercel.app/api?username=mykolamelnykml\u0026include_all_commits=true\u0026count_private=true\u0026show_icons=true)](https://github.com/mykolamelnykml)\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkolia1985%2Fkolia1985","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkolia1985%2Fkolia1985","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkolia1985%2Fkolia1985/lists"}