Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-bdccai-tools

Werkzeuge für Big Data und Cloud-Computing für KI
https://github.com/cyberlytics/awesome-bdccai-tools

Last synced: 3 days ago
JSON representation

Uncategorized
- Uncategorized
  - OTH Amberg-Weiden
  - Chocolatey - n useRememberedArgumentsForUpgrades**
Datenbanksysteme
- Community Edition
- Docker Container
- TPC-H Benchmark - Systeme (suite of business oriented ad-hoc decision support queries and concurrent data modifications)
- DuckDB - Memory-basiertes In-Process-fähiges ACID-konformes RDBMS für analytische Workloads
- Embeddable - reasons-duckdb-slaps/)
- MySQL
- MariaDB - d -p 3306:3306 -e MYSQL_ROOT_PASSWORD=geheim mariadb:latest**\] sowie [Maria **Galera**](https://mariadb.com/kb/en/galera-cluster/) = Multi-Master-Cluster
- PostgreSQL - -params '"/Password:geheim /Port:5432"' --params-global**\]
- SQLite - studio.portable**\]
- **Oracle** eXpress Edition - d -p 1521:1521 -e ORACLE_PASSWORD=geheim gvenzl/oracle-xe**\]
- Microsoft **SQL Server** Express - server-express** sowie **choco install sql-server-management-studio**\] ggf. noch statischen Port 1433 konfigurieren
- IBM **Db2** Community Edition
- CouchDB
- BaseX
- Neo4j - community**\]: [Cypher](https://neo4j.com/developer/cypher/) Anfragesprache (Further Reading: [Neo4j GraphAcademy](https://neo4j.com/graphacademy/online-training/))
- bit.io - 1.4))
- **OCI Cloud** Free Tier - Instanzen, je 20GB, verschieden Typen, bspw. Exadata oder NoSQL
- dbfiddle - basierter SQL-Datenbank-Playground (diverse Datenbanksysteme)
- MongoDB Atlas - Variante des klassischen NoSQL-Systems (The „M“ in MEAN and MERN) – kostenlos für 512MB
- **CockroachDB** SQL-Playground - Variante des NewSQL-Datenbanksystems (s. unten)
- LeanStore - performance OLTP storage engine optimized for many-core CPUs and NVMe SSDs (Prof. Viktor Leis)
- HyPer - memory-based relational DBMS for mixed OLTP and OLAP workloads (aquired by Tableau)
- Umbra - based system with in-memory performance
- Peloton - driving main-memory-based relational DBMS for mixed OLTP and OLAP workloads
Big Data
- Elastic - Stack, insbesondere L = **[Logstash](https://www.elastic.co/logstash/)** \[u.a. via **[Docker](https://www.elastic.co/guide/en/elasticsearch/reference/current/docker.html)**\], Elastic ist im Kern eine verteilte Volltext-Suchmaschine, basierend auf Lucene
- Apache **Hadoop**
- Key/Value-Stores - Stores](https://db-engines.com/de/ranking/document+store) | [Wide-Column-Stores](https://db-engines.com/de/ranking/wide+column+store)
- EXASOL - Source MPP-fähiges und In-Memory-basiertes ACID-konformes RDBMS (MPP-DBMS; OLAP workloads); für analytische Anwendungen wie BI/DWH, DSS und Data Science; sehr hohe SQL-Standard-Kompatibilität und hohe Oracle-SQL-Dialekt-Kompatibilität
- Snowflake - native DWaaS
- CockroachDB - cockroachdb-windows)\]: Open-Source NewSQL; **PostgreSQL**\-compatible; built on a transactional and strongly-consistent key-value store
- YugabyteDB - start/docker/)\]: Open-source NewSQL; **PostgreSQL**\-compatible
- PingCAP **TiDB** - source NewSQL (OLTP/HTAP workloads); **MySQL**\-compatible; built on a transactional key-value store
- Twitter **Summingbird**
- Apache **Flink**
- Stratosphere - dr-volker-markl.html))
- **Kafka** Streams
- Apache **Druid** - time (i.e., sub-second) analytics database, with separation of ingest compute and query compute
- **InfluxDB** Open Source - time (i.e., sub-second) analytics of IoT Data; core component of the [TICK stack](https://www.influxdata.com/time-series-platform/)
- **Splunk** Free
- logz.io
- OpenCL - und/oder datenbasierter Parallelität, als HW-Plattform-Abstraktion für CPUs, GPUs, DSPs, FGPAs, usw.
- JOCL - Abstraktion für OpenGL, OpenAL, OpenCL und OpenVR
- Awesome Big Data
Datenbankwerkzeuge
- DbVisualizer - visualizer**\]: Advanced SQL Editor
- **DBeaver** Community Edition - Source Hintergrund](https://github.com/dbeaver/dbeaver), Open Source **[Beekeeper](https://www.beekeeperstudio.io/)** \[**choco install beekeeper-studio.portable**\]
- DataGrip
- DbSchema
- SchemaCrawler - Source Database Schema Discovery and Comprehension Tool; generates Schema Diagrams
- SchemaSpy
- Navicat Data Modeler - data-modeler-essentials);
- Talend Open Studio
- Airbyte
- Ab Initio - UIW-731/images/Gartner-MQ-2022-Quadrant.png) auftaucht)
- Artikel von Atlan
- Talend Open Studio for Data Quality - US/8.0/studio-user-guide-open-studio-for-data-quality/detecting-anomalies-in-columns-functional-dependency-analysis)
- Data Catalog
- Artikel von Atlan
- Dozenten-Werkzeuge
- SQLFlow
- Artikel von Atlan
- CleverCSV - Code für CSV-Imports, zzgl. Bibliotheksfunktionen für Data Cleaning
- WinPure Clean & Match
- OpenRefine
- DataVault Builder - builder.com/pricing/)
- RelaX
- Functional Dependency Calculator
- Awesome Database Tools - Source Data Engineering](https://github.com/gunnarmorling/awesome-opensource-data-engineering) (ähnliche [Liste mit kommerziellen Optionen](https://github.com/igorbarinov/awesome-data-engineering))
Datenvisualisierung
- Tableau - desktop**\]
- kostenlos für Studierende
- Looker
- Qlik Sense
- kostenlos für Studierende
- Eclipse **BIRT** - Installation\]
- **KNOWAGE** Community Edition
- DataWrapper
- Exploratory Desktop
- kostenlos für Studierende
- Metabase - d -p 3000:3000 --name metabase metabase/metabase**\]
- Panel - Werkzeug basierend auf HoloViz, s. unten)
- Seal Report
- HoloViz
- Plotly Dash
- Awesome Business Intelligence
- Awesome DataViz - data-visualization)
Data Science
- KNIME
- RapidMiner Studio auch Open Source
- **Juyter** Docker Stacks - p 8888:8888 jupyter/scipy-notebook**\]
- binder - Bindeglied zwischen Jupyter und Ihren git-gehosteten Notebook-Dateien (Obacht: Wenn in den USA die Leute aufstehen, dann geht der globally-shared Infrastruktur von binder ggf. die Puste aus, daher ggf. nicht ausreichend zuverlässig für Lehrveranstaltungen oder Konferenz-Demos)
- CoCalc
- SageMath
- SQL Notebook
- Tad
- Google **Collab**
- **kaggle** Datasets - public-datasets)** ⭐
- **100 interesting data sets** for statistics - public-data-sets-data-science-project/)
- Worldbank Open Data
- **Quick Draw!** The Data - ähnlich; bspw. [Ameisen](https://quickdraw.withgoogle.com/data/ant))
- The Stack - Listing](https://www.numbersstation.ai/post/introducing-nsql-open-source-sql-copilot-foundation-models)
- Rucio
- Awesome Data Science - awesome.org/krzjoa/awesome-python-data-science)
Moderne Web-Anwendungsentwicklung
- BuildWith
- JHipster - Docu](https://www.jhipster.tech/tech-stack/)) | [**Spring** Initializr](https://start.spring.io/)
- CodebaseShow » **RealWorld** - Repo](https://github.com/gothinkster/realworld)\] | [**JHipster** Non-Java-Blueprints](https://www.jhipster.tech/modules/official-blueprints/)
- Vaadin
- ASP.NET Core - us/aspnet/core/blazor/?view=aspnetcore-6.0)[Py](https://pyscript.net)[: PyScript](https://pyscript.net)
- 11 **Micro Frontends Frameworks** You Should Know
- üblichen Verdächtigen - side):
- ASP.NET Core - aspnetruntime\]
- RoR
- Laravel
- OpenUI5
- Business Technology Platform (**BTP**)
- Fiori
- AppGyver - platform/no-code-app-builder/get-started.html)** (Low-Code-Plattform; technisch losgelöst von OpenUI5/SAPUI5)
- Awesome **Markdown**
- **.htaccess** Generator - echoplex.net/flexyboxes/)
- HTML **Cleaner** - cleaner.com/css/) und [JS](https://html-cleaner.com/js/)) sowie HTML Beautifier **[DirtyMarkup](https://www.10bestdesign.com/dirtymarkup/)**
- URL-Decoder
- List of (free) **Public APIs**
- Obsidian
- ObisdianShell
- MK's Guide **Empfehlungsliste** - **advanced-uri**](https://github.com/Vinzent03/obsidian-advanced-uri), [obsidian-**languagetool**\-plugin](https://github.com/Clemens-E/obsidian-languagetool-plugin)
- Bildmaterialien
- Tools for Web Designers #1 - little-web-based-tools-web-designers/), [CSS-Tools](https://speckyboy.com/free-tools-apps-css/)
- W³Techs - Versions](https://w3techs.com/technologies/details/pl-php), [Wordpress-Versions](https://w3techs.com/technologies/details/cm-wordpress), uvm.)
- **Lorem-Ipsum**\-Generatoren
- neuroflash - gestützte Textgenerierung, kann Deutsch, stilistisch das was man „SEO-optimiert“ nennt (kostenlose 2000 Wörter)
- AI writing assistants - first“, „Give me some ideas for a …“ und weitere: [ChatGPT-**Cheatsheet**](https://www.kdnuggets.com/publications/sheets/ChatGPT_Cheatsheet_Costa.pdf)) aber auch ältere Werkzeuge wie bspw. [rytr.me](https://rytr.me) (kostenlose 10K Zeichen), [copy.ai](https://www.copy.ai/) (kostenlose 2000 Wörter) oder [simplified](https://simplified.com/pricing) (kostenlose 3000 Wörter)
- Awesome Generative AI
- **WebGazer**.js - gaze locations of web visitors on a page in real time
- Metered
- coturn
- Awesome Real Time Communications
- Heroku
- Hetzner
- Google Rank Checker
- Website Analyzer
- Awesome Search Engine Optimization - seo-tools/) | buffer [Free SEO Tools](https://buffer.com/library/free-seo-tools/)
- KrakenD
- Quarkus - native Java Stack
- Awesome Webdesign - dev-bookmarks/blob/master/TOTALLY-GIGANTIC-FILE.md) | [Awesome Microservices](https://github.com/mfornos/awesome-microservices) | [Awesome CRDT](https://github.com/alangibson/awesome-crdt)
Cloud-Computing
- Micronaut
- Amazon **AWS** - services/), [**Google** Cloud](https://cloud.google.com/free), [**Alibaba** Cloud](https://www.alibabacloud.com/free), [**IBM** Cloud](https://www.ibm.com/cloud/free), [**Tencent** Cloud](https://www.tencentcloud.com/campaign/freetier), [Oracle **OCI**](https://www.oracle.com/cloud/free/), Heroku (no free tier anymore \*sigh\*), **[DigitalOcean](https://www.digitalocean.com/pricing/app-platform)**, [**SAP** BTP](https://www.sap.com/products/technology-platform/trial.html)
- Azure for Students
- Vercel - service/static/) \[**[Awesome JAMstack](https://github.com/automata/awesome-jamstack)**\]
- podman - Gehversuche](https://github.com/containers/podman/blob/main/docs/tutorials/podman-for-windows.md)) sowie ggf. [buildah](https://buildah.io/) direkt
- KataContainers - microvm.GitHub.io/), google [gVisor](https://gvisor.dev/) (und historisch: CoreOS [rkt](https://github.com/rkt/rkt), später per [CNCF archived](https://www.cncf.io/archived-projects/))
- CRI-O
- Play with Docker - basierte Docker-Umgebung
- hadolint - -rm -i hadolint/hadolint < Dockerfile**\]
- . - ignore-dockerignore-2/)\-Generator!?)
- Divio - basierte Proof-of-Concept WebApps
- Alpine
- GHCR
- Quay
- docker run … [docker.io/registry:2
- Play with K8s - basierte Kubernetes-Umgebung
- **OpenShift** Playground - basierte OpenShift-Umgebung
- Rancher Desktop - desktop**\]: Runs Kubernetes and container management on your desktop
- RKE1 - Container-basiert, über [RancherOS](https://github.com/rancher/os), mit Docker als Container Engine) \[**choco install rke**\]
- K8sGPT
- Acorn
- Vagrant
- Packer
- TerraForm
- Vault
- Consul - tools)**
- Nomad
- Waypoint
- Resilience4j
- Arkade - of-apps) for Kubernetes
- Portainer
- cAdvisor
- Quarkus
- Val Town
- Apache **OpenWhisk**
- Knative - sponsored Open Source Serverless Cloud Platform
- OpenFaaS - based [Scale to Zero](https://docs.openfaas.com/openfaas-pro/scale-to-zero/)
- Cellery - based [Knative](https://knative.dev/)
- Cold-Start - Zeiten:
- SWE » DevOps
- Kepler - Metriken exportierbar
- Nubenetes - awesome-lists/) | [Awesome Sysadmin](https://github.com/awesome-foss/awesome-sysadmin) | [Awesome Chaos Engineering](https://github.com/dastergon/awesome-chaos-engineering) | [Awesome AWS](https://github.com/donnemartin/awesome-aws) | [Awesome Serverless](https://github.com/anaibol/awesome-serverless) | [Awesome Lambda Essentials](https://github.com/danteata/awesome-aws-lambda) | [Awesome Lambda Layers](https://github.com/mthenw/awesome-layers)
- Kubernetes Failure Stories
Mobile Apps
- Android Studio
- JetBrains **AppCode**
- Ionic
- Flutter
- Instabug
- GoNative
- Adapty - Code Plattform und SDK um In-App Subscriptions einfach in Mobile Apps zu integrieren
Semantic Web / Knowledge Representation
- Protégé Desktop - started/))
- WebProtégé
- Schema.org - knowledge.org/graph/) | [SparQL on **YAGO**](http://www.yago-knowledge.org/sparql) | [SparQL on **Wikidata**](https://query.wikidata.org/) | [SparQL on **DBpedia**](https://dbpedia.org/sparql) | [**prefix**.cc](https://prefix.cc/)
- OpenLink **Virtuoso** - Source Edition (VOS)](http://vos.openlinksw.com/owiki/wiki/VOS/VOSDownload) \[via [Docker](https://hub.docker.com/r/openlink/virtuoso-opensource-7)\]: SPARQL- und SQL-fähiges Multi-Modell-Datenbanksystem / RDF Database
- Apache **Jena** - fähiger Triple Store / RDF Database
- Ontotext **GraphDB** - fähiger Triple Store / RDF Database \[with OWL reasoning, forward-chaining\]
- Awesome Semantic Web - knowledge-graph), [Awesome Linked Data](https://github.com/nandana/awesome-linkeddata)
Verteilte Systeme
- parallel-ssh - ssh\]: asynchronous parallel SSH client library
- Apache **Kafka** - source pub/sub event streaming, Pull-based approach (open-sourced by LinkedIn in 2011, based on Java/Scala)
- Akka.NET - based Actor Model for C# and F# (see also [petabridge.cmd](https://cmd.petabridge.com) \[choco install petabridge-cmd\])
- ZeroMQ - source universal messaging library
- NetMQ
- Datomic - Implementierung von [Rich Hickey](https://github.com/tallesl/Rich-Hickey-fanclub), dabei architekturell interessant weil Distributed, Transactional und Immutable
- Conflict-free Replicated Data Types (**CRDT**)
- Awesome Distributed System Projects - crdt)
Operations Research (OR) / Optimization
- OPTIMA 103
- for Optimizaton Software
- CBC - OR CLP/**[CBC](https://github.com/coin-or/Cbc)**, **[HiGHS](https://highs.dev/)**, **[SCIP](https://www.scipopt.org/)**
- CPLEX - MP](http://www.fico.com/en/products/fico-xpress-optimization-suite/)**, **[MOSEK](https://www.mosek.com/)**
- Pulp - or.org/Cmpl)**, …

Programming Languages

Go 3 C# 3 Python 3 C++ 1 Java 1 Haskell 1 C 1 Scala 1

Ecosyste.ms: Awesome

awesome-bdccai-tools

Uncategorized

Uncategorized

Datenbanksysteme

Big Data

Datenbankwerkzeuge

Datenvisualisierung

Data Science

Moderne Web-Anwendungsentwicklung

Cloud-Computing

Mobile Apps

Semantic Web / Knowledge Representation

Verteilte Systeme

Operations Research (OR) / Optimization