Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/servian/confluence-pusher

A tool to convert and upload markdown documents into Atlassian Confluence

batch-processing confluence confluence-markup markdown

Last synced: 29 Jun 2024

https://github.com/faastjs/faast.js

Serverless batch computing made simple.

batch batch-processing faas javascript library serverless typescript

Last synced: 17 Jun 2024

https://github.com/opencultureconsulting/openrefine-batch

Shell script to run OpenRefine in batch mode (import, transform, export). It orchestrates OpenRefine (server) and a python client that communicates with the OpenRefine API.

bash-script batch-processing code4lib docker etl openrefine

Last synced: 01 Jun 2024

https://github.com/pszemraj/textsum

CLI & Python API to easily summarize text-based files with transformers

batch-processing inference inference-api pipeline summarization summary text text-to-text-transformer transformer transformers

Last synced: 31 May 2024

https://github.com/lilydjwg/pssh

Parallel SSH Tools

batch-processing parallel-processing pssh ssh

Last synced: 26 May 2024

https://github.com/tintinweb/ida-batch_decompile

*Decompile All the Things* - IDA Batch Decompile plugin and script for Hex-Ray's IDA Pro that adds the ability to batch decompile multiple files and their imports with additional annotations (xref, stack var size) to the pseudocode .c file

batch-processing decompile ida ida-batch-decompile ida-plugin reverse-engineering

Last synced: 24 May 2024

https://github.com/spring-projects/spring-batch

Spring Batch is a framework for writing batch applications using Java and Spring

batch batch-processing java spring

Last synced: 14 May 2024

https://github.com/NaiboWang/EasySpider

A visual no-code/code-free web crawler/spider易采集：一个可视化浏览器自动化测试/数据采集/爬虫软件，可以无代码图形化的设计和执行爬虫任务。别名：ServiceWrapper面向Web应用的智能化服务封装系统。

batch-processing batch-script code-free crawler data-collection frontend gui html input-parameters layman parameters robotics rpa scraper spider visual visualization visualprogramming web www

Last synced: 14 May 2024

https://github.com/samber/awesome-olap

A curated list of awesome Online Analytical Processing databases, frameworks, ressources and other awesomeness.

analytics awesome awesome-list batch-processing big-data database datalake datawarehouse lakehouse metastore olap processing sql stream-processing streaming timeseries

Last synced: 14 May 2024

https://github.com/j-easy/easy-batch

The simple, stupid batch framework for Java

batch batch-processing java

Last synced: 02 May 2024

https://github.com/scripbox/flume

A blazing fast job processing system backed by GenStage & Redis.

background-jobs batch-processing concurrent elixir-lang genstage rate-limiting redis scheduled-jobs

Last synced: 01 May 2024

https://github.com/nilenso/goose

The Next-Level background job processing library for Clojure

asynchronous background-processing batch-processing clojure rabbitmq redis scheduler

Last synced: 01 May 2024

https://github.com/Refefer/Dampr

Python Data Processing library

batch-processing dataflow machine-learning mapreduce

Last synced: 27 Apr 2024

https://github.com/guillermo-navas-palencia/optbinning

Optimal binning: monotonic binning with constraints. Support batch & stream optimal binning. Scorecard modelling and counterfactual explanations.

batch-processing binning counterfactual-explanations credit-scoring mdlp optimization python scorecard stream streaming-data woe woebinning

Last synced: 18 Apr 2024

https://github.com/apple/batch-processing-gateway

The gateway component to make Spark on K8s much easier for Spark users.

batch-processing k8s kubernetes spark

Last synced: 17 Apr 2024

https://github.com/iusztinpaul/energy-forecasting

🌀 𝗧𝗵𝗲 𝗙𝘂𝗹𝗹 𝗦𝘁𝗮𝗰𝗸 𝟳-𝗦𝘁𝗲𝗽𝘀 𝗠𝗟𝗢𝗽𝘀 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 | 𝗟𝗲𝗮𝗿𝗻 𝗠𝗟𝗘 & 𝗠𝗟𝗢𝗽𝘀 for free by designing, building and deploying an end-to-end ML batch system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 2.5 𝘩𝘰𝘶𝘳𝘴 𝘰𝘧 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 & 𝘷𝘪𝘥𝘦𝘰 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

3-pipeline-design airflow batch-processing cicd data-versioning docker fastapi feature-store gcp github-actions great-expectations hopsworks ml-monitoring mlops model-registry poetry python sktime streamlit weights-and-biases

Last synced: 14 Apr 2024

https://github.com/pathwaycom/pathway

Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.

batch-processing kafka machine-learning-algorithms pathway python real-time streaming

Last synced: 11 Apr 2024

https://github.com/drichardson/transcode

batch transcode video files with ffmpeg

batch-processing video-transcoding

Last synced: 09 Apr 2024

https://github.com/Comcast/python-batch-runner

A tiny framework for building batch applications as a collection of tasks in a workflow.

batch batch-processing microframework python tiny-framework workflow-engine

Last synced: 09 Apr 2024

https://github.com/btargac/excel-parser-processor

Automate downloads from Excel files in seconds. Simply does the tedious, repetitive operations for rows of Excel files and reports the results. It downloads files from URL(s) in column A, if a new filename is provided at column B it will rename before saving. It will even create sub folders if column C is filled with a valid folder name.

autodownloader batch batch-download batch-processing download downloader electron electronjs excel excel-based excel-download excel-import excel-parse exceldownload filedownloader imagedownloader nodejs rename subfolder

Last synced: 01 Apr 2024

https://github.com/kieranjol/IFIscripts

Detailed documentation is available here: http://ifiscripts.readthedocs.io/en/latest/index.html

batch-processing dcp digital-preservation ffv1 manifest metadata premis tiff-files transcode

Last synced: 31 Mar 2024

https://github.com/orkan/ffmpeg

Convert your media files quickly with FFmpeg library

audio batch-processing batch-script ffmpeg media video windows

Last synced: 31 Mar 2024

https://github.com/alessandrofrancesconi/gimp-plugin-bimp

BIMP. Batch Image Manipulation Plugin for GIMP.

batch-processing c gimp image-manipulation plugin

Last synced: 23 Mar 2024

https://github.com/aureliojargas/replace

Generic file search & replace tool (python)

batch-processing find-and-replace python3 regex

Last synced: 14 Mar 2024