Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with batch-processing

A curated list of projects in awesome lists tagged with batch-processing .

https://github.com/mazzzystar/focus

Chrome Extension: One-click to batch open websites, double-click to close them.

batch-processing chrome-extension

Last synced: 28 Apr 2025

https://github.com/thechymera/repositorg

Automatically reposit, organize, rename, and process large collections of files.

batch-processing file-management multimedia organizer

Last synced: 19 Apr 2025

https://dylanpieper.github.io/hellmer/

Batch Processing for Chat Models

batch batch-processing ellmer llm package r

Last synced: 06 Apr 2025

https://github.com/prechy123/batch-tools

Batch tools provides various tools which are easy and free to use to work with files completely free and easy to use. Convert document format, background removal, qr code generator, video transcriber, pdf merger, html to pdf, pdf to jpg, json to csv and more!

batch-processing clean-code file-converter frontend image-converter image-processing nextjs14 pdf-tools tailwindcss vercel

Last synced: 05 Mar 2026

https://github.com/thaddeusjiang/nextjs-12-starter

You shouldn't start a wonderful app from scratch every time.

admin-system batch-processing e2e-testing job-scheduler nextjs storybook terraform

Last synced: 08 May 2025

https://github.com/ThaddeusJiang/nextjs-12-starter

You shouldn't start a wonderful app from scratch every time.

admin-system batch-processing e2e-testing job-scheduler nextjs storybook terraform

Last synced: 11 Mar 2025

https://github.com/brakmic/using-thrill

A complete Thrill environment with demo code

batch-processing big-data cpp cpp14 thrill

Last synced: 23 Apr 2025

https://github.com/bitcomplete/gcp-runbatch

Easily run serverless Docker workloads in a transient GCE VM instance

batch-processing google-cloud serverless

Last synced: 20 Feb 2026

https://github.com/sjaak31367/a1111-controlnet-batch-preprocessor

A Python script to run a batch of images through ControlNet via A1111's API.

a1111 a1111-stable-diffusion-webui batch-processing controlnet stable-diffusion-webui

Last synced: 14 Apr 2025

https://github.com/code-parth/webp-converter

WebP Converter: A Windows utility for instant image conversion to WebP format with a simple right-click.

batch-processing context-menu file-conversion image-conversion open-source optimization python-script webp windows-utility

Last synced: 08 Mar 2026

https://github.com/lemonpi/multidim_indexing

Batch multidimensional indexing for pytorch

arrays batch batch-processing indexing numpy python pytorch tensor voxel-grid voxels

Last synced: 21 Jul 2025

https://github.com/mitay-walle/com.mitay-walle.asset-process-graph

Designer-oriented replacement for Unity3d-official Asset Graph (abondoned at 2020), help batch process assets. UPM package, Easy extendable

batch-processing unity3d upm-package workflow

Last synced: 24 Oct 2025

https://github.com/richjackson/cogstack

Database - Elasticsearch realtime mapping. With NLP goodiness.

batch-processing elasticsearch natural-language-processing partitioning spring-batch

Last synced: 17 Jul 2025

https://github.com/rbbrdckybk/comfy-batcher

A simple command-line, API-driven, batch-prompter for ComfyUI with a workflow for Flux.

api-client batch-processing comfyui flux

Last synced: 21 Aug 2025

https://github.com/shixiangwang/regport

Regression Model Processing Port

batch-processing r-package regression-models rstats

Last synced: 11 Oct 2025

https://github.com/dylanpieper/hellmer

Batch Processing for Chat Models

batch batch-processing ellmer llm package r

Last synced: 16 Jun 2025

https://github.com/poissonconsulting/batchr

An R package to batch process files with a user-supplied R function

batch-processing rstats

Last synced: 02 Aug 2025

https://github.com/fiware/tutorials.crud-operations

:blue_book: FIWARE 103: Manipulating Context Data through CRUD Operations

batch-processing crud crud-operation entity fiware fiware-orion postman-collection tutorial

Last synced: 30 Apr 2025

https://github.com/olafwrieden/batch-transcription-python-azure-databricks

Referencing a Blob Storage (in Azure) containing voice recordings, we want to be able to call the Speech to Text Cognitive Service in Azure to transcribe the respective recordings in parallel (batch), and save the transcript into another Blob Storage container.

azure batch-processing databricks python speech-to-text transcription

Last synced: 11 Apr 2025

https://github.com/nathievzm/lumi

🌸 your lightning-fast and interactive cli companion to resize, convert, and optimize media in seconds.

batch-processing bun cli cli-app cli-tool concurrency image-optimization image-processing image-resizer media-processing sharp typescript

Last synced: 29 May 2026

https://github.com/makarasty/r6fix

⚙ The game Rainbow Six Siege, after 3-4 matches begins to lag, hang, freeze, as a solution to this problem I invented a program that temporarily solves the problem

batch batch-file batch-processing batch-script batchfile freezing lag problem-solving rainbow-six-siege

Last synced: 02 Mar 2025

https://github.com/jaysongcs/micro-batcher

Interval-based micro batching library for TypeScript/JavaScript

batch batch-processing javascript typescript

Last synced: 26 May 2026

https://github.com/simple-works/folder-creator

📁 Simple batch folder creator for Windows

batch batch-processing creator directory folder generator maker simple

Last synced: 23 Apr 2026

https://github.com/tetrax-10/batch-metadata-editor

This python script removes all metadata from mp4 and mkv files and sets the title and year tag from the file name in batch

batch-metadata-editor batch-processing metadata metadata-editor python-script

Last synced: 14 Apr 2025

https://github.com/saladtechnologies/salad-cloud-job-queue-worker

SaladCloud Job Queue Worker, SDK, and samples

batch-processing go job-queue salad saladcloud

Last synced: 15 Feb 2026

https://github.com/bbc-esq/batch-process-openai-whisper

GUI and accompanying batch file that will use OpenAI's Whisper program to transcribe/translate all files in a directory and/or sub-directories.

batch batch-file batch-processing batch-script batchfile openai-whisper python transcription translation

Last synced: 11 Jul 2025

https://github.com/darsan-in/remige

Remige is an advanced image compression framework, built as a fork of libSquoosh. By integrating Squoosh's powerful image codecs directly into JavaScript applications, Remige offers unparalleled compression performance and file size reduction. Designed for compatibility with the latest Node.js versions, Remige enhances image processing with modern

auto-optimizer batch-processing ci-cd-pipelines high-performance-tools image-compression image-encoding image-optimization image-preprocessing image-processing-pipeline image-resizing javascript-codecs memory-management modern-development node-js-integration node-js-library open-source-projects parallel-processing performance-enhancement squoosh-fork web-development

Last synced: 04 Oct 2025

https://github.com/leonwong282/eagle-movie-picture-stitching

A modern, internationalized Eagle plugin for vertically stitching multiple images into panoramic compositions. Features real-time preview, 8-language support, precise cropping controls, and optimized performance for seamless workflow integration.

automation batch-processing canvas css eagle glass-effect html internationalization js long-picture merge movie picture responsive stitching

Last synced: 04 Apr 2026

https://github.com/yokai-php/batch-src

Yokai Batch Development Monorepo

batch-processing jobs php symfony

Last synced: 08 Jan 2026

https://github.com/servian/confluence-pusher

A tool to convert and upload markdown documents into Atlassian Confluence

batch-processing confluence confluence-markup markdown

Last synced: 11 Apr 2025

https://github.com/bradsec/fontconvert

A bash shell script for batch conversion of font files using fontforge. Supports both TrueType Font (TTF) and OpenType Font (OTF). Convert from either format.

bash-script batch-processing conversion converter fontforge otf-fonts shell-script ttf-fonts

Last synced: 24 Apr 2025

https://github.com/alfacrab/microp

Handy tool for generating a bunch of icons from one source, e.g. for mobile apps development

android-development batch-processing crop-image cropper icons ios-app

Last synced: 12 Feb 2026

https://github.com/pompierninja/beam-amazon-batch-example

A practical example of batch processing on Google Cloud Dataflow using the Go SDK for Apache Beam :fire:

amazon apache-beam batch-processing big-data golang google-cloud-dataflow

Last synced: 28 May 2026

https://github.com/codexparas/db-migrator

DB Migrator is a Spring Boot-based tool for seamless data migration between MySQL, PostgreSQL, and Oracle databases. Using Spring Batch, it supports efficient batch processing and provides REST APIs for migration and data insertion.

batch-processing data-migration mysql openapi oracle postgresql rest-api spring-batch spring-boot

Last synced: 08 Apr 2026

https://github.com/wunderkind2k1/ai-pdf-renamer

AI-powered batch PDF renamer that works fully offline. Extracts text from each PDF, uses a local LLM to generate descriptive filenames, handles errors and invalid characters, and logs actions—no internet or external APIs required. Perfect for private, automated PDF organization.

ai automation batch-processing llama3 local ocr ollama pdf rename-files

Last synced: 24 Jun 2025

https://github.com/scrrlt/vertex-batch-embeddings-api

REST API for managing large-scale text embedding jobs on Google Cloud Vertex AI. Provides support for batch processing, authentication, rate limiting, and integration with Google Cloud Storage for reproducible and scalable workflows.

batch-processing cloud-run-function embeddings-and-vector-databases error-handling flask-rest-api google-cloud-platform jsonl-input-output rate-limiting text-processing vertex-ai webhook-callbacks workflow-tool wrapper-api

Last synced: 18 Jan 2026

https://github.com/michaelakridge-noaa/archive-toolbox

Collection of Tools, Workflows and Processes to help Facilitate Archiving Scientific Data.

archive batch-processing cloud file-transfer file-upload filesystem folder-size gcp-storage google google-cloud-platform python toolbox

Last synced: 24 Oct 2025

https://github.com/goatcheesesaladwithpeanutoildressing/beam-amazon-batch-example

A practical example of batch processing on Google Cloud Dataflow using the Go SDK for Apache Beam :fire:

amazon apache-beam batch-processing big-data golang google-cloud-dataflow

Last synced: 25 Feb 2025

https://github.com/smsraj2001/stream-batch-processing-kafka-spark

A project which includes simulation of real time queries by kafka and performing stream and batch processing of the simulated queries by spark. Also, this follows lambda architecture, in which kafka is publisher and spark helps in subscribing

batch-processing kafka kafka-topics lambda-architecture mysql-database no-api pub-sub pyspark python3 realtime spark streaming ubuntu2204 zookeeper

Last synced: 18 Apr 2026

https://github.com/elgopher/batch-example

Web application example using elgopher/batch package

batch batch-processing go golang high-performance high-throughput

Last synced: 24 May 2026

https://github.com/tamarin-prover/batch-tamarin

A Python package that enables batch execution of tamarin-prover tasks with JSON configuration files and comprehensive reporting.

batch-processing tamarin-prover

Last synced: 14 Jan 2026

https://github.com/denizetkar/dpdk-router

A high performance layer-3 router written with DPDK framework.

batch-processing dir-24-8 dpdk router

Last synced: 16 Mar 2025

https://github.com/stevenjdh/whatsmore

Batch send messages to multiple WhatsApp users from your computer.

batch-processing chat messaging whatsapp whatsapp-api

Last synced: 08 Aug 2025

https://github.com/mawngo/go-batch

Simple batch processing library for golang

batch-processing golang

Last synced: 19 Jun 2025

https://github.com/vinc/runa.sh

Simplify your batch processing workflow

background-jobs batch-processing task-runner task-scheduler

Last synced: 07 Oct 2025

https://github.com/vinyl-davyl/bulldorizer

🚜 Powerful array manipulation utility for splitting, compacting, and doubling arrays.

array array-manipulations batch batch-processing group library npm-package string

Last synced: 16 May 2026

https://github.com/debruine/webmorph

Average and morph faces online http://webmorph.org/

batch-processing faces morphing transforming

Last synced: 20 Jan 2026

https://github.com/inc44/rusty_scissors

Rusty Scissors is a useful tool created with ❤️ using Rust. It quickly trims extra space around images like smart scissors. It's fast, efficient, and precise.

batch-processing cli image-optimization image-processing performance rust windows

Last synced: 14 May 2026

https://github.com/prodrom3/nostos

Zero-dependency Python CLI for batch-updating and curating a fleet of git repositories. SQLite metadata index, fail-closed upstream probes (GitHub / GitLab / Gitea), weekly digest, Obsidian bridge.

automation batch-processing cli devsecops fleet-management git git-pull gitea github gitlab obsidian parallel python red-team repository-management sqlite zero-dependencies

Last synced: 01 May 2026

https://github.com/pszemraj/lm-api

Efficiently query multiple prompts with ease: a command-line tool for batch querying large language models.

api batch-processing gpt-3 gpt-neo gpt-neox openai prompt-engineering prompt-toolkit

Last synced: 20 Oct 2025

https://github.com/codeflowx649/celflow-batch-excel-csv

🚀 Celflow - 一个高效、轻量的命令行工具，用于 Excel 和 CSV 的批量处理，支持转换、合并、去重等功能。 A fast & lightweight CLI tool for batch processing Excel & CSV data, supporting conversion, merging, deduplication & more.

automation batch-processing convert csv excel java-8

Last synced: 12 Feb 2026

https://github.com/orkan/ffmpeg

Convert your media files quickly with FFmpeg library

audio batch-processing batch-script ffmpeg media video windows

Last synced: 10 Oct 2025

https://github.com/pizofreude/de-zoomcamp

This repository contains learning materials and notes for the Data Engineering Zoomcamp by Datatalks.Club.

analytics-engineering batch-processing containerization-with-docker data-engineering data-ingestion data-warehouse streaming workflow-orchestration

Last synced: 05 Apr 2026

https://github.com/cgossain/firebaseresultscontroller

An NSFetchedResultsController replacement for FirebaseDatabase on iOS, written in Swift.

batch-processing diff diffing diffing-data firebase firebase-realtime-database realtime-updates uitableview

Last synced: 16 May 2026

https://github.com/omar-besbes/football-big-data

This is a comprehensive solution for real-time football analytics, leveraging Apache Spark execution on yarn for both streaming and batch processing, Hadoop HDFS for distributed storage, Kafka for real-time data ingestion, RethinkDB for live data updates and Next.js for data visualization as well as a custom built search engine.

batch-processing hadoop kafka nextjs rethinkdb spark streaming t3-stack yarn

Last synced: 01 Oct 2025

https://github.com/nowaytouse/modern-format-boost

A Rust CLI for high-fidelity media transcoding — JPEG XL, AVIF, HEVC, AV1. Features perceptual quality gating (VMAF, PSNR, CAMBI), adaptive CRF search, and BLAKE3-fingerprinted analysis cache.

apple-silicon batch-processing ffmpeg image-conversion jpeg-xl live-photos optimization optimizer psnr rust vmaf

Last synced: 02 May 2026

https://github.com/hfmrow/rename-machine

Linux software designed to rename/cleaning filenames, adding titles (from a list) and provide specific tag insertion and moving files contained in multi directories to a single folder ... lot of option availables (regex, Posix character classes, case sensitive, keep between, extract).

batch-processing extract file-moving filename golang gotk3 insert logical-operations naming rename rename-machine replacing titling

Last synced: 20 Mar 2026

https://github.com/urethramancer/multitool

A grab-bag of functionality for the command line.

batch-processing cli devices hashing limited routers

Last synced: 01 Apr 2025

https://github.com/akornatskyy/sample-etl-flink-java

The sample ingests multiline gzipped files of popular books into postgres.

batch-processing etl flink ingestion java postgres sample

Last synced: 09 Feb 2026

https://github.com/mikaelsundell/jobman

Jobman is a Mac application designed for efficient batch processing of files based on predefined tasks. It features a simple drag-and-drop interface, allowing users to create tool chains that streamline workflows.

batch-app batch-processing conversion file

Last synced: 21 Jan 2026

https://github.com/sinaru/rapidflow

🌊 A Ruby library for concurrent batch data processing through lightweight, composable flows.

batch-processing concurrent ruby

Last synced: 17 Mar 2026

https://github.com/noarche/photo-metadata-batch-cleaner

Batch Clean metadata from photos

batch-processing metadata-deleter

Last synced: 08 Jul 2025

https://github.com/0xibra/blackfeed

Python package that allows you easily and elastically download thousands of files concurrently.

batch-processing concurrency downloader http python

Last synced: 23 Feb 2025

https://github.com/hfmrow/search-and-replace

This program is designed to find and replace a text pattern in one or more files stored in one or more dir, subdir. Search and replace in the clipboard is allowed. Drag and drop can be used. You can use it to search multiple files to find definitions of specific functions in a development environment for example.

batch-processing clipboard code golang gotk3 gtksourceview preview replace search search-and-replace source

Last synced: 16 Dec 2025

https://github.com/yukito0209/recolor-app-icons

这是一个 Python 脚本，用于批量将应用程序图标重新着色为具有特定基础色调的极简、海报化风格。

batch-processing icons image-manipulation image-processing pillow png posterization python recolor script webp

Last synced: 11 Apr 2025

https://github.com/drichardson/transcode

batch transcode video files with ffmpeg

batch-processing video-transcoding

Last synced: 28 Mar 2025

https://github.com/tdanks2000/vtools

A command-line tool to delete videos shorter than a specified duration from a folder.

batch-processing cleaner cli cross-platform ffmpeg ffprobe tools video video-tools

Last synced: 16 May 2026

https://github.com/noarche/securecrypt

Batch Encrypt/Decrypt files in DIR recursivly using AES256.

aes-256 aes-encryption batch-processing encryption-decryption privacy python-script python3

Last synced: 10 Sep 2025

https://github.com/pkharsimran/webm-to-mp3-converter

This repository hosts a powerful and efficient Bash script that is designed to convert WebM audio files to high-quality MP3 files. Built with ffmpeg and the libmp3lame codec, this script provides a simple yet effective solution for batch conversion of WebM files to MP3 format at 320 kbps bitrate and 48 kHz sampling frequency.

audio-conversion audio-processing bash-script batch-processing ffmpeg webm-to-mp3

Last synced: 07 May 2026

https://github.com/stun4j/stun4j-stf

Flexible transaction framework, orchestration mechanism, delay queue, adaptive batch processing, async task chain with lineage, compensatory workflow, distributed, high performance, easy to use

adaptive async-task base-theorem batch-processing delay-queue distributed dsl high-availability high-performance high-reliability horizontal-scalable lightweight lineage orchestration responsive retry-library transaction workflow

Last synced: 17 Jan 2026