An open API service indexing awesome lists of open source software.

https://github.com/node0/hypercortex

A TUI based LM Swiss army knife and analysis tool
https://github.com/node0/hypercortex

benchmarking cli-tools hyperparameter-tuning llm-evaluation model-diagnostics quantization semantic-analysis visualization

Last synced: 2 months ago
JSON representation

A TUI based LM Swiss army knife and analysis tool

Awesome Lists containing this project

README

          

# HyperCortex

**Semantic profiling system for LLMs across hyperparameter and quantization space.**

HyperCortex is a test harness and diagnostic tool designed to map the behavioral contours of language models across combinatoric hyperparameter configurations. Through structured test batteries, it reveals how quantization, temperature, prompt framing, and context shaping affect metrics such as hallucination rate, coherence, relevance, and perplexity. It produces signature charts like the "Task Solvability vs. Bit Depth" curve, identifying the precision thresholds at which distinct cognitive task classes become tractable. While it does not orchestrate models, HyperCortex surfaces the empirical profiles needed for downstream routing, benchmarking, and model selection.