https://github.com/yeautyye/auto-allocator
π Zero-config automatic memory allocator for Rust - just add one line and get up to 1.6x faster allocation performance across all platforms
https://github.com/yeautyye/auto-allocator
allocator automatic cross-platform embedded hardware-aware high-performance memory-management memory-optimization mimalloc no-std performance rust systems-programming wasm zero-config
Last synced: 3 months ago
JSON representation
π Zero-config automatic memory allocator for Rust - just add one line and get up to 1.6x faster allocation performance across all platforms
- Host: GitHub
- URL: https://github.com/yeautyye/auto-allocator
- Owner: YeautyYE
- License: apache-2.0
- Created: 2025-06-30T11:19:14.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2025-07-01T05:15:43.000Z (7 months ago)
- Last Synced: 2025-07-01T06:25:08.882Z (7 months ago)
- Topics: allocator, automatic, cross-platform, embedded, hardware-aware, high-performance, memory-management, memory-optimization, mimalloc, no-std, performance, rust, systems-programming, wasm, zero-config
- Language: Rust
- Homepage:
- Size: 51.8 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE-APACHE
Awesome Lists containing this project
README
# π Auto-Allocator
[](https://crates.io/crates/auto-allocator)
[](https://docs.rs/auto-allocator)
[](https://github.com/YeautyYE/auto-allocator/blob/main/LICENSE-APACHE)
[](https://www.rust-lang.org/)
> **π― One line of code. Platform-intelligent optimization. Zero configuration.**
The smartest memory allocator for Rust that automatically selects the optimal allocator for your platform - delivering performance improvements where possible, and platform compliance where required.
## π Why Developers Choose Auto-Allocator
**π― Smart Optimization for Every Platform**
- **Performance where it helps**: 1.6x faster on multi-core Windows/macOS/Linux ([Microsoft Research](https://www.microsoft.com/en-us/research/uploads/prod/2019/06/mimalloc-tr-v1.pdf))
- **Compliance where it matters**: Respects Android/iOS official policies
- **Efficiency everywhere**: Optimal allocation from servers to microcontrollers
**β‘ Effortless Integration**
- **Truly zero-config** - just `use auto_allocator;` and you're optimized
- **Universal compatibility** - works on every Rust platform
- **Production ready** - handles platform differences automatically
**π§ Platform Intelligence**
- **Respects each platform's strengths** - leverages native optimizations when better
- **Hardware-aware** - adapts to CPU cores and memory constraints
- **Research-backed** - every choice has technical justification
## β‘ Quick Start
### 1. Add Dependency
```toml
[dependencies]
auto-allocator = "*"
```
### 2. Import and Use
```rust
use auto_allocator; // π Done! Memory allocation is now optimized
fn main() {
// Your existing code automatically benefits from optimal allocation
let data = vec![1, 2, 3, 4, 5];
let text = "Hello".repeat(1000);
// No changes needed - just faster memory operations!
println!("π High-performance allocation active!");
}
```
### 3. Verify Optimization (Optional)
```rust
use auto_allocator;
fn main() {
let info = auto_allocator::get_allocator_info();
println!("β
Using: {:?}", info.allocator_type);
println!("π‘ {}", info.reason);
}
```
**β¨ That's literally all you need!** Auto-Allocator handles everything else automatically.
## π¬ How It Works
Auto-Allocator uses **intelligent two-phase optimization**:
```
π COMPILE TIME π RUNTIME β
RESULT
βββββββββββββββββββ βββββββββββββββββββ βββββββββββββββββββ
β Platform β β CPU Core Count β β β
β Detection ββββββββββββββββΆβ Analysis ββββββββββββΆβ Optimal β
β β β β β Allocator β
β Compiler β β Memory β β Selection β
β Analysis ββββββββββββββββΆβ Detection ββββββββββββΆβ β
β β β β β β
β Feature β β Hardware β β β
β Availability ββββββββββββββββΆβ Optimization ββββββββββββΆβ β
βββββββββββββββββββ βββββββββββββββββββ βββββββββββββββββββ
π― 90% of decisions made at compile-time for zero runtime overhead
β‘ Only high-performance platforms need runtime CPU detection
```
### π― Platform-Specific Selection
| Platform | Selected Allocator | Expected Benefit | Technical Reason |
|----------|-------------------|------------------|------------------|
| **π₯οΈ Windows/macOS/Linux (Multi-core)** | **mimalloc** | **1.6x faster allocation** | Microsoft Research-proven performance |
| **π± Android** | **Scudo** | Platform security compliance | Google's official security policy |
| **π± iOS** | **libmalloc** | Deep system integration | Apple's optimization recommendation |
| **π BSD/Solaris** | **Native allocator** | Already optimal | Platform-tuned performance |
| **π€ Embedded** | **embedded-alloc** | Resource efficiency | Designed for constraints |
| **π Debug builds** | **System** | Fast compilation | Development speed priority |
| **π WASM** | **System** | Browser compatibility | Web standard compliance |
### π Performance Results
**When mimalloc is selected** (Windows/macOS/Linux multi-core):
- **1.6x faster allocation** in multi-threaded scenarios ([Microsoft Research](https://www.microsoft.com/en-us/research/uploads/prod/2019/06/mimalloc-tr-v1.pdf))
- **Reduced lock contention** through free-list sharding
- **Better cache locality** and lower memory fragmentation
**Test it yourself**:
```bash
cargo bench # Benchmark your specific workload
```
**Key insight**: Auto-Allocator delivers performance improvements where they matter, while respecting platform policies elsewhere.
## π‘οΈ Security Features
### π When Available (Platform-Dependent)
Security features are **only available on platforms that use mimalloc-secure**:
```toml
# Only effective on Windows/macOS/Linux with mimalloc support
[dependencies]
auto-allocator = { version = "*", features = ["secure"] }
```
### π― Platform-Specific Security
| Platform | Secure Mode Effect | Security Features |
|----------|-------------------|-------------------|
| **π₯οΈ Windows/macOS/Linux** | **mimalloc-secure activated** | Guard pages, encrypted free lists, randomization |
| **π± Android** | **No change** (uses Scudo) | Android's built-in security (UAF protection) |
| **π± iOS** | **No change** (uses libmalloc) | iOS system-level protections |
| **π BSD/Solaris** | **No change** (native allocators) | Platform built-in security hardening |
| **π WASM** | **No change** (browser sandbox) | Browser security model isolation |
| **π€ Embedded** | **No change** (resource constraints) | Standard embedded safety measures |
### π Security Trade-offs
| Configuration | Performance | Security Level | Available On |
|---------------|-------------|----------------|--------------|
| **Default** | 100% speed | Rust safety + platform defaults | All platforms |
| **Secure** | 90% speed | Enhanced heap protection | Windows/macOS/Linux only |
**π‘ Key insight**: Many platforms already have excellent built-in security - Auto-Allocator respects and leverages these instead of overriding them.
## π οΈ Advanced Usage
### π Check What's Being Used
```rust
use auto_allocator;
fn main() {
// π Inspect current allocator selection
let info = auto_allocator::get_allocator_info();
println!("π Active: {:?}", info.allocator_type);
println!("π‘ Why: {}", info.reason);
// π System specifications
println!("π₯οΈ Hardware: {} cores, {} RAM",
info.system_info.cpu_cores,
auto_allocator::format_memory_size(info.system_info.total_memory_bytes));
// β
Validate optimal configuration
let (is_optimal, suggestion) = auto_allocator::check_allocator_optimization();
if !is_optimal {
println!("β οΈ Optimization tip: {}", suggestion.unwrap());
}
// π― Get platform-specific recommendations
let (recommended, reason) = auto_allocator::get_recommended_allocator();
println!("π― Recommended: {:?} - {}", recommended, reason);
}
```
## π¬ Technical Deep-Dive
### π Why mimalloc Dominates Performance
**π― Peer-Reviewed Research**:
- [**Microsoft Research Study**](https://www.microsoft.com/en-us/research/uploads/prod/2019/06/mimalloc-tr-v1.pdf): **1.6x faster** than jemalloc in production
- **Free-list sharding**: Eliminates lock contention in multi-threaded applications
- **Cache-conscious design**: Better memory locality = faster access patterns
- **Battle-tested**: Powers Microsoft Azure, Office 365, and Windows services
## π‘ Examples & Tutorials
Explore real-world usage in the [`examples/`](examples/) directory:
| Example | Use Case | What You'll Learn |
|---------|----------|-------------------|
| **[π simple_demo](examples/simple_demo/)** | Basic integration | Zero-config setup + system introspection |
| **[β
optimization_check](examples/optimization_check/)** | CI/CD validation | Automated performance verification |
| **[π web_server](examples/web_server/)** | Production server | High-throughput web application |
| **[π€ embedded_system](examples/embedded_system/)** | IoT/Embedded | Resource-constrained optimization + Real no_std compilation |
## π License
**Flexible licensing** for maximum compatibility:
- **[MIT License](LICENSE-MIT)** - Permissive, commercial-friendly
- **[Apache License 2.0](LICENSE-APACHE)** - Enterprise-preferred, patent protection
- **[Mozilla Public License 2.0](LICENSE-MPL)** - Copyleft alternative
**Choose the license that best fits your project!**
## π Research & References
### π Core Research
- **[mimalloc: Free List Sharding in Action](https://www.microsoft.com/en-us/research/uploads/prod/2019/06/mimalloc-tr-v1.pdf)** - Microsoft Research
- **[A Scalable Concurrent malloc(3) Implementation](https://people.freebsd.org/~jasone/jemalloc/bsdcan2006/jemalloc.pdf)** - Jason Evans (Facebook)
### π’ Platform Documentation
- **[Android Scudo Hardened Allocator](https://source.android.com/docs/security/test/scudo)** - Android AOSP
- **[Apple Memory Management Guidelines](https://developer.apple.com/library/archive/documentation/Performance/Conceptual/ManagingMemory/Articles/MemoryAlloc.html)** - Apple Developer