{"id":37161292,"url":"https://github.com/italoag/repocloner","last_synced_at":"2026-01-14T19:12:10.518Z","repository":{"id":297680163,"uuid":"997573197","full_name":"italoag/repocloner","owner":"italoag","description":"Git Complete Repository Cloner","archived":false,"fork":false,"pushed_at":"2025-12-01T12:25:53.000Z","size":15744,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-12-05T03:32:00.327Z","etag":null,"topics":["clone","clone-coding","git","multi-repository","repo-cloner","repository","repository-clone","repository-cloning"],"latest_commit_sha":null,"homepage":"https://repocloner.italo.xyz","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/italoag.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-06-06T19:00:55.000Z","updated_at":"2025-12-04T03:34:13.000Z","dependencies_parsed_at":"2025-06-06T20:26:19.628Z","dependency_job_id":"ce2ff7c2-a168-423e-ad4c-92de930938ad","html_url":"https://github.com/italoag/repocloner","commit_stats":null,"previous_names":["italoag/ghcloner","italoag/repocloner"],"tags_count":6,"template":false,"template_full_name":null,"purl":"pkg:github/italoag/repocloner","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/italoag%2Frepocloner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/italoag%2Frepocloner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/italoag%2Frepocloner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/italoag%2Frepocloner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/italoag","download_url":"https://codeload.github.com/italoag/repocloner/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/italoag%2Frepocloner/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28431724,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T18:57:19.464Z","status":"ssl_error","status_checked_at":"2026-01-14T18:52:48.501Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["clone","clone-coding","git","multi-repository","repo-cloner","repository","repository-clone","repository-cloning"],"created_at":"2026-01-14T19:12:09.786Z","updated_at":"2026-01-14T19:12:10.511Z","avatar_url":"https://github.com/italoag.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# repocloner\n\n\u003e 🚀 A high-performance, concurrent GitHub and Bitbucket repository cloner built with Go\n\n[![CI](https://github.com/italoag/repocloner/workflows/CI/badge.svg)](https://github.com/italoag/repocloner/actions)\n[![Go Report Card](https://goreportcard.com/badge/github.com/italoag/repocloner)](https://goreportcard.com/report/github.com/italoag/repocloner)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n[![Go Version](https://img.shields.io/badge/Go-1.24.3+-blue.svg)](https://golang.org)\n\n**repocloner** is a powerful command-line tool designed for efficiently cloning multiple GitHub and Bitbucket repositories concurrently. It features an enhanced terminal UI with real-time progress tracking, structured logging, and intelligent worker pool management.\n\n**📖 [Versão em Português](README_pt.md)**\n\n## ✨ Features\n\n- **🔄 Concurrent Processing**: Clone multiple repositories simultaneously using configurable worker pools\n- **📊 Real-time Progress Tracking**: Interactive terminal UI with live progress updates\n- **🎯 Smart Filtering**: Advanced filtering by language, size, fork status, and update date\n- **📁 Flexible Organization**: Support for GitHub (users/orgs) and Bitbucket (users/workspaces)\n- **🛠️ Multiple Interfaces**: Choose between CLI and TUI (Terminal User Interface)\n- **📋 Multiple Output Formats**: Export repository lists as table, JSON, or CSV\n- **🔐 Token Support**: GitHub API token and Bitbucket API token integration with rate limiting\n- **🏗️ Domain-Driven Design**: Clean architecture with SOLID principles\n- **📝 Structured Logging**: Comprehensive logging with configurable levels\n- **🐳 Docker Support**: Ready-to-use Docker images\n\n## 🚀 Installation\n\n### 📦 Pre-built Binaries\n\nDownload the latest release from the [releases page](https://github.com/italoag/repocloner/releases):\n\n```bash\n# Linux (amd64)\ncurl -L https://github.com/italoag/repocloner/releases/latest/download/repocloner-linux-amd64.tar.gz | tar xz\nsudo mv repocloner /usr/local/bin/\n\n# macOS (amd64)\ncurl -L https://github.com/italoag/repocloner/releases/latest/download/repocloner-darwin-amd64.tar.gz | tar xz\nsudo mv repocloner /usr/local/bin/\n\n# Windows (amd64)\n# Download repocloner-windows-amd64.zip and extract to your PATH\n```\n\n### 🐹 From Source (Go)\n\n```bash\n# Install with Go (requires Go 1.24.3+)\ngo install github.com/italoag/repocloner/cmd/repocloner@latest\n\n# Or clone and build\ngit clone https://github.com/italoag/repoclonerr.git\ncd repoclonerr\nmake build\nsudo cp build/repocloner /usr/local/bin/\n```\n\n### 🐳 Docker\n\n```bash\n# Pull the image\ndocker pull ghcr.io/italoag/repocloner:latest\n\n# Run with Docker\ndocker run --rm -v $(pwd):/workspace ghcr.io/italoag/repocloner:latest clone user octocat\n\n# Create an alias for convenience\necho 'alias repocloner=\"docker run --rm -v $(pwd):/workspace ghcr.io/italoag/repocloner:latest\"' \u003e\u003e ~/.bashrc\n```\n\n## 📚 Usage\n\n### 🎯 Quick Start\n\n```bash\n# Clone all repositories from a GitHub user\nrepocloner clone user octocat\n\n# Clone GitHub organization repositories (skip forks)\nrepocloner clone org microsoft --skip-forks\n\n# Clone all repositories from a Bitbucket user\nrepocloner bitbucket user myusername\n\n# Clone Bitbucket workspace repositories\nrepocloner bitbucket workspace myworkspace --skip-forks\n\n# List repositories in JSON format\nrepocloner list user torvalds --format json\n\n# Clone with custom settings\nrepocloner clone user kubernetes --concurrency 16 --depth 1 --base-dir ./repos\n```\n\n### 🔧 GitHub Clone Command\n\nClone repositories from a GitHub user or organization:\n\n```bash\nrepocloner clone [type] [owner] [flags]\n```\n\n**Repository Types:**\n- `user` or `users` - Clone from a GitHub user account\n- `org` or `orgs` - Clone from a GitHub organization\n\n**Examples:**\n\n```bash\n# Basic user cloning\nrepocloner clone user octocat\n\n# Organization with custom concurrency\nrepocloner clone org microsoft --concurrency 8\n\n# Include forks and set custom directory\nrepocloner clone user torvalds --include-forks --base-dir /tmp/repos\n\n# Clone specific branch with shallow depth\nrepocloner clone org kubernetes --branch main --depth 5\n\n# Clone with debug logging\nrepocloner clone user facebook --log-level debug\n```\n\n### 🪣 Bitbucket Clone Command\n\nClone repositories from a Bitbucket user or workspace:\n\n```bash\nrepocloner bitbucket [type] [owner] [flags]\n```\n\n**Repository Types:**\n- `user` or `users` - Clone from a Bitbucket user account\n- `workspace` or `workspaces` - Clone from a Bitbucket workspace\n\n**Authentication:**\nRequires Bitbucket API token:\n```bash\nexport BITBUCKET_API_TOKEN=your-api-token\n```\n\n**Examples:**\n\n```bash\n# Basic user cloning\nrepocloner bitbucket user myusername\n\n# Workspace with custom concurrency\nrepocloner bitbucket workspace myworkspace --concurrency 8\n\n# Include forks and set custom directory\nrepocloner bitbucket user myuser --include-forks --base-dir /tmp/repos\n\n# Clone specific branch with shallow depth\nrepocloner bitbucket workspace myws --branch develop --depth 3\n\n# Clone with debug logging\nrepocloner bitbucket user myuser --log-level debug\n```\n\n**Available Flags:**\n\n| Flag | Description | Default |\n|------|-------------|---------|\n| `--base-dir` | Base directory for cloning | `.` |\n| `--branch` | Specific branch to clone | default branch |\n| `--concurrency` | Number of concurrent workers | `8` |\n| `--depth` | Clone depth (0 for full history) | `1` |\n| `--include-forks` | Include forked repositories | `false` |\n| `--skip-forks` | Skip forked repositories | `true` |\n| `--token` | GitHub personal access token | `$GITHUB_TOKEN` |\n| `--log-level` | Log level (debug/info/warn/error) | `info` |\n\n### 📋 List Command\n\nList and filter repositories without cloning:\n\n```bash\nrepocloner list [type] [owner] [flags]\n```\n\n**Examples:**\n\n```bash\n# List user repositories in table format\nrepocloner list user octocat\n\n# Export organization repositories as JSON\nrepocloner list org microsoft --format json\n\n# Filter by language and size\nrepocloner list user torvalds --language c --min-size 1000000\n\n# Sort by size and limit results\nrepocloner list org kubernetes --sort size --limit 20\n\n# Filter by update date\nrepocloner list user facebook --updated-after 2024-01-01\n\n# Export as CSV for spreadsheets\nrepocloner list org google --format csv --sort updated\n```\n\n**Available Flags:**\n\n| Flag | Description | Default |\n|------|-------------|---------|\n| `--format` | Output format (table/json/csv) | `table` |\n| `--sort` | Sort by (name/size/updated) | `name` |\n| `--limit` | Limit number of results | unlimited |\n| `--min-size` | Minimum repository size (bytes) | `0` |\n| `--max-size` | Maximum repository size (bytes) | unlimited |\n| `--language` | Filter by programming language | all |\n| `--updated-after` | Filter by update date (YYYY-MM-DD) | all |\n| `--include-forks` | Include forked repositories | `false` |\n| `--skip-forks` | Skip forked repositories | `true` |\n\n## ⚙️ Configuration\n\n### 🔑 Authentication\n\n#### GitHub Authentication\n\nrepocloner supports GitHub personal access tokens for higher rate limits and private repository access:\n\n```bash\n# Set via environment variable\nexport GITHUB_TOKEN=\"your_token_here\"\n\n# Or pass directly\nrepocloner clone user octocat --token \"your_token_here\"\n```\n\n**Creating a GitHub Token:**\n1. Go to GitHub Settings → Developer settings → Personal access tokens\n2. Generate a new token with `repo` scope\n3. Copy the token and set it as an environment variable\n\n#### Bitbucket Authentication\n\nrepocloner supports Bitbucket API tokens for authentication:\n\n```bash\n# Set via environment variable\nexport BITBUCKET_API_TOKEN=\"your-api-token\"\n\n# Or pass directly\nrepocloner bitbucket user myuser --bitbucket-api-token \"your-api-token\"\n```\n\n**Creating a Bitbucket API Token:**\n1. Go to Bitbucket Settings → Personal Bitbucket settings → API tokens\n2. Create a new API token with `Repositories: Read` permission\n3. Copy the API token and set it as an environment variable\n\n### 🎨 Terminal UI Features\n\nWhen cloning repositories, repocloner provides a rich terminal interface:\n\n- **📊 Real-time Progress**: Live updates on cloning progress\n- **⚡ Throughput Metrics**: Current speed and estimated completion\n- **📈 Success/Error Counters**: Track successful and failed operations\n- **🎯 Current Operation**: See which repository is being processed\n- **📝 Detailed Logging**: Comprehensive logs with configurable levels\n\n### 🗂️ Directory Structure\n\nBy default, repositories are cloned with this structure:\n\n```\n./\n├── repo1/\n├── repo2/\n└── repo3/\n```\n\nYou can customize the base directory:\n\n```bash\n# Custom base directory\nrepocloner clone user octocat --base-dir /home/user/projects\n\n# This creates:\n/home/user/projects/\n├── repo1/\n├── repo2/\n└── repo3/\n```\n\n## 🏗️ Architecture\n\nrepocloner is built with clean architecture principles:\n\n```\ncmd/repocloner/           # Application entry point\n├── main.go\n\ninternal/\n├── application/       # Business logic layer\n│   ├── services/      # Application services\n│   └── usecases/      # Use case implementations\n├── domain/           # Core business domain\n│   ├── cloning/      # Cloning domain\n│   ├── repository/   # Repository domain\n│   └── shared/       # Shared domain types\n├── infrastructure/   # External concerns\n│   ├── concurrency/  # Worker pool management\n│   ├── git/          # Git operations\n│   ├── github/       # GitHub API client\n│   └── logging/      # Structured logging\n└── interfaces/       # User interfaces\n    ├── cli/          # Command-line interface\n    └── tui/          # Terminal user interface\n```\n\n**Key Design Principles:**\n- **Domain-Driven Design**: Clear separation of business logic\n- **SOLID Principles**: Single responsibility, dependency inversion\n- **Concurrent Processing**: Efficient worker pool implementation\n- **Error Handling**: Comprehensive error management\n- **Testability**: Clean interfaces for easy testing\n\n## 🛠️ Development\n\n### 📋 Prerequisites\n\n- Go 1.24.3 or later\n- Git\n- Make (optional, for convenience)\n\n### 🔨 Building\n\n```bash\n# Clone the repository\ngit clone https://github.com/italoag/repoclonerr.git\ncd repoclonerr\n\n# Build for current platform\nmake build\n\n# Build for all platforms\nmake build-all\n\n# Build static binary\nmake build-static\n```\n\n### 🧪 Testing\n\n```bash\n# Run all tests\nmake test\n\n# Run tests with coverage\nmake cover\n\n# Run benchmarks\nmake bench\n\n# Fast testing during development\nmake test-fast\n```\n\n### 🎯 Quality Checks\n\n```bash\n# Run linting\nmake lint\n\n# Format code\nmake fmt\n\n# Run security checks\nmake sec\n\n# Complete quality workflow\nmake ci\n```\n\n### 🐳 Docker Development\n\n```bash\n# Build Docker image\nmake docker-build\n\n# Run with Docker\nmake docker-run\n\n# Push to registry\nmake docker-push\n```\n\n## 🤝 Contributing\n\nWe welcome contributions! Please see our [Contributing Guidelines](CONTRIBUTING.md) for details.\n\n### 📝 Development Workflow\n\n1. **Fork** the repository\n2. **Create** a feature branch: `git checkout -b feature/amazing-feature`\n3. **Make** your changes following our coding standards\n4. **Test** your changes: `make test`\n5. **Lint** your code: `make lint`\n6. **Commit** your changes: `git commit -m 'Add amazing feature'`\n7. **Push** to the branch: `git push origin feature/amazing-feature`\n8. **Open** a Pull Request\n\n### 🐛 Bug Reports\n\nWhen reporting bugs, please include:\n- Operating system and version\n- Go version\n- repocloner version (`repocloner --version`)\n- Steps to reproduce\n- Expected vs actual behavior\n- Any relevant logs or error messages\n\n### 💡 Feature Requests\n\nWe'd love to hear your ideas! Please open an issue with:\n- Clear description of the feature\n- Use case and motivation\n- Proposed implementation (if you have ideas)\n\n## 📊 Performance\n\nrepocloner is optimized for performance:\n\n- **Concurrent Processing**: Configurable worker pools (default: 8 workers)\n- **Memory Efficient**: Streaming operations where possible\n- **Rate Limiting**: Respects GitHub API limits\n- **Shallow Clones**: Default depth of 1 for faster cloning\n- **Progress Tracking**: Minimal overhead real-time updates\n\n**Benchmarks** (approximate, varies by network and system):\n- **Single Repository**: 2-5 seconds\n- **Organization (50 repos)**: 30-60 seconds with 8 workers\n- **Large Organization (200+ repos)**: 2-5 minutes with 16 workers\n\n## 🔍 Troubleshooting\n\n### Common Issues\n\n**Authentication Errors:**\n```bash\n# Verify your token\ncurl -H \"Authorization: token $GITHUB_TOKEN\" https://api.github.com/user\n\n# Check token scopes\nrepocloner list user octocat --log-level debug\n```\n\n**Rate Limiting:**\n```bash\n# Use authenticated requests\nexport GITHUB_TOKEN=\"your_token_here\"\n\n# Reduce concurrency\nrepocloner clone org large-org --concurrency 4\n```\n\n**Network Issues:**\n```bash\n# Enable debug logging\nrepocloner clone user octocat --log-level debug\n\n# Check connectivity\ncurl -I https://api.github.com\n```\n\n**Permission Errors:**\n```bash\n# Ensure directory is writable\nls -la $(pwd)\n\n# Use custom directory\nrepocloner clone user octocat --base-dir /tmp/repos\n```\n\n## 📄 License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n\n## 🙏 Acknowledgments\n\n- [Charm](https://charm.sh/) for the excellent TUI libraries\n- [Cobra](https://cobra.dev/) for the CLI framework\n- [Zap](https://github.com/uber-go/zap) for structured logging\n- [Ants](https://github.com/panjf2000/ants) for worker pool management\n\n## 📞 Support\n\n- 📧 **Issues**: [GitHub Issues](https://github.com/italoag/repocloner/issues)\n- 💬 **Discussions**: [GitHub Discussions](https://github.com/italoag/repocloner/discussions)\n- 📖 **Documentation**: [Wiki](https://github.com/italoag/repocloner/wiki)\n\n---\n\nMade with ❤️ by [Italo A. G.](https://github.com/italoag)\n\n**📖 [Read this in Portuguese](README_pt.md)**\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fitaloag%2Frepocloner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fitaloag%2Frepocloner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fitaloag%2Frepocloner/lists"}