{"id":31600229,"url":"https://github.com/akshayboddhul/data-engineering-commands","last_synced_at":"2026-04-10T11:32:09.337Z","repository":{"id":318176375,"uuid":"1070247238","full_name":"akshayboddhul/data-engineering-commands","owner":"akshayboddhul","description":"🔧 Essential Data Engineering Commands - Interactive quick reference with 142+ commands for Linux, Bash, Git, Databricks, Curl, Docker, SQL \u0026 more. Copy-paste ready with search \u0026 dark mode.","archived":false,"fork":false,"pushed_at":"2025-10-05T15:10:39.000Z","size":24,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-10-17T16:10:13.567Z","etag":null,"topics":["bash","cheatsheet","cli-tools","commands","curl","data-engineering","databricks","developer-tools","docker","git","interacti","linux","quick-reference","reference","sql"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/akshayboddhul.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-10-05T15:07:19.000Z","updated_at":"2025-10-05T15:10:40.000Z","dependencies_parsed_at":"2025-10-05T17:34:23.131Z","dependency_job_id":"74d474b1-3cad-4e12-95bf-92f6bb278085","html_url":"https://github.com/akshayboddhul/data-engineering-commands","commit_stats":null,"previous_names":["akshayboddhul/data-engineering-commands"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/akshayboddhul/data-engineering-commands","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/akshayboddhul%2Fdata-engineering-commands","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/akshayboddhul%2Fdata-engineering-commands/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/akshayboddhul%2Fdata-engineering-commands/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/akshayboddhul%2Fdata-engineering-commands/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/akshayboddhul","download_url":"https://codeload.github.com/akshayboddhul/data-engineering-commands/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/akshayboddhul%2Fdata-engineering-commands/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31641114,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-10T07:40:12.752Z","status":"ssl_error","status_checked_at":"2026-04-10T07:40:11.664Z","response_time":98,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bash","cheatsheet","cli-tools","commands","curl","data-engineering","databricks","developer-tools","docker","git","interacti","linux","quick-reference","reference","sql"],"created_at":"2025-10-06T06:53:54.670Z","updated_at":"2026-04-10T11:32:09.321Z","avatar_url":"https://github.com/akshayboddhul.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Create a focused README.md file that only describes what the website actually has\nreadme_content = '''# Essential Data Engineering Commands - Quick Reference\n\nA comprehensive interactive reference guide for essential data engineering commands including Linux, Bash, Git, Databricks, Curl, Docker, SQL, and additional CLI tools.\n\n## ✨ Features\n\n### 🎨 **Design \u0026 Interface**\n- **Professional Typography** - DM Serif Display for headers, DM Sans for body text\n- **Dark/Light Mode Toggle** - Switch between themes with the moon/sun icon\n- **Responsive Design** - Works perfectly on desktop, tablet, and mobile devices\n- **Smooth Animations** - Elegant hover effects and transitions\n- **Clean Layout** - Minimalist design focused on usability\n\n### 🔍 **Functionality**\n- **Real-time Search** - Find commands instantly as you type\n- **Category Navigation** - Filter by technology (Linux, Git, Docker, etc.)\n- **One-click Copy** - Copy any command to clipboard with visual feedback\n- **Collapsible Sections** - Expand/collapse command categories\n- **Keyboard Shortcuts** - Ctrl/Cmd+K for search, Esc to clear\n- **Back-to-Top Button** - Quick navigation for long content\n\n## 📚 Command Database (142+ Commands)\n\n### **Linux Commands (20)**\nFile operations, system monitoring, and text processing commands:\n- File management: `ls -la`, `cd`, `mkdir -p`, `cp -r`, `mv`, `rm -rf`\n- Text processing: `grep -r`, `head`, `tail`, `wc -l`, `find`\n- System monitoring: `top`, `htop`, `ps aux`, `free -h`, `df -h`, `du -sh`\n- Process control: `kill -9`, `chmod`\n\n### **Bash/Shell Commands (19)**\nScripting, automation, and data processing:\n- Script basics: `#!/bin/bash`, variables, conditionals, loops\n- Data processing: `awk`, `sed`, `sort`, `uniq`, `cut`, `join`, `paste`\n- I/O operations: piping (`|`), redirection (`\u003e`, `\u003e\u003e`), error handling (`2\u003e\u00261`)\n- Job control: `nohup`, `crontab`, background processes (`\u0026`)\n\n### **Git Commands (20)**\nVersion control and collaboration:\n- Repository basics: `git init`, `git clone`, `git status`, `git log`\n- Staging \u0026 commits: `git add`, `git commit`, `git push`, `git pull`\n- Branching: `git branch`, `git checkout`, `git merge`, `git stash`\n- Advanced operations: `git diff`, `git reset`, `git tag`, `git remote`\n\n### **Databricks CLI Commands (15)**\nBig data platform management:\n- Setup: `databricks configure`\n- Cluster operations: `clusters list`, `clusters start`, `clusters terminate`\n- File system: `fs ls`, `fs cp` (DBFS operations)\n- Job management: `jobs list`, `jobs run-now`, `runs list`\n- Workspace: `workspace list`, `workspace export`, `workspace import`\n\n### **Curl Commands (15)**\nAPI testing and data transfer:\n- HTTP requests: GET, POST with headers and authentication\n- Data handling: JSON payloads, file uploads, response saving\n- Options: redirects (`-L`), retries (`--retry`), timeouts, verbose mode (`-v`)\n- Authentication: Bearer tokens, basic auth, custom headers\n\n### **Docker Commands (19)**\nContainer management and deployment:\n- Container lifecycle: `docker run`, `docker start`, `docker stop`, `docker rm`\n- Image management: `docker build`, `docker pull`, `docker images`, `docker rmi`\n- Debugging: `docker exec`, `docker logs`, `docker stats`\n- Orchestration: `docker-compose up`, `docker-compose down`\n- Maintenance: `docker system prune`, volume management\n\n### **SQL Commands (19)**\nDatabase operations and analytics:\n- Data retrieval: `SELECT`, `WHERE`, `ORDER BY`, `LIMIT`, `DISTINCT`\n- Data modification: `INSERT`, `UPDATE`, `DELETE`\n- Table operations: `CREATE TABLE`, `DROP TABLE`, `ALTER TABLE`\n- Advanced queries: `JOIN`, `GROUP BY`, `HAVING`, CTEs (`WITH`)\n- Performance: `CREATE INDEX`, `EXPLAIN`\n\n### **Additional CLI Tools (15)**\nModern productivity tools:\n- JSON processing: `jq` for parsing and filtering\n- Data exploration: `visidata` for interactive analysis\n- Database tools: `pgcli` for enhanced PostgreSQL interaction\n- File utilities: `bat` (syntax highlighting), `fzf` (fuzzy finding)\n- Data formats: `csvkit`, `miller` for CSV processing\n- Monitoring: `lnav` for logs, `httpie` for APIs\n- Data tools: `dvc`, `great_expectations`, `airflow`\n\n## 🎯 What Each Command Includes\n\nEvery command in the reference provides:\n- **Command syntax** - Exact command with proper formatting\n- **Clear description** - What the command does\n- **Practical usage** - When and why to use it in data engineering workflows\n\n## 🔧 Technical Details\n\n### **Frontend Architecture**\n- **Pure JavaScript** - No external frameworks\n- **Modern CSS** - Custom properties, Grid, Flexbox\n- **Semantic HTML5** - Proper structure and accessibility\n- **Progressive Enhancement** - Works without JavaScript\n\n### **Browser Support**\n- Chrome 88+\n- Firefox 85+\n- Safari 14+\n- Edge 88+\n- Mobile browsers (iOS Safari, Chrome Mobile)\n\n### **Performance Features**\n- Fast initial load with efficient rendering\n- Smooth search across all commands\n- Optimized animations and transitions\n- Minimal DOM manipulation for better performance\n\n## 🎨 Design System\n\n### **Typography**\n- **Headers**: DM Serif Display - elegant serif font\n- **Body text**: DM Sans - clean, readable sans-serif\n- **Code blocks**: Monaco/Consolas monospace fonts\n\n### **Color Scheme**\n- **Light Mode**: Clean whites and blues with good contrast\n- **Dark Mode**: Dark backgrounds with light text for comfortable viewing\n- **Accent Colors**: Blue primary, green for success states\n\n### **Layout**\n- **Responsive Grid**: Adapts to screen size\n- **Card-based Design**: Each command in its own card\n- **Sticky Navigation**: Categories remain accessible while scrolling\n\n## 🛠️ Customization\n\n### **Adding New Commands**\nCommands are stored in the `commandData` object in `app.js`:\n```javascript\n\"category_name\": [\n    {\n        \"command\": \"your-command\",\n        \"description\": \"What the command does\",\n        \"usage\": \"When to use this command\"\n    }\n]\n```\n\n### **Modifying Colors**\nColors are defined as CSS custom properties in `style.css`:\n```css\n:root {\n    --primary-color: #2563eb;\n    --accent-color: #10b981;\n    --background-color: #ffffff;\n}\n```\n\n### **Changing Fonts**\nFont imports are in the HTML head, with CSS variables:\n```css\n:root {\n    --font-serif: \"DM Serif Display\", serif;\n    --font-sans: \"DM Sans\", sans-serif;\n}\n```\n\n## 📱 Mobile Experience\n\n### **Responsive Features**\n- **Touch-optimized**: Tap targets sized for mobile use\n- **Horizontal scroll**: Category navigation adapts to small screens\n- **Condensed layout**: Single-column design on mobile\n- **Fast performance**: Optimized for mobile browsers\n\n### **Mobile-specific Interactions**\n- Tap to expand/collapse sections\n- Swipe-friendly navigation\n- Copy feedback optimized for touch\n- Proper zoom behavior for command details\n\n## 🔍 Search Functionality\n\n### **Search Capabilities**\n- **Real-time filtering**: Results update as you type\n- **Cross-category search**: Finds commands across all categories\n- **Multiple match types**: Searches command text, descriptions, and usage\n- **Instant results**: No loading delays\n\n### **Search Features**\n- Search icon and clear button\n- Keyboard shortcuts (Ctrl/Cmd+K to focus)\n- \"No results\" message when needed\n- Automatic section expansion for matches\n\n## 🎪 Interactive Elements\n\n### **Command Cards**\n- **Hover effects**: Subtle animations on mouse over\n- **Copy buttons**: One-click copying with success feedback\n- **Code formatting**: Proper syntax highlighting in dark blocks\n- **Responsive layout**: Adapts to different screen sizes\n\n### **Navigation**\n- **Category filtering**: Click categories to filter commands\n- **Active states**: Current category highlighted\n- **Smooth scrolling**: Enhanced page navigation\n- **Back-to-top**: Appears when scrolling down\n\n### **Theme Toggle**\n- **Persistent preference**: Remembers your choice\n- **Smooth transitions**: Animated theme switching\n- **System integration**: Respects user's system preferences\n- **Icon feedback**: Moon/sun icon changes with theme\n\n## 📋 File Structure\n\n```\n├── index.html          # Main page structure and layout\n├── style.css           # Complete styling and responsive design\n├── app.js              # Functionality and command database\n└── README.md           # This documentation\n```\n\n## 🎯 Use Cases\n\n### **Daily Reference**\n- Quick command lookup during development\n- Copy commands directly to terminal\n- Explore commands by technology category\n\n### **Learning Tool**\n- Understand command usage patterns\n- Learn new tools and technologies\n- See practical examples of command usage\n\n### **Team Resource**\n- Standardize command usage across team\n- Onboard new data engineers\n- Reference during code reviews\n\n## ⚡ Performance\n\n### **Optimizations**\n- **Minimal dependencies**: No external JavaScript libraries\n- **Efficient rendering**: Commands load quickly\n- **Smooth interactions**: 60fps animations\n- **Fast search**: Instant filtering across 142+ commands\n\n### **Loading**\n- **Quick startup**: Page loads and renders immediately\n- **Progressive enhancement**: Core features work without JavaScript\n- **Error handling**: Graceful fallbacks for any issues\n\n---","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fakshayboddhul%2Fdata-engineering-commands","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fakshayboddhul%2Fdata-engineering-commands","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fakshayboddhul%2Fdata-engineering-commands/lists"}