{"id":42277129,"url":"https://github.com/rambo3000/logscraper","last_synced_at":"2026-03-10T07:16:33.614Z","repository":{"id":214324985,"uuid":"597178517","full_name":"Rambo3000/LogScraper","owner":"Rambo3000","description":"A tool to assist in downloading, concatinating and filtering log files","archived":false,"fork":false,"pushed_at":"2026-01-22T10:40:54.000Z","size":3656,"stargazers_count":2,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-01-23T01:20:50.691Z","etag":null,"topics":["debugging-tool","log","logging","productivity-tools"],"latest_commit_sha":null,"homepage":"","language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Rambo3000.png","metadata":{"files":{"readme":"docs/README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-02-03T19:57:42.000Z","updated_at":"2026-01-22T10:41:07.000Z","dependencies_parsed_at":"2024-11-28T09:21:54.363Z","dependency_job_id":"39522c45-4499-45dc-a822-1c932ede0b66","html_url":"https://github.com/Rambo3000/LogScraper","commit_stats":null,"previous_names":["rambo3000/logscraper"],"tags_count":20,"template":false,"template_full_name":null,"purl":"pkg:github/Rambo3000/LogScraper","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rambo3000%2FLogScraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rambo3000%2FLogScraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rambo3000%2FLogScraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rambo3000%2FLogScraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Rambo3000","download_url":"https://codeload.github.com/Rambo3000/LogScraper/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Rambo3000%2FLogScraper/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28809337,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-27T07:41:26.337Z","status":"ssl_error","status_checked_at":"2026-01-27T07:41:08.776Z","response_time":168,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["debugging-tool","log","logging","productivity-tools"],"created_at":"2026-01-27T08:03:47.812Z","updated_at":"2026-01-27T08:03:49.056Z","avatar_url":"https://github.com/Rambo3000.png","language":"C#","funding_links":[],"categories":[],"sub_categories":[],"readme":"# LogScraper\n\n**LogScraper** is a powerful, standalone tool for retrieving, filtering, and analyzing logs from HTTP endpoints, Kubernetes clusters, or local files. It's designed to help developers and operators inspect logs quickly and efficiently.\n\n![image](https://github.com/user-attachments/assets/60c5bb6d-0830-4b20-867a-c89575853e0a)\n\n\n---\n\n## 🔍 Key Features\n\n- ✅ Retrieve logs from HTTP endpoints, Kubernetes, and local file systems  \n- 🔄 Concatenate multiple log downloads for seamless reading  \n- 📡 Continuous log reading for live monitoring  \n- 🧩 Filter and hide metadata for cleaner views  \n- ⚡ Fast navigation via metadata and content filters  \n- 🔍 Search within logs  \n- 📤 Export to external tools like Notepad++  \n- 🛠️ Fully configurable UI  \n- 🗃️ Available as installer or standalone, no .Net framework installation required\n- 🔔 Automatic update checks  \n- 📌 Mini Controls: compact always-on-top UI for quick log access  \n- 🔐 Secure credential storage using Windows Credential Manager \n\n---\n\n## 📦 Download\n\nGet the latest release from the [Releases section](https://github.com/Rambo3000/logscraper/releases).\n\n---\n\n## ⚙️ Before You Start\n\nDownload the installer and run it or download the standalone ZIP and extract it to a desired location. \n\nBuilt in C# (.NET), the application does **not** require a separate .NET runtime.\n\n---\n\n## 🔄 Updates\n\n### Recommended: Use the installer\nThe preferred way to update Logscraper is to **download and run the latest installer** from the [Releases section](https://github.com/Rambo3000/logscraper/releases).\n\nWhen switching from standalone to installer, you can import settings from the standalone version in the installed version using the settings window. The JSON files adjecent to the standalone can be imported one at a time.\n\n---\n\n### Alternative: Standalone (ZIP) update\nIf the installer does not work for your setup, you can update manually using the **standalone ZIP**:\n\n1. Download the latest ZIP from the [Releases section](https://github.com/Rambo3000/logscraper/releases)\n2. **Replace the executable file** with the new version\n\nYou can **keep your existing configuration files**  \n(`LogScraperConfig.json`, `LogScraperLogLayouts.json`, `LogScraperLogProviders.json`) — there is no need to change or reconfigure them unless specified in the release notes.\n\n\n---\n\n## 🛠️ Configuration\n\nOpen the **Settings** window via the ⚙️ icon. Most options are self-explanatory.\n\nLogScraper uses a **layout system** to define how logs are interpreted. Each log line is treated as a combination of:\n\n- A **timestamp**\n- **Metadata fields**\n- The actual **log content**\n\nYou can configure:\n- The **timestamp format** (used for parsing)\n- Which **metadata fields** are present, on which you filter the log\n- Log content filters for easy navigating within the log\n- Transformers which can inverse the log or extract JSON from a line\n\n---\n\n## 🚀 Using the Application\n\n1. Select a log source (HTTP, Kubernetes, or file system) and select the corresponding detailed source information like a filename or a Kubernetes pod\n2. (optional) Select a log layout, or use the default\n3. Click **Record** or **Record for several minutes** to start loading logs\n4. (optional) Filter on specified metadata\n5. (optional) Search for a specific word or use the content filter to the right of the screen to quickly navigate to a specific line in the log or to pick a specific beginn and end of the log\n\n---\n\n## 💡 Tips \u0026 Recommendations\n\n- 🪟 Use **Mini Controls**: a compact always-on-top window for easy log reading without switching apps  \n- 🌲 Enable hierarchical navigation by setting up Begin/End Content Filters in the layout section of Settings. This groups related log lines into a hierarchical view/tree, making large logs easier to scan and explore.\n- 👁️ By default, metadata is hidden — enable it via the **Metadata** section, or change the defaults in Settings\n- ✂️ Keep logs readable by selectively showing metadata values inline  \n- ⚠️ Ensure the correct **log layout** is selected to avoid parsing issues  \n- 🧠 Memory usage depends on log size. As a guideline, keep logs under **100,000 lines** to avoid performance issues  \n- 🔑 When accessing protected HTTP sources, the app will prompt for credentials and store them securely  \n- 📝 For advanced search/editing, use **Notepad++** via the **Open in Notepad++** button (configurable in Settings)  \n- 🔐 Credentials are stored securely via the **Windows Credential Manager** and can be managed from there  \n\n---\n\n## 📧 Feedback\n\nFound a bug or want to request a feature? Please open an issue on the [Issues page](https://github.com/Rambo3000/logscraper/issues).\n\n---\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frambo3000%2Flogscraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frambo3000%2Flogscraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frambo3000%2Flogscraper/lists"}