{"id":20704169,"url":"https://github.com/solidsnack/colog","last_synced_at":"2026-04-25T07:31:33.837Z","repository":{"id":7868278,"uuid":"9240713","full_name":"solidsnack/colog","owner":"solidsnack","description":null,"archived":false,"fork":false,"pushed_at":"2013-04-05T08:54:35.000Z","size":105,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-03-05T17:08:17.106Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Haskell","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/solidsnack.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2013-04-05T12:28:38.000Z","updated_at":"2020-03-10T03:47:05.000Z","dependencies_parsed_at":"2022-07-11T01:47:19.144Z","dependency_job_id":null,"html_url":"https://github.com/solidsnack/colog","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solidsnack%2Fcolog","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solidsnack%2Fcolog/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solidsnack%2Fcolog/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/solidsnack%2Fcolog/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/solidsnack","download_url":"https://codeload.github.com/solidsnack/colog/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":242973962,"owners_count":20215245,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-17T01:11:16.114Z","updated_at":"2025-12-16T06:22:44.567Z","avatar_url":"https://github.com/solidsnack.png","language":"Haskell","funding_links":[],"categories":[],"sub_categories":[],"readme":"Colog is a log file aggregator.  It reads and merges log files from\ndifferent servers and outputs them to stdout in a mostly-sorted\nfashion.\n\nUsage\n=====\n\nYour S3 access credentials must be provided using the environment\nvariables:\n\n  - `AWS_ACCESS_KEY`: account access key\n  - `AWS_SECRET_KEY`: secret\n\nThe basic arguments are:\n\n    colog s3://\u003cbucketname\u003e/\u003clogroot\u003e \u003cstart-date\u003e[/[\u003cend-date\u003e]]\n\nExamples:\n\n    # List all the logs from all servers produced between March 1st\n    # and March 2nd in 2013\n    colog s3://mybucket/logs/ 2013-03-01/2013-03-02\n\n    # List all the logs for 3 March 2013, 14:45 UTC\n    colog s3://mybucket/logs/ 2013-03-03T14:45\n\n    # List all the logs from march until now\n    colog s3://mybucket/logs/ 2013-03/...\n\nFor more info type:\n\n    colog --help\n\nFiltering by seconds is currently not supported.\n\n\nStructure of log file store\n===========================\n\nColog currently assumes that all log files are stored on Amazon S3 and\nrequires the following directory structure:\n\n    s3://\u003cbucket\u003e/\u003croot\u003e/\u003cservername\u003e/\u003cyyyy-mm-dd\u003e/\u003chh\u003e/\u003cmm\u003eZ\n\nfor example the file:\n\n    s3://mybucket/syslogs/i-39824792/2013-03-15/14/43Z\n\nwould contain the syslogs for server `i-39824792` on 15 March 2013,\n14:43 UTC time.  The log file itself must be a bzip2-compressed CSV\nfile.  Each line in the CSV file must start with the date in ISO 8601\nformat using UTC time.  For example:\n\n    2013-02-17T15:58:00.049808+00:00,01.myserver.mydomain,user,notice,\"label\",12345,\"My message here\"\n\nColog only requires that the first component in each line is in ISO\n8601 format for sorting purposes.  The remainder of the line is\ncurrently ignored.\n\n\nInstallation\n============\n\n    $ hsenv --ghc=7.6.2\n    $ source .hsenv/bin/activate\n    $ cabal update\n    $ make install INSTALL_OPTS=-j\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsolidsnack%2Fcolog","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsolidsnack%2Fcolog","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsolidsnack%2Fcolog/lists"}