{"id":19832043,"url":"https://github.com/ail-project/ail-feeder-jsonlogs","last_synced_at":"2026-05-11T01:03:15.677Z","repository":{"id":118130561,"uuid":"303354126","full_name":"ail-project/ail-feeder-jsonlogs","owner":"ail-project","description":"Aggregate json log lines and push to AIL framework.","archived":false,"fork":false,"pushed_at":"2020-10-13T13:12:10.000Z","size":16,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":6,"default_branch":"main","last_synced_at":"2025-01-11T10:19:39.995Z","etag":null,"topics":["ail-framework"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"agpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ail-project.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-10-12T10:17:40.000Z","updated_at":"2020-10-14T08:47:31.000Z","dependencies_parsed_at":null,"dependency_job_id":"b06e13e1-dfc1-4088-9aa4-61b9fb06c4e6","html_url":"https://github.com/ail-project/ail-feeder-jsonlogs","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ail-project%2Fail-feeder-jsonlogs","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ail-project%2Fail-feeder-jsonlogs/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ail-project%2Fail-feeder-jsonlogs/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ail-project%2Fail-feeder-jsonlogs/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ail-project","download_url":"https://codeload.github.com/ail-project/ail-feeder-jsonlogs/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241191626,"owners_count":19925302,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ail-framework"],"created_at":"2024-11-12T11:36:08.826Z","updated_at":"2026-05-11T01:03:15.585Z","avatar_url":"https://github.com/ail-project.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AIL -feeder from JSON\nAggregate json log lines and push to AIL\n\nThis AIL feeder is a generic software to feed JSON logs lines stored in a folder to AIL.\n\n# Installation\n\nOn a debian/ubuntu launch `./setup.sh`\n\n# Usage\n\n- first activate virtualenv:\n`. ./venv/bin/activate`\n\n- then use:\n~~~shell\n(venv) ➜  ail-feeder-jsonlogs git:(main) ✗ ./bin/jsonfeeder.py --h\nusage: jsonfeeder.py [-h] [--dry]\n\noptional arguments:\n  -h, --help  show this help message and exit\n  --dry       dry run - output to stdout\n(venv) ➜  ail-feeder-jsonlogs git:(main) ✗ \n~~~\n\n# Configuration\n```\n[ail]\nurl = https://127.0.0.1:7020/api/v1/import/json/item\napikey = \u003cYOURAPIKEY\u003e\nailfeedertype = \n# use uuidgen\nuuid = \n\n[folder]\n# basedir is the logs root folder\nbasedir = .\n# a prefix can be prepended\nprefix =\n# a suffix can be appended\nsuffix =\n# Leave datapattern empty to inspect all basedir's subfolders\ndatepattern =\n# Set datepattern to a date pattern if you need a daily output\n# an instance with datepattern = %Y%m%d on the 12/10/2020 will\n# look into basedir/prefix20201012suffix\n# datepattern follows 1989 C standard\n\n# selector follows jmespath grammar\n# it should follow the multi-select hash spec\n# add u_ in front of keys to have these set together as keyid (this will be unique per exec)\n# for instance sending only one line to AIL for several client requests on a webserver would look like that:\n[selector]\nselector = \"{u_request: request , u_remote_ip: ip, time: time}\"\n\n[input]\nencoding = utf-8\n```\n\n# JSON output format to AIL\n\n- `source` is the name of the AIL json feeder module\n- `source-uuid` is the UUID of the feeder (unique per feeder)\n- `data` is the JSON data\n- `data-sha256` is the SHA256 value JSON data \n\n## ail_feeder_jsonlogs\n\n~~~~json\n{\n    \"data\": {\n        \"host\": \"example.com\",\n        \"remote_ip\": \"127.0.0.1\",\n        \"time\": \"31/Aug/2020:15:15:13 +0200\"\n    },\n    \"data-sha256\": \"1650da45f2480a5bb95e40b1306280157f5efd9d71fe2858d1b1879969d6d41f\",\n    \"default-encoding\": \"UTF-8\",\n    \"source\": \"my_ail_feeder\",\n    \"source-uuid\": \"c0e2aa8a-7b41-4156-803e-ec5f364b4a1e\"\n}\n~~~~\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fail-project%2Fail-feeder-jsonlogs","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fail-project%2Fail-feeder-jsonlogs","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fail-project%2Fail-feeder-jsonlogs/lists"}