{"id":21994281,"url":"https://github.com/codelibs/fess-ds-s3","last_synced_at":"2025-04-30T16:48:32.320Z","repository":{"id":42895244,"uuid":"190333965","full_name":"codelibs/fess-ds-s3","owner":"codelibs","description":"DataStore Crawler for Amazon S3 (Under Development)","archived":false,"fork":false,"pushed_at":"2025-04-13T13:43:55.000Z","size":175,"stargazers_count":3,"open_issues_count":0,"forks_count":3,"subscribers_count":8,"default_branch":"master","last_synced_at":"2025-04-13T14:36:44.072Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codelibs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2019-06-05T05:53:05.000Z","updated_at":"2025-04-13T13:43:58.000Z","dependencies_parsed_at":"2024-02-24T12:24:17.107Z","dependency_job_id":"3e7a8f3e-216a-4e35-b76c-029e1cd896e6","html_url":"https://github.com/codelibs/fess-ds-s3","commit_stats":null,"previous_names":[],"tags_count":33,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codelibs%2Ffess-ds-s3","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codelibs%2Ffess-ds-s3/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codelibs%2Ffess-ds-s3/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codelibs%2Ffess-ds-s3/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codelibs","download_url":"https://codeload.github.com/codelibs/fess-ds-s3/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251748119,"owners_count":21637408,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-29T21:08:15.030Z","updated_at":"2025-04-30T16:48:32.283Z","avatar_url":"https://github.com/codelibs.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"Amazon S3 Data Store for Fess\n[![Java CI with Maven](https://github.com/codelibs/fess-ds-s3/actions/workflows/maven.yml/badge.svg)](https://github.com/codelibs/fess-ds-s3/actions/workflows/maven.yml)\n==========================\n\n## Overview\n\nAmazon S3 Data Store is an extension for Fess Data Store Crawling.\n\n## Download\n\nSee [Maven Repository](https://repo1.maven.org/maven2/org/codelibs/fess/fess-ds-s3/).\n\n## Installation \n\nSee [Plugin](https://fess.codelibs.org/14.2/admin/plugin-guide.html) of Administration guide.\n\n## Getting Started\n\n### Parameters\n\n```\nregion=...\naccess_key_id=...\nsecret_key=...\n```\n\n| Key | Value |\n| --- | --- |\n| *region* | The region of the S3 buckets (eg: `ap-northeast-1`) |\n| *access_key_id* | AWS Access Key ID |\n| *secret_key* | AWS Secret Key |\n| *buckets* | (Optional) Bucket names (comma separated values) |\n\n### Scripts\n\n```\nurl=object.url\ntitle=object.key\ncontent=object.contents\nmimetype=object.mimetype\nfiletype=object.filetype\nfilename=object.filename\ncontent_length=object.size\nlast_modified=object.last_modified\n```\n\n| Key | Value |\n| --- | --- |\n| *object.url* | The URL of the S3 object. |\n| *object.management_url* | The management URL of the S3 Object. |\n| *object.key* | The key of the S3 object. |\n| *object.e_tag* | The ETag of the S3 object. |\n| *object.contents* | The text content of the S3 object. |\n| *object.mimetype* | The mimetype of the S3 object. |\n| *object.filetype* |  The filetype of the S3 object. |\n| *object.filename* | The file name of the S3 object. |\n| *object.size* | The size of the S3 object. |\n| *object.last_modified* | The last time the S3 object was modified. |\n| *object.owner_id* | The owner ID of the S3 object. |\n| *object.owner_display_name* | The display name of the S3 object's owner. |\n| *object.bucket_name* | The bucket name of the S3 object. |\n| *object.creation_date* | The time when the bucket created. |\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodelibs%2Ffess-ds-s3","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodelibs%2Ffess-ds-s3","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodelibs%2Ffess-ds-s3/lists"}