https://github.com/codelibs/fess-ds-s3
DataStore Crawler for Amazon S3 (Under Development)
https://github.com/codelibs/fess-ds-s3
Last synced: 2 months ago
JSON representation
DataStore Crawler for Amazon S3 (Under Development)
- Host: GitHub
- URL: https://github.com/codelibs/fess-ds-s3
- Owner: codelibs
- License: apache-2.0
- Created: 2019-06-05T05:53:05.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2025-04-13T13:43:55.000Z (3 months ago)
- Last Synced: 2025-04-13T14:36:44.072Z (3 months ago)
- Language: Java
- Homepage:
- Size: 171 KB
- Stars: 3
- Watchers: 8
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Amazon S3 Data Store for Fess
[](https://github.com/codelibs/fess-ds-s3/actions/workflows/maven.yml)
==========================
## Overview
Amazon S3 Data Store is an extension for Fess Data Store Crawling.
## Download
See [Maven Repository](https://repo1.maven.org/maven2/org/codelibs/fess/fess-ds-s3/).
## Installation
See [Plugin](https://fess.codelibs.org/14.2/admin/plugin-guide.html) of Administration guide.
## Getting Started
### Parameters
```
region=...
access_key_id=...
secret_key=...
```
| Key | Value |
| --- | --- |
| *region* | The region of the S3 buckets (eg: `ap-northeast-1`) |
| *access_key_id* | AWS Access Key ID |
| *secret_key* | AWS Secret Key |
| *buckets* | (Optional) Bucket names (comma separated values) |
### Scripts
```
url=object.url
title=object.key
content=object.contents
mimetype=object.mimetype
filetype=object.filetype
filename=object.filename
content_length=object.size
last_modified=object.last_modified
```
| Key | Value |
| --- | --- |
| *object.url* | The URL of the S3 object. |
| *object.management_url* | The management URL of the S3 Object. |
| *object.key* | The key of the S3 object. |
| *object.e_tag* | The ETag of the S3 object. |
| *object.contents* | The text content of the S3 object. |
| *object.mimetype* | The mimetype of the S3 object. |
| *object.filetype* | The filetype of the S3 object. |
| *object.filename* | The file name of the S3 object. |
| *object.size* | The size of the S3 object. |
| *object.last_modified* | The last time the S3 object was modified. |
| *object.owner_id* | The owner ID of the S3 object. |
| *object.owner_display_name* | The display name of the S3 object's owner. |
| *object.bucket_name* | The bucket name of the S3 object. |
| *object.creation_date* | The time when the bucket created. |