Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/rocketbase-io/commons-asset
Adds a flexible asset service with a bunch of features to your spring-boot applications
https://github.com/rocketbase-io/commons-asset
asset file-upload gridfs-storage image-processing s3-bucket spring-boot spring-mvc
Last synced: 3 days ago
JSON representation
Adds a flexible asset service with a bunch of features to your spring-boot applications
- Host: GitHub
- URL: https://github.com/rocketbase-io/commons-asset
- Owner: rocketbase-io
- License: mit
- Created: 2018-05-18T06:41:36.000Z (over 6 years ago)
- Default Branch: master
- Last Pushed: 2024-08-08T11:06:16.000Z (about 2 months ago)
- Last Synced: 2024-09-19T12:04:39.374Z (8 days ago)
- Topics: asset, file-upload, gridfs-storage, image-processing, s3-bucket, spring-boot, spring-mvc
- Language: Java
- Homepage:
- Size: 7.13 MB
- Stars: 5
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# commons-asset
[](https://mvnrepository.com/artifact/io.rocketbase.commons/commons-asset)
Add a flexible asset service with a bunch of features to your spring-boot applications.
I've added a swagger api-documentation. You can find it within [src](./commons-asset-api/src/doc/swagger)
of [swaggerHub](https://app.swaggerhub.com/apis-docs/melistik/commons-asset)
**Features:**
* api and controller to handle asset-uploads
* works with images: jpeg, gif, png, tiff, svg, webp, heic/heif and documents like: pdf, excel, word, powerpoint and zip
*(with 4.6 upwards a long list of other types like videos, audio and docs has been added)*
* you can configure the allowed contentTypes via property *("asset.api.types")*
* 4 different storage implementations (mongo-grid-fs / aws-s3 / jpa-blob / local-file)
* embedded thumb service with different implementations (java / command-line ImageMagick or extermal services like
imgproxy/thumbor)
* java resource to communicate with api
* batch downloading urls and storing them / analyzing
* integrated [color-thief](https://github.com/SvenWoltmann/color-thief-java) in order to get primary and other colors
from photo
* optional LIQP (Low Quality Image Placeholder) option to have a placeholder for images in base64 encoded in ultra low
resolution
* optional preview calculation after upload
* configure available preview-sizes
***module-structure-tree:***
## commons-asset-api
This module provides the DTOs and a client to communicate with the asset endpoints.
The main Objects are: **AssetReference** that is used to store in MongoDb in case of refrencing and **AssetRead**
containing also the different preview urls.
***AssetReference sample:***
```json
{
"id": "5fc6076bb8f6921c45eedae5",
"urlPath": "5fc6076bb8f6921c45eedae5",
"type": "JPEG",
"meta": {
"created": "2020-12-01T09:05:47.039Z",
"originalFilename": "photo-1595776430819-9aa35f06830b.jpeg",
"fileSize": 183740,
"resolution": {
"width": 1950,
"height": 1300
},
"colorPalette": {
"primary": "#b0b2b5",
"colors": [
"#302f2a",
"#4a5355"
]
}
},
"lqip": "data:image/jpeg;base64,/9j/4AAQSkZJRgABAgAAAQABAAD/2wBDAKBueIx4ZKCMgoy0qqC+8P//8Nzc8P//////////////////////////////////////////////////////////2wBDAaq0tPDS8P//////////////////////////////////////////////////////////////////////////////wAARCAAhADIDASIAAhEBAxEB/8QAHwAAAQUBAQEBAQEAAAAAAAAAAAECAwQFBgcICQoL/8QAtRAAAgEDAwIEAwUFBAQAAAF9AQIDAAQRBRIhMUEGE1FhByJxFDKBkaEII0KxwRVS0fAkM2JyggkKFhcYGRolJicoKSo0NTY3ODk6Q0RFRkdISUpTVFVWV1hZWmNkZWZnaGlqc3R1dnd4eXqDhIWGh4iJipKTlJWWl5iZmqKjpKWmp6ipqrKztLW2t7i5usLDxMXGx8jJytLT1NXW19jZ2uHi4+Tl5ufo6erx8vP09fb3+Pn6/8QAHwEAAwEBAQEBAQEBAQAAAAAAAAECAwQFBgcICQoL/8QAtREAAgECBAQDBAcFBAQAAQJ3AAECAxEEBSExBhJBUQdhcRMiMoEIFEKRobHBCSMzUvAVYnLRChYkNOEl8RcYGRomJygpKjU2Nzg5OkNERUZHSElKU1RVVldYWVpjZGVmZ2hpanN0dXZ3eHl6goOEhYaHiImKkpOUlZaXmJmaoqOkpaanqKmqsrO0tba3uLm6wsPExcbHyMnK0tPU1dbX2Nna4uPk5ebn6Onq8vP09fb3+Pn6/9oADAMBAAIRAxEAPwCSiohL7Uvme1AElGaj8wUhegB5YDvTS57VHmjNAC5PqaKbRQBJtP8Aepdp9acKWgBm0+pppDe9S0lAEXPqaTn1qVlBphQigBtFGKKAJRS0UUAFLRRQAUhoooASiiigD//Z",
"previews": {
"s": "http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/s",
"m": "http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/m",
"l": "http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/l",
"responsive": {
"sizes": "(max-width: 1200px) 100vw, 1200px",
"srcset": "http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/s 300w, http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/m 600w, http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/l 1200w",
"src": "http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/l"
}
},
"download": "http://localhost:51857/api/asset/5fc6076bb8f6921c45eedae5/b",
"keyValues": {}
}
```
With urlPath you can calculate your preview url. The logic is been implemented in AssetConverter.toRead(...)
During upload process the file is getting read so that some meta information get stored. In case of image also the
resolution is getting stored...
## commons-asset-tooling
Containing Thumbnail-Service, ColorThief, Download-Service, ImageHandler (for download images and on the fly
thumbnailing + base64 converting)...
## commons-asset-core
Containing an implementation for storing asset references...
| property | default | explanation |
|-----------------------------|-------------------------------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| asset.api.path | /api/asset | base path of assetController |
| asset.api.types | *All* | you can shrink allowed Types (is a list property) |
| asset.imagemagick.enabled | false | you can active imagemagick command-line use otherwise java-processor will get used |
| asset.api.download | true | you can disable endpoint |
| asset.api.delete | true | when false no delete is possible |
| asset.api.copy | true | when false no copy is possible |
| asset.api.batch | true | you can disable batch endpoint |
| asset.api.analyse | true | you can disable analyse endpoint |
| asset.api.preview | true | should only been taken in case of mongo-storage
please consider also using outside caching |
| asset.api.detect-resolution | true | you can disable image resolution detection |
| asset.api.detect-colors | true | you can disable image colorThief |
| asset.api.base-url | "" | used for previewUrls in case of mongo-storage, will get used as fallback |
| asset.api.preview-quality | XS: 0.7
S: 0.75
M: 0.8
L: 0.85
XL: 0.85 | configure quality of image preview via java-code. Its a Map Configuration and the key needs to match the enum PreviewSize
ValueRange is between 0 - 1.
1 means 100% |
| asset.api.preview-sizes | XS, S, M, L, XL | configure possible preview-sizes (will limit precalcuation + assetRead previewSizes) |
| asset.api.precalculate | false | when enabled the configured previews of configured sizes will get generated directly after store of original file |
**LQIP** (Low Quality Image Placeholder) since 3.1.x there is an option to allow adding base64 thumb as a placeholder to
the assetReference. During upload process the system adds it to the entity and the small thumb get stored in db as well.
It should be used as placeholder before loading the main preview. To lower http calls the "binary" is already containing
within the rest response.
| | default | explanation |
|-----------------------|---------|-------------------------------|
| asset.lqip.enabled | false | by default disabled feature |
| asset.lqip.max-width | 50 | max with of the image |
| asset.lqip.max-height | 50 | max height of the image |
| asset.lqip.quality | 0.05 | ultra low res of the image 5% |
An usecase example could be found here [codepen - low quality image placeholder](https://codepen.io/alxdr/pen/oNgKNGY)
**Shrink-options** in some cases it's useful not to store the original imagesize. Therefore some new options had been
added sine 3.5.x
| | default | explanation |
|-------------------------|---------|-------------------------------------|
| asset.shrink.enabled | false | by default disabled feature |
| asset.shrink.max-width | 2560 | max with of the image |
| asset.shrink.max-height | 2560 | max height of the image |
| asset.shrink.quality | 0.9 | quality of image - default mean 90% |
### custom preview service
From version 2.2.x on we've removed our thumbor integration to open our project to multiple thumb providers. In case you
would like to use your own you need to provide a custom bean within you application.
````java
/*
*
* com.squareup
* pollexor
* 2.0.4
*
*/
@Service
@RequiredArgsConstructor
public abstract class ThumborPreviewService implements AssetPreviewService {
protected final ThumborProperties thumborProperties;
public String getPreviewUrl(AssetReference assetReference, PreviewSize size) {
return getThumbor().buildImage(assetReference.getUrlPath())
.resize(size.getMaxWidth(), size.getMaxHeight())
.fitIn()
.toUrl();
}
protected Thumbor getThumbor() {
if (thumbor == null) {
String thumborKey = thumborProperties.getKey();
if (thumborKey.isEmpty()) {
thumbor = Thumbor.create(thumborProperties.getHost());
} else {
thumbor = Thumbor.create(thumborProperties.getHost(), thumborKey);
}
}
return thumbor;
}
}
````
## commons-asset-entity-mongo
Implementation for MongoRepository + Mongo Entity...
## commons-asset-entity-jpa
Implementation for JpaRepository + Jpa Entity...
**If you want to see sql-create statements or liquibase changeLogs take a look in schema-generation/dist**
## commons-asset-storage-fs
Local-FileStorageService
| | default | explanation |
|--------------------|--------------|-----------------------------------------|
| asset.fs.base-path | **required** | required base start path to store files |
## commons-asset-storage-jpa
Stores files as blob in database.
## commons-asset-storage-mongo
Store files in mongo-database with grid-fs
## commons-asset-storage-s3
Containing a communication layer with s3 in order to use it as file storage. Uses the
official [aws-java-sdk-s3](https://aws.amazon.com/de/sdk-for-java/)
| property | default | explanation |
|------------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------|
| asset.s3.bucket | **required** | bucket name where files should get stored |
| asset.s3.access-key | **required** | |
| asset.s3.secret-key | **required** | |
| asset.s3.region | **required** | |
| asset.s3.endpoint | *optional* | allow to connect to replacements of aws s3
by for example [minio](https://www.minio.io/) you can specify the endpoint |
| asset.s3.path-style-access-enabled | *optional* | property to configure aws-java-sdk |
| asset.s3.signer-override | *optional* | property to configure aws-java-sdk | |
| asset.s3.download-expire | "3d" *(3 days)*
(max 7 for AWS and Minio)
[simple duration layout](https://docs.spring.io/spring-boot/docs/2.1.12.RELEASE/reference/html/boot-features-external-config.html#boot-features-external-config-conversion-duration) | property to configure expiration of presigned urls in case no public-url |
| asset.s3.public-read-object | false | property to configure how original file is accessable | |
### example configs
```yaml
## minio
asset:
s3:
access-key: XXX
secret-key: XXX
region: us-east-1
bucket: sample
path-style-access-enabled: true
signer-override: AWSS3V4SignerType
endpoint: "https://minio.example.com"
## aws
asset:
s3:
access-key: XXX
secret-key: XXX
region: eu-central-1
bucket: sample
```
### multiple buckets
You can provide your custom BucketResolver bean to allow support for multiple buckets. An sample implementation could
be.
````java
@Service
public class CustomBucketResolver implements BucketResolver {
@Override
public String resolveBucketName(AssetReference assetReference) {
if ("profile".equalsIgnoreCase(assetReference.getContext())) {
return "profile_bucket";
}
return "default_bucket";
}
}
````
## commons-asset-rest
Containing an all controllers for the rest implementation...
**Hint:** The maximum fileupload size within a spring-boot application is by default just 1Mb you can change this via a
property: **spring.servlet.multipart.max-file-size=5MB**
## commons-asset-imgproxy
Simple preconfiguration to use imgproxy for rendering thumbs via [imgproxy](https://imgproxy.net/) and currently only
configured for s3 use...
| | default | explanation |
|-------------------------|--------------|-----------------------------------------|
| asset.imgproxy.base-url | **required** | required base start path to store files |
| asset.imgproxy.key | optional | |
| asset.imgproxy.salt | optional | |
| asset.imgproxy.enlarge | false | should img-proxy return enlarged thumbs |
## commons-asset-server-filepond
Add **/api/asset/filepond** endpoint to handle uploads. It is similar to base upload but is more flexible with
properties and also returns required assetId instead of AssetRead...
### The MIT License (MIT)
Copyright (c) 2020 rocketbase.io
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated
documentation files (the "Software"), to deal in the Software without restriction, including without limitation the
rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit
persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the
Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE
WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR
COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR
OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.