Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jgrygierek/sonatabatchentityimportbundle
Importing entities with preview and edit features for Sonata Admin.
https://github.com/jgrygierek/sonatabatchentityimportbundle
csv-import php sonata sonata-admin symfony symfony-bundle
Last synced: 20 days ago
JSON representation
Importing entities with preview and edit features for Sonata Admin.
- Host: GitHub
- URL: https://github.com/jgrygierek/sonatabatchentityimportbundle
- Owner: jgrygierek
- License: mit
- Created: 2020-04-18T19:20:07.000Z (over 4 years ago)
- Default Branch: master
- Last Pushed: 2024-08-17T18:45:42.000Z (3 months ago)
- Last Synced: 2024-10-11T13:12:04.704Z (about 1 month ago)
- Topics: csv-import, php, sonata, sonata-admin, symfony, symfony-bundle
- Language: PHP
- Homepage:
- Size: 135 KB
- Stars: 8
- Watchers: 1
- Forks: 3
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# SonataBatchEntityImportBundle
![Code Style](https://github.com/jgrygierek/SonataBatchEntityImportBundle/workflows/Code%20Style/badge.svg)
![Tests](https://github.com/jgrygierek/SonataBatchEntityImportBundle/workflows/Tests/badge.svg)
![Code Coverage](https://img.shields.io/codecov/c/github/jgrygierek/SonataBatchEntityImportBundle/master)
![PHP Versions](https://img.shields.io/badge/PHP->=8.1-blue)
![Symfony Versions](https://img.shields.io/badge/Symfony-5.4--7.*-blue)
[![SymfonyInsight](https://insight.symfony.com/projects/9b1b54d3-7c32-4e05-9d89-cfb0bf521720/mini.svg)](https://insight.symfony.com/projects/9b1b54d3-7c32-4e05-9d89-cfb0bf521720)Bundle is built on top of [BatchEntityImportBundle](https://github.com/jgrygierek/BatchEntityImportBundle).
Importing entities with preview and edit features for Sonata Admin.
* Data can be **viewed and edited** before saving to database.
* Supports **inserting** new records and **updating** existing ones.
* Supported extensions: **CSV, XLS, XLSX, ODS**.
* Supports translations from **KnpLabs Translatable** extension.
* The code is divided into smaller methods that can be easily replaced if you want to change something.
* Columns names are required and should be added as header (first row).
* If column does not have name provided, will be removed from loaded data.![Select File](docs/select_file.png)
![Edit Matrix](docs/edit_matrix.png)## Documentation
* [Installation](#installation)
* [Configuration class](#configuration-class)
* [Basic configuration class](#basic-configuration-class)
* [Fields definitions](#fields-definitions)
* [Matrix validation](#matrix-validation)
* [Passing services to configuration class](#passing-services-to-configuration-class)
* [Show & hide entity override column](#show--hide-entity-override-column)
* [Optimizing queries](#optimizing-queries)
* [Creating admin](#creating-admin)
* [Default Controller](#default-controller)
* [Custom Controller](#custom-controller)
* [Translations](#translations)
* [Overriding templates](#overriding-templates)
* [Importing data to array field](#importing-data-to-array-field)
* [Full example of CSV file](#full-example-of-csv-file)## Installation
Install package via composer:
```
composer require jgrygierek/sonata-batch-entity-import-bundle
```Add entry to `bundles.php` file:
```
JG\SonataBatchEntityImportBundle\SonataBatchEntityImportBundle::class => ['all' => true],
```## Configuration class
To define how the import function should work, you need to create a configuration class.
### Basic configuration class
In the simplest case it will contain only class of used entity.
```php
namespace App\Model\ImportConfiguration;use App\Entity\User;
use JG\BatchEntityImportBundle\Model\Configuration\AbstractImportConfiguration;class UserImportConfiguration extends AbstractImportConfiguration
{
public function getEntityClassName(): string
{
return User::class;
}
}
```Then register it as a service:
```yaml
services:
App\Model\ImportConfiguration\UserImportConfiguration: ~
```### Fields definitions
If you want to change types of rendered fields, instead of using default ones,
you have to override method in your import configuration. If name of field contains spaces, you should use underscores instead.To avoid errors during data import, you can add here validation rules.
```php
use JG\BatchEntityImportBundle\Model\Form\FormFieldDefinition;
use Symfony\Component\Form\Extension\Core\Type\IntegerType;
use Symfony\Component\Form\Extension\Core\Type\TextareaType;
use Symfony\Component\Form\Extension\Core\Type\TextType;
use Symfony\Component\Validator\Constraints\Length;public function getFieldsDefinitions(): array
{
return [
'age' => new FormFieldDefinition(
IntegerType::class,
[
'attr' => [
'min' => 0,
'max' => 999,
],
]
),
'name' => new FormFieldDefinition(TextType::class),
'description' => new FormFieldDefinition(
TextareaType::class,
[
'attr' => [
'rows' => 2,
],
'constraints' => [new Length(['max' => 255])],
]
),
];
}
```### Matrix validation
This bundle provides two new validators.
1) **DatabaseEntityUnique** validator can be used to check if record data does not exist yet in database.
2) **MatrixRecordUnique** validator can be used to check duplication without checking database, just only matrix records values.Names of fields should be the same as names of columns in your uploaded file. With one exception! If name contains spaces, you should use underscores instead.
```php
use JG\BatchEntityImportBundle\Validator\Constraints\DatabaseEntityUnique;
use JG\BatchEntityImportBundle\Validator\Constraints\MatrixRecordUnique;public function getMatrixConstraints(): array
{
return [
new MatrixRecordUnique(['fields' => ['field_name']]),
new DatabaseEntityUnique(['entityClassName' => $this->getEntityClassName(), 'fields' => ['field_name']]),
];
}
```### Passing services to configuration class
If you want to pass some additional services to your configuration, just override constructor.
```php
public function __construct(EntityManagerInterface $em, TestService $service)
{
parent::__construct($em);$this->testService = $service;
}
```Then you will need to define this configuration class as a public service too.
### Show & hide entity override column
If you want to hide/show an entity column that allows you to override entity `default: true`,
you have to override this method in your import configuration.```php
public function allowOverrideEntity(): bool
{
return true;
}
```### Optimizing queries
If you use **KnpLabs Translatable** extension for your entity, probably you will notice increased number of queries, because of Lazy Loading.
To optimize this, you can use `getEntityTranslationRelationName()` method to pass the relation name to the translation.
```php
public function getEntityTranslationRelationName(): ?string
{
return 'translations';
}
```## Creating admin
Your admin class should implement `AdminWithImportInterface` and should contain one additional method.
```php
namespace App\Admin;use App\Model\ImportConfiguration\UserImportConfiguration;
use JG\SonataBatchEntityImportBundle\Admin\AdminWithImportInterface;
use Sonata\AdminBundle\Admin\AbstractAdmin;class UserAdmin extends AbstractAdmin implements AdminWithImportInterface
{
public function getImportConfigurationClassName(): string
{
return UserImportConfiguration::class;
}
}
```## Default controller
If you use default controller, no action is needed. Controller will be replaced automatically.
## Custom controller
If you use your own custom controller, remember that this controller should:
- extend `JG\SonataBatchEntityImportBundle\Controller\ImportCrudController`
- or use `JG\SonataBatchEntityImportBundle\Controller\ImportControllerTrait`.Additionally, if you want to automatically inject your import configuration class,
remember to implement `JG\SonataBatchEntityImportBundle\Controller\ImportConfigurationAutoInjectInterface`
and use method `getImportConfiguration()` from default controller.## Translations
This bundle supports KnpLabs Translatable behavior.
To use this feature, every column with translatable values should be suffixed with locale, for example:
* `name:en`
* `description:pl`
* `title:ru`If suffix will be added to non-translatable entity, field will be skipped.
If suffix will be added to translatable entity, but field will not be found in translation class, field will be skipped.
## Overriding templates
You have two ways to override templates globally:
- **Configuration** - just change paths to templates in your configuration file.
Values in this example are default ones and will be used if nothing will be changed.```yaml
sonata_batch_entity_import:
templates:
select_file: '@SonataBatchEntityImport/select_file.html.twig'
edit_matrix: '@SonataBatchEntityImport/edit_matrix.html.twig'
button: '@SonataBatchEntityImport/button.html.twig'
```- **Bundle directory** - put your templates in this directory:
```
templates/bundles/SonataBatchEntityImportBundle
```## Importing data to array field
If your entity has an array field, and you want to import data from CSV file to it, this is how you can do it.
- Default separator is set to `|`.
- Only one-dimensional arrays are allowed.
- Keys are not allowed.
- **IMPORTANT!** There are limitations:
- There is no possibility to import array with one empty element, for example:
- ['']
- [null]
- But arrays with at least 2 such elements are allowed:
- ['', '']
- [null, null]
- ['', null]
- It is due of mapping CSV data to array:
- Empty value in CSV is equal to `[]`
- If we have default separator, `|` value in CSV is equal to `['', '']`#### Entity
- Allowed entity field types:
- `json`
- `array`
- `simple_array````php
namespace App\Entity;use Doctrine\ORM\Mapping as ORM;
#[ORM\Entity]
class User
{
#[ORM\Column(type: 'json']
private array $roles = [];
}
```#### Import configuration
* You have to add a field definition with a custom `ArrayTextType` type. If you skip this configuration, `TextType` will be used as default.
* You can set here your own separator.```php
use JG\BatchEntityImportBundle\Form\Type\ArrayTextType;
use JG\BatchEntityImportBundle\Model\Form\FormFieldDefinition;public function getFieldsDefinitions(): array
{
return [
'roles' => new FormFieldDefinition(
ArrayTextType::class,
[
'separator' => '&',
]
),
];
}
```#### CSV file
```csv
user_name,roles
user_1,USER&ADMIN&SUPER_ADMIN
user_2,USER
user_3,SUPER_ADMIN
```## Full example of CSV file
```csv
user_name,age,email,roles,country:en,name:pl
user_1,21,[email protected],USER&ADMIN&SUPER_ADMIN,Poland,Polska
user_2,34,[email protected],USER,England,Anglia
user_3,56,[email protected],SUPER_ADMIN,Germany,Niemcy
```