Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

https://github.com/metafacture/metafacture-core

Core package of the Metafacture tool suite for metadata processing.
https://github.com/metafacture/metafacture-core

code4lib etl fix java-library metadata-processing metafacture metafix metamorph

Last synced: about 1 month ago
JSON representation

Core package of the Metafacture tool suite for metadata processing.

Awesome Lists containing this project

README 

          
![Metafacture](https://raw.github.com/wiki/metafacture/metafacture-core/img/metafacture.png)



[![Build](https://github.com/metafacture/metafacture-core/actions/workflows/build.yml/badge.svg?branch=master)](https://github.com/metafacture/metafacture-core/actions?query=workflow%3ABuild)



Metafacture is a toolkit for processing semi-structured data with a focus on library metadata. It provides a versatile set of tools for reading, writing and transforming data. Metafacture can be used as a stand-alone application or as a Java library in other applications. The name Metafacture is a portmanteau of the words *meta*data and manu*facture*.



Metafacture includes a [large number of modules](https://github.com/metafacture/metafacture-documentation/blob/master/flux-commands.md) for operating on semi-structured data. These modules can be combined to build pipelines to perform complex metadata processing tasks. The pipelines can be constructed either in Java code or with the domain-specific language **Flux**. One of the core features of Metafacture is the **Metamorph** module. Metamorph is an XML-based language for specifying transformations of semi-structured data. It can be seamlessly integrated into Java code.



At its heart Metafacture is a framework for implementing modules for metadata processing. This makes Metafacture easily extendable with additional modules. The [plugins and tools page](https://github.com/metafacture/metafacture-core/wiki/Plugins-and-Tools) on the wiki shows supplementary packages and projects which extend Metafacture.



Originally, Metafacture was developed as part of the [Culturegraph](http://www.culturegraph.org) platform but it is developed independently now and used by others, too: [see who uses Metafacture](https://github.com/metafacture/metafacture-core/wiki/Who-uses-Metafacture).



# Getting started



You can either use Metafacture as a stand-alone application or include it as a Java library in your own projects.



## Metafacture as a stand-alone application



If you are only interested in running Flux scripts without doing any Java programming this is the way to go. The instructions assume that you are using a \*nix-like shell. [See more information in the wiki page about Flux](https://github.com/metafacture/metafacture-core/wiki/Flux-user-guide).

You can `build` the stand-alone application yourself or `download` it.



a) Build



Proceed as described in [Building metafacture-core from source](#build_from_source).



b) Download



Download the latest distribution package from the [release page](https://github.com/metafacture/metafacture-core/releases). Make sure that you do download a distribution package and *not* a source code package (the file name should include `*-dist*`).



Regardless if you've built or downloaded, go on with:



1. Extract the archive:

    ```bash

    $ tar xzf metafacture-core-$VERSION-dist.tar.gz

    ```

    This will create a new directory containing a ready-to-use Metafacture distribution.

2. Change into the newly created directory:

    ```bash

    $ cd metafacture-core-$VERSION

    ```

3. Run one of the example scripts:

    ```bash

    $ ./flux.sh examples/read/marc21/read-marc21.flux

    ```

    This example will print a number of MARC 21 records on standard output.



The `examples` folder contains many more examples which provide a good starting point for learning Metafacture. If you have any questions please join our [mailing list](http://lists.dnb.de/mailman/listinfo/metafacture) or use our issue-based discussion forum over at [metafacture-documentation](https://github.com/metafacture/metafacture-documentation).



## Using Metafacture as a Java library



If you want to use Metafacture in your own Java projects all you need is to add some dependencies to your project. As of Metafacture 5, the single metafacture-core package has been replaced with a number of domain-specific packages. You can find the list of packages on [Maven Central](https://search.maven.org/search?q=g:org.metafacture).



Alternatively, you can simply guess the package names from the top-level folders in the source code repository -- they are the same. For instance, if you want to use Metamorph in your project, simply add the following dependency to your `pom.xml`:



```xml



    org.metafacture

    metamorph

    $VERSION



```



or if Gradle is your build tool of choice use:



```groovy

dependencies {

    implementation 'org.metafacture:metamorph:$VERSION'

}

```



Occasionally, we publish snapshot builds on [Sonatype OSS Repository](https://oss.sonatype.org/index.html#nexus-search;gav~org.metafacture~~~~). The version number is derived from the branch name. Snapshot builds from the master branch always have the version `master-SNAPSHOT`. We also provide sometimes pre releases as github packages.





# Building metafacture-core from source



Building metafacture-core from source is easy. All you need is git and JDK 11:



1. Clone the metafacture-core repository and change into the directory:

    ```bash

    $ git clone https://github.com/metafacture/metafacture-core.git

    $ cd metafacture-core

    ```



2. Invoke the Gradle wrapper to download Gradle and build metafacture-core (on Windows call `gradlew.bat publishToMavenLocal` instead) and publish these to your local Maven repository:

    ```bash

    $ ./gradlew publishToMavenLocal

    ```



3. Create a distribution if you need one. The resulting distribution can be found in `metafacture-core/metafacture-runner/build/distributions/`:

    ```bash

    $ ./gradlew assembleDist

    ```



(To import the projects in Eclipse, choose `File > Import > Existing Gradle Project` and select the `metafacture-core` directory.)



See [Code Quality and Style](https://github.com/metafacture/metafacture-core/wiki/Code-Quality-and-Style) on the wiki for further information on the sources.



# Metafacture Fix



Metafacture Fix (Metafix) is work in progress towards tools and an implementation of the Fix language for [Metafacture](https://metafacture.org/) as an alternative to configuring data transformations with [Metamorph](https://github.com/metafacture/metafacture-core/wiki#morph). Inspired by [Catmandu Fix](https://librecat.org/Catmandu/#fix-language), Metafix processes metadata not as a continuous data stream but as discrete records. The basic idea is to rebuild constructs from the (Catmandu) Fix language like [functions](https://librecat.org/Catmandu/#functions), [selectors](https://librecat.org/Catmandu/#selectors) and [binds](https://librecat.org/Catmandu/#binds) in Java and combine with additional functionalities from the Metamorph toolbox.



See also [Fix Interest Group](https://github.com/elag/FIG) for an initiative towards an implementation-independent specification for the Fix Language.



The project `metafix` contains the actual implementation of the Fix language as a Metafacture module and related components. It started as an [Xtext](#xtext) web project with a Fix grammar, from which a parser, a web editor, and a language server are generated. This project also contains an extension for VS code/codium based on that language server. (The web editor has effectively been replaced by the [Metafacture Playground](https://metafacture.org/playground), but remains here for its integration into the language server, which [we want to move over](https://github.com/metafacture/metafacture-playground/issues?q=is%3Aissue+language+server+is%3Aopen) to the playground.)



## Usage



The project `metafix` contains and uses a new `Metafix` stream module for Metafacture which plays the role of the `Metamorph` module in Fix-based Metafacture workflows. For the current implementation of the `Metafix` stream module see the tests in `metafix/src/test/java`. To play around with some examples, check out the [Metafacture Playground](https://metafacture.org/playground). For real-world usage samples see [openRub.fix](https://gitlab.com/oersi/oersi-etl/-/blob/master/data/production/openRub/openRub.fix) and [duepublico.fix](https://gitlab.com/oersi/oersi-etl/-/blob/master/data/production/duepublico/duepublico.fix). For reference documentation, see [Functions and cookbook](#functions-and-cookbook).



### Extension



The project `metafix-vsc` provides an extension for Visual Studio Code / Codium for `fix` via the language server protocol (LSP). In the current state the extension supports auto completion, simple syntax highlighting and auto closing brackets and quotes. This project was created using this [tutorial](https://www.typefox.io/blog/building-a-vs-code-extension-with-xtext-and-the-language-server-protocol) and the corresponding [example](https://github.com/TypeFox/languageserver-example).



Build extension:



> [!IMPORTANT]

> There is a problem when building the extension on Windows and installing the extension on a Linux system afterwards. In some cases the Xtext Server won't start. So if you want to use the extension not only on Windows, build the extension on a Linux system or on a Linux Subsystem on Windows.



1. Install Visual Studio Code / alternative: VS Codium

2. Install Node.js (including npm)

3. In metafacture-core execute:

Unix: `./gradlew installServer`

Windows: `.\gradlew.bat installServer`

4. In `metafix-vsc/` execute (tip: if you use windows, install cygwin to execute npm commands):

`npm install`



To start the extension in development mode (starting a second code/codium instance), follow A. To create a vsix file to install the extension permanently follow B.



A) Run in dev mode:

1. Open `metafix-vsc/` in Visual Studio Code / Codium

2. Launch vscode extension by pressing F5 (opens new window of Visual Studio Code)

3. Open new file (file-ending `.fix`) or open existing fix-file (see sample below)



B) Install vsix file:

1. Install vsce: `npm install -g vsce`

2. In `metafix-vsc/` execute: `vsce package`

vsce will create a vsix file in the vsc directory which can be used for installation:

3. Open VS Code / Codium

4. Click 'Extensions' section

5. Click menu bar and choose 'Install from VSIX...'



### Web editor



Start the web server:



`./gradlew jettyRun`



Visit [http://localhost:8080/](http://localhost:8080/), and paste this into the editor:



```

# Fix is a macro-language for data transformations



# Simple fixes



add_field("hello", "world")

remove_field("my.deep.nested.junk")

copy_field("stats", "output.$append")



# Conditionals



if exists("error")

  set_field("is_valid", "no")

  log("error")

elsif exists("warning")

  set_field("is_valid", "yes")

  log("warning")

else

  set_field("is_valid", "yes")

end



# Loops



do list(path: "foo", "var": "$i")

  add_field("$i.bar", "baz")

end

```



Content assist is triggered with Ctrl-Space. The input above is also used in `FixParsingTest.java`.



Run workflows on the web server, passing `data`, `flux`, and `fix`:



[http://localhost:8080/xtext-service/run?data='1'{'a': '5', 'z': 10}&flux=as-lines|decode-formeta|fix|encode-formeta(style="multiline")&fix=copy_field(a,c)](http://localhost:8080/xtext-service/run?data=%271%27{%27a%27:%20%275%27,%20%27z%27:%2010}&flux=as-lines|decode-formeta|fix|encode-formeta(style=%22multiline%22)&fix=copy_field(a,c))



## Functions and cookbook



### Best practices and guidelines for working with Metafacture Fix



- We recommend to use double quotation marks for arguments and values in functions, binds and conditionals.

- If using a `list` bind with a variable, the `var` option requires quotation marks (`do list(path: "", "var": "")`).

- Fix turns repeated fields into arrays internally but only marked arrays (with `[]` at the end of the field name) are also emitted as "arrays" (entities with indexed literals), all other arrays are emitted as repeated fields.

- Every Fix file should end with a final newline.



### Glossary



#### Array wildcards



Array wildcards resemble [Catmandu's concept of wildcards](http://librecat.org/Catmandu/#wildcards).



When working with arrays and repeated fields you can use wildcards instead of an index number to select elements of an array.



| Wildcard | Meaning |

|----------|:--------|

| `*` | Selects _all_ elements of an array. |

| `$first` | Selects only the _first_ element of an array. |

| `$last` | Selects only the _last_ element of an array. |

| `$prepend` | Selects the position _before_ the first element of an array. Can only be used when adding new elements to an array. |

| `$append` | Selects the position _after_ the last element of an array. Can only be used when adding new elements to an array. |



#### Path wildcards



Path wildcards resemble [Metamorph's concept of wildcards](https://github.com/metafacture/metafacture-core/wiki/Metamorph-User-Guide#addressing-pieces-of-data). They are not supported in Catmandu (it has [specialized Fix functions](https://librecat.org/Catmandu/#marc-mab-pica-paths) instead).



You can use path wildcards to select fields matching a pattern. They only match path _segments_ (field names), though, not _whole_ paths of nested fields. These wildcards cannot be used to add new elements.



| Wildcard | Meaning |

|----------|:--------|

| `*` | Placeholder for zero or more characters. |

| `?` | Placeholder for exactly one character. |

| `\|` | Alternation of multiple patterns. |

| `[...]` | Enumeration of characters. |



### Functions



#### Script-level functions



##### `include`



Includes a Fix file and executes it as if its statements were written in place of the function call.



Parameters:



- `path` (required): Path to Fix file (if the path starts with a `.`, it is resolved relative to the including file's directory; otherwise, it is resolved relative to the current working directory).



Options:



- All options are made available as "dynamic" local variables in the included Fix file.



```perl

include(""[, ...])

```



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/Include.java)



##### `log`



Sends a message to the logs.



Parameters:



- `logMessage` (required): Message to log.



Options:



- `level`: Log level to log at (one of `DEBUG`, `INFO`, `WARN` or `ERROR`). (Default: `INFO`)



```perl

log(""[, level: ""])

```



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/Log.java)



##### `nothing`



Does nothing. It is used for benchmarking in Catmandu.



```perl

nothing()

```



[Example in Playground](https://metafacture.org/playground/?example=nothing)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/Nothing.java)



##### `put_filemap`



Defines an external map for [lookup](#lookup) from a file or a URL. Maps with more than 2 columns are supported but are reduced to a defined key and a value column.



```perl

put_filemap("", "", sep_char: "\t")

```



[Example in Playground](https://metafacture.org/playground/?example=put_filemap)



The separator (`sep_char`) will vary depending on the source file, e.g.:



| Type | Separator  |

|------|------------|

| CSV  | `,` or `;` |

| TSV  | `\t`       |



Options:



- `allow_empty_values`: Sets whether to allow empty values in the filemap or to ignore these entries. (Default: `false`)

- `compression`: Sets the compression of the file.

- `decompress_concatenated`: Flags whether to use decompress concatenated file compression.

- `encoding`: Sets the encoding used to open the resource.

- `expected_columns`: Sets number of expected columns; lines with different number of columns are ignored. Set to `-1` to disable the check and allow arbitrary number of columns. (Default: `2`)

- `key_column`: Defines the column to be used for keys. Uses zero index. (Default: `0`)

- `value_column`: Defines the column to be used for values. Uses zero index. (Default: `1`)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/PutFileMap.java)



##### `put_map`



Defines an internal map for [lookup](#lookup) from key/value pairs.



```perl

put_map("",

  "dog": "mammal",

  "parrot": "bird",

  "shark": "fish"

)

```



[Example in Playground](https://metafacture.org/playground/?example=put_map)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/PutMap.java)



##### `put_rdfmap`



Defines an external RDF map for lookup from a file or an HTTP(S) resource.

As the RDF map is reducing RDF triples to a key/value map it is mandatory to set the target.

The targeted RDF property can optionally be bound by an RDF language tag.



```perl

put_rdfmap("", "", target: "")

put_rdfmap("", "", target: "", select_language: "")

```



[Example in Playground](https://metafacture.org/playground/?example=put_rdfmap)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/PutRdfMap.java)



##### `put_var`



Defines a single global variable that can be referenced with `$[]`.



```perl

put_var("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=put_var)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/PutVar.java)



##### `put_vars`



Defines multiple global variables that can be referenced with `$[]`.



```perl

put_vars(

  "": "",

  "": ""

)

```



[Example in Playground](https://metafacture.org/playground/?example=put_vars)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/PutVars.java)



##### `to_var`



Defines a single global variable that can be referenced with `$[]` and assigns the value of the ``.



```perl

to_var("", "")

```



Options:



- `default`: Default value if source field does not exist. The option needs to be written in quotation marks because it is a reserved word in Java. (Default: Empty string)



[Example in Playground](https://metafacture.org/playground/?example=to_var)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/script/ToVar.java)



#### Record-level functions



##### `add_array`



Creates a new array (with optional values).



```perl

add_array("")

add_array("", ""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=add_array)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/AddArray.java)



##### `add_field`



Creates a field with a defined value.



```perl

add_field("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=add_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/AddField.java)



##### `add_hash`



Creates a new hash (with optional values).



```perl

add_hash("")

add_hash("", "subfieldName": ""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=add_hash)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/AddHash.java)



##### `array`



Converts a hash/object into an array.



```perl

array("")

```



E.g.:



```perl

array("foo")

# {"name":"value"} => ["name", "value"]

```



[Example in Playground](https://metafacture.org/playground/?example=array)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Array.java)



##### `call_macro`



Calls a named macro, i.e. a list of statements that have been previously defined with the [`do put_macro`](#do-put_macro) bind.



Parameters:



- `name` (required): Unique name of the macro.



Options:



- All options are made available as "dynamic" local variables in the macro.



```perl

do put_macro(""[, ...])

  ...

end

call_macro(""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=call_macro)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/CallMacro.java)



##### `copy_field`



Copies a field from an existing field.



```perl

copy_field("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=copy_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/CopyField.java)



##### `format`



Replaces the value with a formatted (`sprintf`-like) version.



---- TODO: THIS NEEDS MORE CONTENT -----



```perl

format("", "")

```



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Format.java)



##### `hash`



Converts an array into a hash/object.



```perl

hash("")

```



E.g.:

```perl

hash("foo")

# ["name", "value"] => {"name":"value"}

```



[Example in Playground](https://metafacture.org/playground/?example=hash)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Hash.java)



##### `move_field`



Moves a field from an existing field. Can be used to rename a field.



```perl

move_field("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=move_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/MoveField.java)



##### `parse_text`



Parses a text into an array or hash of values.



---- TODO: THIS NEEDS MORE CONTENT -----



```perl

parse_text("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=parse_text)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/ParseText.java)



##### `paste`



Joins multiple field values into a new field. Can be combined with additional literal strings.



The default `join_char` is a single space. Literal strings have to start with `~`.



```perl

paste("", ""[, ...][, "join_char": ", "])

```



E.g.:



```perl

# a: eeny

# b: meeny

# c: miny

# d: moe

paste("my.string", "~Hi", "a", "~how are you?")

# "my.string": "Hi eeny how are you?"

```



[Example in Playground](https://metafacture.org/playground/?example=paste)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Paste.java)



##### `print_record`



Prints the current record as JSON either to standard output or to a file.



Parameters:



- `prefix` (optional): Prefix to print before the record; may include [format directives](https://docs.oracle.com/javase/8/docs/api/java/util/Formatter.html#syntax) for counter and record ID (in that order). (Default: Empty string)



Options:



- `append`: Whether to open files in append mode if they exist. (Default: `false`)

- `compression` (file output only): Compression mode. (Default: `auto`)

- `destination`: Destination to write the record to; may include [format directives](https://docs.oracle.com/javase/8/docs/api/java/util/Formatter.html#syntax) for counter and record ID (in that order). (Default: `stdout`)

- `encoding` (file output only): Encoding used by the underlying writer. (Default: `UTF-8`)

- `footer`: Footer which is written at the end of the output. (Default: `\n`)

- `header`: Header which is written at the beginning of the output. (Default: Empty string)

- `id`: Field name which contains the record ID; if found, will be available for inclusion in `prefix` and `destination`. (Default: `_id`)

- `internal`: Whether to print the record's internal representation instead of JSON. (Default: `false`)

- `pretty`: Whether to use pretty printing. (Default: `false`)

- `separator`: Separator which is written after the record. (Default: `\n`)



```perl

print_record([""][, ...])

```



E.g.:



```perl

print_record("%d) Before transformation: ")

print_record(destination: "record-%2$s.json", id: "001", pretty: "true")

print_record(destination: "record-%03d.json.gz", header: "After transformation: ")

```



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/PrintRecord.java)



##### `random`



Creates (or replaces) a field with a random number (less than the specified maximum).



```perl

random("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=random)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Random.java)



##### `remove_field`



Removes a field.



```perl

remove_field("")

```



[Example in Playground](https://metafacture.org/playground/?example=remove_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/RemoveField.java)



##### `rename`



Replaces a regular expression pattern in subfield names of a field. Does not change the name of the source field itself.



```perl

rename("", "", "")

```



[Example in Playground](https://metafacture.org/playground/?example=rename)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Rename.java)



##### `retain`



Deletes all fields except the ones listed (incl. subfields).



```perl

retain(""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=retain)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Retain.java)



##### `set_array`



Creates a new array (with optional values), provided that the intermediate structures (i.e. parent fields) exist. To create any missing intermediate structures, use [`add_array`](#add_array) instead.



```perl

set_array("")

set_array("", ""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=set_array)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/SetArray.java)



##### `set_field`



Creates a field with a defined value, provided that the intermediate structures (i.e. parent fields) exist. To create any missing intermediate structures, use [`add_field`](#add_field) instead.



```perl

set_field("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=set_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/SetField.java)



##### `set_hash`



Creates a new hash (with optional values), provided that the intermediate structures (i.e. parent fields) exist. To create any missing intermediate structures, use [`add_hash`](#add_hash) instead.



```perl

set_hash("")

set_hash("", "subfieldName": ""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=set_hash)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/SetHash.java)



##### `timestamp`



Creates (or replaces) a field with the current timestamp.



Options:



- `format`: Date and time pattern as in [java.text.SimpleDateFormat](https://docs.oracle.com/javase/8/docs/api/java/text/SimpleDateFormat.html). (Default: `timestamp`)

- `timezone`: Time zone as in [java.util.TimeZone](https://docs.oracle.com/javase/8/docs/api/java/util/TimeZone.html). (Default: `UTC`)

- `language`: Language tag as in [java.util.Locale](https://docs.oracle.com/javase/8/docs/api/java/util/Locale.html). (Default: The locale of the host system)



```perl

timestamp(""[, format: ""][, timezone: ""][, language: ""])

```



[Example in Playground](https://metafacture.org/playground/?example=timestamp)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Timestamp.java)



##### `vacuum`



Deletes empty fields, arrays and objects.



```perl

vacuum()

```



[Example in Playground](https://metafacture.org/playground/?example=vacuum)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Vacuum.java)



#### Field-level functions



##### `append`



Adds a string at the end of a field value.



```perl

append("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=append)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Append.java)



##### `capitalize`



Upcases the first character in a field value.



```perl

capitalize("")

```



[Example in Playground](https://metafacture.org/playground/?example=capitalize)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Capitalize.java)



##### `count`



Counts the number of elements in an array or a hash and replaces the field value with this number.



```perl

count("")

```



[Example in Playground](https://metafacture.org/playground/?example=count)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Count.java)



##### `downcase`



Downcases all characters in a field value.



```perl

downcase("")

```



[Example in Playground](https://metafacture.org/playground/?example=downcase)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Downcase.java)



##### `filter`



Only keeps field values that match the regular expression pattern. Works only with array of strings/repeated fields.



```perl

filter("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=filter)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Filter.java)



##### `flatten`



Flattens a nested array field.



```perl

flatten("")

```



[Example in Playground](https://metafacture.org/playground/?example=flatten)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Flatten.java)



##### `from_json`



Replaces the string with its JSON deserialization.



Options:



- `error_string`: Error message as a placeholder if the JSON couldn't be parsed. (Default: `null`)



```perl

from_json(""[, error_string: ""])

```



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/FromJson.java)



##### `index`



Returns the index position of a substring in a field and replaces the field value with this number.



```perl

index("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=index)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Index.java)



##### `isbn`



Extracts an ISBN and replaces the field value with the normalized ISBN; optionally converts and/or validates the ISBN.



Options:



- `to`: ISBN format to convert to (either `ISBN10` or `ISBN13`). (Default: Only normalize ISBN)

- `verify_check_digit`: Whether the check digit should be verified. (Default: `false`)

- `error_string`: Error message as a placeholder if the ISBN couldn't be validated. (Default: `null`)



```perl

isbn(""[, to: ""][, verify_check_digit: ""][, error_string: ""])

```



[Example in Playground](https://metafacture.org/playground/?example=isbn)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Isbn.java)



##### `join_field`



Joins an array of strings into a single string.



```perl

join_field("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=join_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/JoinField.java)



##### `lookup`



Looks up matching values in a map and replaces the field value with this match. [External files](#put_filemap), [internal maps](#put_map) as well as [RDF resources](#put_rdfmap) can be used.



Parameters:



- `path` (required): Field path to look up.

- `map` (optional): Name or path of the map in which to look up values.



Options:



- `default`: Default value to use for unknown values. The option needs to be written in quotation marks because it is a reserved word in Java. (Default: Old value)

- `delete`: Whether to delete unknown values. (Default: `false`)

- `print_unknown`: Whether to print unknown values. (Default: `false`)



Additional options when printing unknown values:



- `append`: Whether to open files in append mode if they exist. (Default: `true`)

- `compression` (file output only): Compression mode. (Default: `auto`)

- `destination`: Destination to write unknown values to; may include [format directives](https://docs.oracle.com/javase/8/docs/api/java/util/Formatter.html#syntax) for counter and record ID (in that order). (Default: `stdout`)

- `encoding` (file output only): Encoding used by the underlying writer. (Default: `UTF-8`)

- `footer`: Footer which is written at the end of the output. (Default: `\n`)

- `header`: Header which is written at the beginning of the output. (Default: Empty string)

- `id`: Field name which contains the record ID; if found, will be available for inclusion in `prefix` and `destination`. (Default: `_id`)

- `prefix`: Prefix to print before the unknown value; may include [format directives](https://docs.oracle.com/javase/8/docs/api/java/util/Formatter.html#syntax) for counter and record ID (in that order). (Default: Empty string)

- `separator`: Separator which is written after the unknown value. (Default: `\n`)



```perl

lookup(""[, ][, ...])

```



E.g.:



```perl

# local (unnamed) map

lookup("path.to.field", key_1: "value_1", ...)



# internal (named) map

put_map("internal-map", key_1: "value_1", ...)

lookup("path.to.field", "internal-map")



# external file map (implicit)

lookup("path.to.field", "path/to/file", sep_char: ";")



# external file map (explicit)

put_filemap("path/to/file", "file-map", sep_char: ";")

lookup("path.to.field", "file-map")



# RDF map (explicit)

put_rdfmap("path/to/file", "rdf-map", target: "")

lookup("path.to.field", "rdf-map")



# with default value

lookup("path.to.field", "map-name", "default": "NA")



# with printing unknown values to a file

lookup("path.to.field", "map-name", print_unknown: "true", destination: "unknown.txt")

```



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Lookup.java)



##### `prepend`



Adds a string at the beginning of a field value.



```perl

prepend("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=prepend)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Prepend.java)



##### `replace_all`



Replaces a regular expression pattern in field values with a replacement string. Regexp capturing is possible; refer to capturing groups by number (`$`) or name (`${}`).



```perl

replace_all("", "", "")

```



[Example in Playground](https://metafacture.org/playground/?example=replace_all)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/ReplaceAll.java)



##### `reverse`



Reverses the character order of a string or the element order of an array.



```perl

reverse("")

```



[Example in Playground](https://metafacture.org/playground/?example=reverse)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Reverse.java)



##### `sort_field`



Sorts strings in an array. Alphabetically and A-Z by default. Optional numerical and reverse sorting.



```perl

sort_field("")

sort_field("", reverse: "true")

sort_field("", numeric: "true")

```



[Example in Playground](https://metafacture.org/playground/?example=sort_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/SortField.java)



##### `split_field`



Splits a string into an array and replaces the field value with this array.



```perl

split_field("", "")

```



[Example in Playground](https://metafacture.org/playground/?example=split_field)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/SplitField.java)



##### `substring`



Replaces a string with its substring as defined by the start position (offset) and length.



```perl

substring("", "", "")

```



[Example in Playground](https://metafacture.org/playground/?example=substring)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Substring.java)



##### `sum`



Sums numbers in an array and replaces the field value with this number.



```perl

sum("")

```



[Example in Playground](https://metafacture.org/playground/?example=sum)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Sum.java)



##### `to_base64`



Replaces the value with its Base64 encoding.



Options:



-`url_safe`: Perform URL-safe encoding (uses Base64URL format). (Default: `false`)



```perl

to_base64(""[, url_safe: ""])

```



[Example in Playground](https://metafacture.org/playground/?example=to_base64)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/ToBase64.java)



##### `to_json`



Replaces the value with its JSON serialization.



Options:



- `error_string`: Error message as a placeholder if the JSON couldn't be generated. (Default: `null`)

- `pretty`: Whether to use pretty printing. (Default: `false`)



```perl

to_json(""[, pretty: ""][, error_string: ""])

```



[Example in Playground](https://metafacture.org/playground/?example=to_json)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/ToJson.java)



##### `trim`



Deletes whitespace at the beginning and the end of a field value.



```perl

trim("")

```



[Example in Playground](https://metafacture.org/playground/?example=trim)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Trim.java)



##### `uniq`



Deletes duplicate values in an array.



```perl

uniq("")

```



[Example in Playground](https://metafacture.org/playground/?example=uniq)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Uniq.java)



##### `upcase`



Upcases all characters in a field value.



```perl

upcase("")

```



[Example in Playground](https://metafacture.org/playground/?example=upcase)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/Upcase.java)



##### `uri_encode`



Encodes a field value as URI. Aka percent-encoding.



Options:



- `plus_for_space`: Sets whether "space" (` `) will be substituted by a "plus" (`+`) or be percent escaped (`%20`). (Default: `true`)

- `safe_chars`: Sets characters that won't be escaped. Safe characters are the ranges 0..9, a..z and A..Z. These are always safe and should not be specified. (Default: `.-*_`)



```perl

uri_encode(""[, ...])

```



E.g.:



```perl

uri_encode("path.to.field", plus_for_space:"false", safe_chars:"")

```



[Example in Playground](https://metafacture.org/playground/?example=uri_encode)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/field/UriEncode.java)



### Selectors



#### `reject`



Ignores records that match a condition.



```perl

if 

  reject()

end

```



[Example in Playground](https://metafacture.org/playground/?example=reject)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/method/record/Reject.java)



### Binds



#### `do list`



Iterates over each element of an array. In contrast to Catmandu, it can also iterate over a single object or string.



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/bind/List.java)



```perl

do list(path: "")

  ...

end

```



[Example in Playground](https://metafacture.org/playground/?example=do_list)



Only the current element is accessible in this case (as the root element).



When specifying a variable name for the current element, the record remains accessible as the root element and the current element is accessible through the variable name:



```perl

do list(path: "", "var": "")

  ...

end

```



[Example in Playground](https://metafacture.org/playground/?example=do_list_with_var)



#### `do list_as`



Iterates over each _named_ element of an array (like [`do list`](#do-list) with a variable name). If multiple arrays are given, iterates over the _corresponding_ elements from each array (i.e., all elements with the same array index, skipping elements whose arrays have already been exhausted).



[Example in Playground](https://metafacture.org/playground/?example=do+list_as)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/bind/ListAs.java)



```perl

do list_as(element_1: ""[, ...])

  ...

end

```



E.g.:



```perl

# "ccm:university":["https://ror.org/0304hq317"]

# "ccm:university_DISPLAYNAME":["Gottfried Wilhelm Leibniz Universität Hannover"]

set_array("sourceOrga[]")

do list_as(orgId: "ccm:university[]", orgName: "ccm:university_DISPLAYNAME[]")

  copy_field(orgId, "sourceOrga[].$append.id")

  copy_field(orgName, "sourceOrga[].$last.name")

end

# {"sourceOrga":[{"id":"https://ror.org/0304hq317","name":"Gottfried Wilhelm Leibniz Universität Hannover"}]}

```



#### `do once`



Executes the statements only once (when the bind is first encountered), not repeatedly for each record.



```perl

do once()

  ...

end

```



[Example in Playground](https://metafacture.org/playground/?example=do_once)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/bind/Once.java)



In order to execute multiple blocks only once, tag them with unique identifiers:



```perl

do once("maps setup")

  ...

end

do once("vars setup")

  ...

end

```



#### `do put_macro`



Defines a named macro, i.e. a list of statements that can be executed later with the [`call_macro`](#call_macro) function.



Variables can be referenced with `$[]`, in the following order of precedence:



1. "dynamic" local variables, passed as options to the `call_macro` function;

2. "static" local variables, passed as options to the `do put_macro` bind;

3. global variables, defined via [`put_var`](#put_var)/[`put_vars`](#put_vars).



Parameters:



- `name` (required): Unique name of the macro.



Options:



- All options are made available as "static" local variables in the macro.



```perl

do put_macro(""[, ...])

  ...

end

call_macro(""[, ...])

```



[Example in Playground](https://metafacture.org/playground/?example=do_put_macro)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/bind/PutMacro.java)



### Conditionals



Conditionals start with `if` in case of affirming the condition or `unless` rejecting the condition.



Conditionals require a final `end`.



Additional conditionals can be set with `elsif` and `else`.



```perl

if 

  ...

end

```



```perl

unless 

  ...

end

```



```perl

if 

  ...

elsif

  ...

else

  ...

end

```



#### `contain`



##### `all_contain`



Executes the functions if/unless the field contains the value. If it is an array or a hash all field values must contain the string.



[Example in Playground](https://metafacture.org/playground/?example=all_contain)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/AllContain.java)



##### `any_contain`



Executes the functions if/unless the field contains the value. If it is an array or a hash one or more field values must contain the string.



[Example in Playground](https://metafacture.org/playground/?example=any_contain)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/AnyContain.java)



##### `none_contain`



Executes the functions if/unless the field does not contain the value. If it is an array or a hash none of the field values may contain the string.



[Example in Playground](https://metafacture.org/playground/?example=none_contain)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/NoneContain.java)



##### `str_contain`



Executes the functions if/unless the first string contains the second string.



[Example in Playground](https://metafacture.org/playground/?example=str_contain)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/StrContain.java)



#### `equal`



##### `all_equal`



Executes the functions if/unless the field value equals the string. If it is an array or a hash all field values must equal the string.



[Example in Playground](https://metafacture.org/playground/?example=all_equal)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/AllEqual.java)



##### `any_equal`



Executes the functions if/unless the field value equals the string. If it is an array or a hash one or more field values must equal the string.



[Example in Playground](https://metafacture.org/playground/?example=any_equal)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/AnyEqual.java)



##### `none_equal`



Executes the functions if/unless the field value does not equal the string. If it is an array or a hash none of the field values may equal the string.



[Example in Playground](https://metafacture.org/playground/?example=none_equal)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/NoneEqual.java)



##### `str_equal`



Executes the functions if/unless the first string equals the second string.



[Example in Playground](https://metafacture.org/playground/?example=str_equal)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/StrEqual.java)



#### `exists`



Executes the functions if/unless the field exists.



```perl

if exists("")

```



[Example in Playground](https://metafacture.org/playground/?example=exists)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/Exists.java)



#### `greater_than`



Executes the functions if/unless the field value is greater than the given value.



[Example in Playground](https://metafacture.org/playground/?example=greater_than)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/GreaterThan.java)



#### `in`



Executes the functions if/unless the field value [is contained in](https://perldoc.perl.org/perlop#Smartmatch-Operator) the value of the other field.



_Also aliased as [`is_contained_in`](#is_contained_in)._



[Example in Playground](https://metafacture.org/playground/?example=in)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/In.java)



#### `is_contained_in`



_Alias for [`in`](#in)._



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsContainedIn.java)



#### `is_array`



Executes the functions if/unless the field value is an array.



[Example in Playground](https://metafacture.org/playground/?example=is_array)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsArray.java)



#### `is_empty`



Executes the functions if/unless the field value is empty.



[Example in Playground](https://metafacture.org/playground/?example=is_empty)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsEmpty.java)



#### `is_false`



Executes the functions if/unless the field value equals `false` or `0`.



[Example in Playground](https://metafacture.org/playground/?example=is_false)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsFalse.java)



#### `is_hash`



_Alias for [`is_object`](#is_object)._



[Example in Playground](https://metafacture.org/playground/?example=is_hash)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsHash.java)



#### `is_number`



Executes the functions if/unless the field value is a number.



[Example in Playground](https://metafacture.org/playground/?example=is_number)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsNumber.java)



#### `is_object`



Executes the functions if/unless the field value is a hash (object).



_Also aliased as [`is_hash`](#is_hash)._



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsObject.java)



#### `is_string`



Executes the functions if/unless the field value is a string (and not a number).



[Example in Playground](https://metafacture.org/playground/?example=is_string)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsString.java)



#### `is_true`



Executes the functions if/unless the field value equals `true` or `1`.



[Example in Playground](https://metafacture.org/playground/?example=is_true)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/IsTrue.java)



#### `less_than`



Executes the functions if/unless the field value is less than the given value.



[Example in Playground](https://metafacture.org/playground/?example=less_than)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/LessThan.java)



#### `match`



##### `all_match`



Executes the functions if/unless the field value matches the regular expression pattern. If it is an array or a hash all field values must match the regular expression pattern.



[Example in Playground](https://metafacture.org/playground/?example=all_match)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/AllMatch.java)



##### `any_match`



Executes the functions if/unless the field value matches the regular expression pattern. If it is an array or a hash one or more field values must match the regular expression pattern.



[Example in Playground](https://metafacture.org/playground/?example=any_match)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/AnyMatch.java)



##### `none_match`



Executes the functions if/unless the field value does not match the regular expression pattern. If it is an array or a hash none of the field values may match the regular expression pattern.



[Example in Playground](https://metafacture.org/playground/?example=none_match)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/NoneMatch.java)



##### `str_match`



Executes the functions if/unless the string matches the regular expression pattern.



[Example in Playground](https://metafacture.org/playground/?example=str_match)



[Java Code](https://github.com/metafacture/metafacture-core/blob/master/metafix/src/main/java/org/metafacture/metafix/conditional/StrMatch.java)



## Xtext



The Metafix projects have been originally set up with [Xtext](https://www.eclipse.org/Xtext/) 2.17.0 and Eclipse for Java 2019-03, following [https://www.eclipse.org/Xtext/documentation/104_jvmdomainmodel.html](https://www.eclipse.org/Xtext/documentation/104_jvmdomainmodel.html).



# Stay updated



For support and discussion join the [mailing list](http://lists.dnb.de/mailman/listinfo/metafacture).