Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hopsoft/field_mapper
Data mapping & transformation
https://github.com/hopsoft/field_mapper
data-conversion data-transformation ruby
Last synced: 16 days ago
JSON representation
Data mapping & transformation
- Host: GitHub
- URL: https://github.com/hopsoft/field_mapper
- Owner: hopsoft
- License: mit
- Created: 2014-04-01T18:13:12.000Z (almost 11 years ago)
- Default Branch: master
- Last Pushed: 2020-08-24T16:55:47.000Z (over 4 years ago)
- Last Synced: 2024-12-26T10:05:12.387Z (30 days ago)
- Topics: data-conversion, data-transformation, ruby
- Language: Ruby
- Size: 82 KB
- Stars: 26
- Watchers: 3
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE.txt
Awesome Lists containing this project
README
[](http://blog.codinghorror.com/the-best-code-is-no-code-at-all/)
[](https://travis-ci.org/hopsoft/field_mapper)
[](https://coveralls.io/r/hopsoft/field_mapper?branch=master)
# FieldMapper
## Data Mapping & Transformation
### Uses
- Mapping data between 2 or more formats
- Transforming data with complex rules
- Defining data standards
### Overview
FieldMapper introduces a new term for a model-like data structure
to avoid possible confusion with libraries such as ActiveRecord.
This new term is: **Plat**
A plat defines the following:
- Fields
- Datatypes
- Mappings
- Transformation rules
Datatype declarations exist to support implicit type casting of values.
The supported datatypes are:
- String
- Boolean
- Time
- Integer
- Float
- Money
- Plat
- List (of any listed type)
## Usage
```sh
gem install field_mapper
```
```ruby
# Gemfile
gem "field_mapper"
```
Suppose we want to perform a mapping between Facebook users & Twitter users.
1. First we need to define a standard user class.
```ruby
class StandardUser < FieldMapper::Standard::Plat
field :name, type: String
field :screen_name, type: String
field :info, type: String
field :website, type: String
field :age, type: Integer
# field with allowed values
field :gender, type: String do
value "F"
value "M"
end
# field with a default value
field :net_worth,
type: Money,
default: 0
# field that holds a list of plats
field :friends,
type: FieldMapper::Types::List[StandardUser],
default: []
end
```
2. Next we define a Facebook user class that maps onto our standard.
```ruby
class FacebookUser < FieldMapper::Custom::Plat
# note that we set the standard
set_standard StandardUser
# fields are mapped to the standard
field :name, standard: :name
field :bio, standard: :info
field :website, standard: :website
field :net_worth, standard: :net_worth
# field with mapped values
field :gender, standard: :gender do
value "female", standard: "F"
value "male", standard: "M"
end
# some fields don't map to a standard
field :birthday, type: Time
field :friends,
standard: :friends,
type: FieldMapper::Types::List[FacebookUser], # <- lists must define type even when mapped to a standard
default: []
# field with complex transformation rules
field :username,
standard: :screen_name,
custom_to_standard: -> (value, standard_instance: nil) {
# value passed is the custom value
# value returned is the standard value
"Facebook:#{value.to_s.strip}"
},
standard_to_custom: -> (value, standard_instance: nil) {
# value passed is the standard value
# value returned is the custom value
value.to_s.split(/:/).last
}
end
```
3. Then we define a Twitter user class that maps onto our standard.
```ruby
class TwitterUser < FieldMapper::Custom::Plat
set_standard StandardUser
field :name, standard: :name
field :description, standard: :info
field :url, standard: :website
field :followers_count, type: Integer
field :screen_name, standard: :screen_name,
custom_to_standard: -> (value, standard_instance: nil) {
"Twitter:#{value.to_s.strip}"
},
standard_to_custom: -> (value, standard_instance: nil) {
value.to_s.split(/:/).last
}
# callback method that runs after tranformation
def after_convert(from: nil, to: nil)
if from.respond_to? :friends
self.followers_count = from.friends.length
end
end
end
```
4. Now we can construct a Facebook user.
```ruby
zuck = FacebookUser.new(
name: "Mark Zuckerberg",
username: "zuck",
bio: "Creator of Facebook",
website: "http://www.facebook.com/zuck",
gender: "male",
age: 29,
net_worth: "$29,000,000,000 USD", # value will be cast to a Money
birthday: "1984-05-14" # value will be cast to a Time
)
zuck.friends << FacebookUser.new(name: "Priscilla Chan")
```
5. We can also transform our Facebook user to a standard user.
```ruby
converter = FieldMapper::Custom::Converter.new(zuck)
standard_zuck = converter.convert_to_standard
```
6. We can also transform our Facebook user to a Twitter user.
```ruby
converter = FieldMapper::Custom::Converter.new(zuck)
twitter_zuck = converter.convert_to(TwitterUser)
```
7. We can transform a standard user into both a Facebook & Twitter user.
```ruby
converter = FieldMapper::Standard::Converter.new(standard_zuck)
zuck_from_standard = converter.convert_to(FacebookUser)
twitter_zuck_from_standard = converter.convert_to(TwitterUser)
```
8. We can emit our objects as a Hash.
```ruby
zuck_hash = zuck.to_hash
{
"_node_id" => 70260402777020,
"_flat" => false,
"name" => "Mark Zuckerberg",
"username" => "zuck",
"bio" => "Creator of Facebook",
"website" => "http://www.facebook.com/zuck",
"gender" => "male",
"net_worth" => "$29,000,000,000.00 USD",
"friends" => [
{
"_node_id" => 70260401841760,
"_flat" => false,
"name" => "Priscilla Chan",
"username" => nil,
"bio" => nil,
"website" => nil,
"gender" => nil,
"net_worth" => nil,
"friends" => [],
"birthday" => nil
}
],
"birthday" => "1984-05-14T06:00:00Z"
}
zuck_flat_hash = zuck.to_hash(flatten: true)
{
"_node_id" => 70260402777020,
"_flat" => true,
"name" => "Mark Zuckerberg",
"username" => "zuck",
"bio" => "Creator of Facebook",
"website" => "http://www.facebook.com/zuck",
"gender" => "male",
"net_worth" => "$29,000,000,000.00 USD",
"friends" => "[{\"_node_id\":70260401841760,\"_flat\":true,\"name\":\"Priscilla Chan\",\"username\":null,\"bio\":null,\"website\":null,\"gender\":null,\"net_worth\":null,\"friends\":[],\"birthday\":null}]",
"birthday" => "1984-05-14T06:00:00Z"
}
```
9. We can also reconstruct instances from a Hash.
```ruby
zuck_from_hash = FacebookUser.new(zuck_hash)
zuck_from_flat_hash = FacebookUser.new(zuck_flat_hash)
```
This is powerful stuff.
I invite you to play around & experiment.
Read through [the tests](https://github.com/hopsoft/field_mapper/tree/master/test) for more detail.