Mutator class for evolving Schemas conveniently

[pereferrera]

For the next Pangool release I'm working on an utility called "Mutator" that allows to conveniently evolve Schemas. Currently it has these methods:

minusFields(Schema schema, String... minusFields) - returns a Schema like the argument one minus the fields passed as second parameter.

subSetOf(Schema schema, String... subSetFields) - returns a Schema like the argument one containing only the fields passed as second parameter.

superSetOf(Schema schema, Field... newFields) - returns a Schema like the argument one but adding new Fields to it.

jointSchema(Schema leftSchema, Schema rightSchema) - returns a joint Schema of two Schemas, where the left one has priority over the right (first all fields from the left are added, then the ones in the right that are not in left).

Shout if you have more suggestions or feedback.

[ivanprado]

Some ideas:

• I would add some file renaming tooling. Something like rename(Schema
  schema, String []oldNames, String []newNames)
• Tools for changing the nullable properties of some fields
• Tools for changing the default value of some fields. Related with Backwards compatibility for TupleReader and TupleMRBuilder #20

2013/10/1 Pere Ferrera notifications@github.com

For the next Pangool release I'm working on an utility called "Mutator"
that allows to conveniently evolve Schemas. Currently it has these methods:

minusFields(Schema schema, String... minusFields) - returns a Schema like the argument one minus the fields passed as second parameter.

subSetOf(Schema schema, String... subSetFields) - returns a Schema like the argument one containing only the fields passed as second parameter.

superSetOf(Schema schema, Field... newFields) - returns a Schema like the argument one but adding new Fields to it.

jointSchema(Schema leftSchema, Schema rightSchema) - returns a joint Schema of two Schemas, where the left one has priority over the right (first all fields from the left are added, then the ones in the right that are not in left).

Shout if you have more suggestions or feedback.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/33
.

Iván de Prado
CEO & Co-founder
www.datasalt.com