Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Defining your own Type Converter

TODO
See org.pentaho.hadoop.mapreduce.converter.spi.ITypeConverter for more info. We use the Service Locator pattern; specifically Java's ServiceLoader.

Distributed Cache

Pentaho MapReduce relies on Hadoop's Distributed Cache to distribute the Kettle environment, configuration, and plugins across the cluster. By leveraging the Distributed Cache network traffic is reduced up for subsequent executions as the Kettle environment is automatically configured on each node. This also allows you to use multiple version of Kettle against a single cluster.

...