Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Wiki Markup
{include:Labs Warning}

{excerpt}PMR Vizor is a realtime monitoring and debugging tool for transforms running in the Hadoop cluster{excerpt}

h2. Project Info
* *Status:* Initial Dev Complete, in Engineering review
* *Roadmap:* On road map, target for 5.1
* *Availability:* Enterprise Edition Only
* *Contact:* dmoran or use "Add Comment" at bottom of page
* *JIRA:* http://jira.pentaho.com/browse/PDI-10325

{youtube}X1FbpSIeCzY{youtube}
* Download the Video: color:#ff0000}{*}NOTE:  VIZOR IS AN EXPERIMENTAL TOOL. IT IS NOT RECOMMENDED FOR PRODUCTION USE.*{color}

Vizor monitors running Pentaho MapReduce (PMR) jobs that are distributed on Hadoop or Carte clusters.  Vizor helps you debug PMR jobs by displaying errors, metrics, Hadoop output, Carte information, and other job execution information in a Spoon perspective.  Because Vizor is experimental, it does not come bundled with PDI.  You have to install Vizor before it is ready to be used.

h2. Installation

To install Vizor, download it from the Support Portal, unzip it, and place it in the right directory.
# Download the *pentaho-pmr-vizor-plugin-package<version>.dist.zip* file from the Pentaho Support portal.
# Unzip the file, then follow the onscreen instructions to extract the vizor jar from the package.
# Move vizor jar file here: *pentaho/design-tools/data-integration/plugins/Vizor*. If the *Vizor* directory doesn't exist, create it.
# Set the *VIZOR_SPOON_CARTE_HOSTNAME* kettle variable to the local IP address for Carte. &nbsp;See&nbsp;[Set Kettle Variables|https://help.pentaho.com/Documentation/5.2/0L0/0Y0/090/020/000/010/010]&nbsp;to learn how to do this.
# Open the *plugin.properties* file in the *pentaho/design-tools/data-integration/plugins/pentaho-big-data-plugin*&nbsp;folder and add this line: &nbsp;*pmr.kettle.additional.plugins=Vizor*
# Stop and restart Spoon if it is running.

h2. Using Vizor

Once Vizor is installed, it is available any time you run a job.  To use Vizor, complete these steps.
# In Spoon, open a job that has a *Pentaho MapReduce* entry in it. &nbsp;
# Run the Pentaho MapReduce job.
# A message appears asking whether you want to use the Pentaho MapReduce Vizor perspective.   Click *Yes*.

* As the step runs, notes about the job execution progress and step statuses appear in the logging tab near the bottom of the window.
* The Vizor perspective (which you can see when you click the button in the upper right corner of the Spoon main window) reveals more details about the jobs. It shows each transformation in the job, as well as transformation statistics.&nbsp;
* In the Vizor perspective, statistics displayed are common PDI statistics, such as: number of read and written rows, input and output, number of errors and execution status. Column types mirror those in other PDI steps.
* Two tabs in the bottom of the screen are context-dependent and show logging messages for the selected node and steps output data respectively.

*{_}NOTE:&nbsp;The big-data plugin storage in hadoop might need to be cleared to make vizor work. To do it, use OpenURL toconnect to your hadoop server, then remove /opt/pentaho/mapreduce contents._*



h2. Demo Video

You can download the video here:&nbsp;[https://pentaho.box.com/PMRVizorUpdate1
\\]. &nbsp;
\\
\\
{jiraissues:anonymous=true|columns=key;fixVersion;summary;status;assignee;updated|url=http://jira.pentaho.com/sr/jira.issueviews:searchrequest-xml/temp/SearchRequest.xml?jqlQuery=text+%7E+%22vizor%22&tempMax=1000}



{scrollbar}