Preparing the Apache Spark Environment

How to:

Configure the Java CLASSPATH

The following components are needed to use the adapter for Hadoop/Hive:

Java. To use this JDBC-based adapter, you must have Java installed. Hadoop requires Version 1.7 or later. Java can be downloaded from http://www.java.com.
The location of Java must be specified in an environment variable.

If you are using Linux, add a line to your profile with the location where Java is installed. For example:
```
export JAVA_HOME=/usr/lib/jvm/jre-1.7.0
```
If you have JDK installed:
```
export JAVA_HOME=/usr/lib/jvm/jdk-1.7.0
```
If you are using Windows, right-click Computer and click Properties. Then click Advanced System Settings and click Environment Variables. Add the locations to your PATH variable. For example:
```
C:\Program Files\Java\jdk7\bin\server;C:\Program Files\Java\jdk7\bin;
```
JDBC Drivers. The Spark JDBC driver requires two jar files, which are included with Apache Spark. If you are installing the server on the same system where Spark is installed, you can point to the jar files as described in the next section. If you are installing the server on some other system, copy those files to a location of your choice.

Procedure: How to Configure the Java CLASSPATH

The location of the Apache Spark jar files must be specified to the server. If you are running the server on the same system as the Hadoop and Hive server, you can specify their location. If you are running the server on another system, copy the files listed below to some location on your system and specify their location.

This can be done in the system CLASSPATH or in the DataMigrator or WebFOCUS Reporting Server IBI_CLASSPATH variable as follows:

From the Web Console menu bar, select Workspace

or

From the Data Management Console, expand the Workspace folder.
Expand the Java Services folder. Right-click DEFAULT and click Properties.

The Java Services Configuration page opens.
Expand Class path.
In the IBI_CLASSPATH box, enter the full location of the Spark files shown below. The file names must be entered one per line.

If you are installing the adapter on a different system than where Hadoop and Hive are installed, copy the jar files to a location on that system.

Enter the location on your system that matches your installation.
```
hive-jdbc-<version>-standalone.jar
hadoop-common.jar
```