apache-ignite

1
// Licensed to the Apache Software Foundation (ASF) under one or more
2
// contributor license agreements.  See the NOTICE file distributed with
3
// this work for additional information regarding copyright ownership.
4
// The ASF licenses this file to You under the Apache License, Version 2.0
5
// (the "License"); you may not use this file except in compliance with
6
// the License.  You may obtain a copy of the License at
7
//
8
// http://www.apache.org/licenses/LICENSE-2.0
9
//
10
// Unless required by applicable law or agreed to in writing, software
11
// distributed under the License is distributed on an "AS IS" BASIS,
12
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
13
// See the License for the specific language governing permissions and
14
// limitations under the License.
15
= Using Pentaho With Apache Ignite
16

17
== Overview
18

19
http://www.pentaho.com[Pentaho, window=_blank] is a comprehensive platform that provides the ability to extract,
20
transform, visualize, and analyze your data easily. Pentaho Data Integration uses the Java Database Connectivity (JDBC)
21
API in order to connect to your database.
22

23
Apache Ignite is shipped with its own implementation of the JDBC driver which makes it possible to connect to Ignite
24
from the Pentaho platform and analyze the data stored in a distributed Ignite cluster.
25

26
== Installation and Configuration
27

28
* Download and Install Pentaho platform. Refer to the official https://help.pentaho.com/Documentation/7.1/Installation[Pentaho documentation, window=_blank].
29
* After Pentaho is successfully installed, you will need to install the Apache Ignite JDBC Driver using the JDBC Distribution Tool.
30
To do so, download Apache Ignite and locate `{apache-ignite}/libs/ignite-core-{version}.jar` and copy the file to the `{pentaho}/jdbc-distribution` directory.
31
* Open a command line tool, navigate to the `{pentaho}/jdbc-distribution` directory and run the following script `./distribute-files.sh ignite-core-{version}.jar`
32

33
== Ignite JDBC Driver Setup
34

35
The next step is to set up the JDBC driver and connect to the cluster. Below you will find the minimal number of actions
36
that need to be taken. Refer to the link:SQL/JDBC/jdbc-driver[JDBC Thin Driver] documentation for the more details.
37

38
. Open your command line tool, go to the `{pentaho}/design-tools/data-integration` directory and launch Pentaho Data Integration using the `./spoon.sh` script.
39
. Once the screen like the one below appears, click on the `File` menu option and create a new transformation -  `New -> Transformation`
40
+
41
image::images/tools/pentaho-new-transformation.png[Pentaho New Transformation]
42

43
. You can create a new Database Connection using setting the following parameters in Pentaho:
44
+
45
[opts="header"]
46
|===
47
|Pentaho Property Name | Value
48

49
| Connection Name| Set some custom name such as `IgniteConnection`
50
| Connection Type| Select the `Generic database` option.
51
| Access| Select the `Native (JDBC)` option.
52
| Custom Connection URL| `jdbc:ignite:thin://localhost:10800` or the real address of a cluster node to connect to.
53
| Custom Driver Class Name| `org.apache.ignite.IgniteJdbcThinDriver`
54
|===
55

56
. Click the `Test` button to check that the connection​ can be established:
57
+
58
image::images/tools/pentaho-ignite-connection.png[Pentaho Ignite Connection]
59

60
== Data Querying and Analysis
61

62
Once the connection between Ignite and Pentaho is established , you can query, transform, and analyze the data in a
63
variety of ways supported by Pentaho. For more details, refer to the official Pentaho documentation.
64

65
image::images/tools/pentaho-running-and-inspecting-data.png[Pentaho Running Queries]
66