• Stars
    star
    224
  • Rank 177,792 (Top 4 %)
  • Language
    Java
  • License
    Apache License 2.0
  • Created over 12 years ago
  • Updated 4 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Kettle plugin that provides support for interacting within many "big data" projects including Hadoop, Hive, HBase, Cassandra, MongoDB, and others.

Pentaho Big Data Plugin

The Pentaho Big Data Plugin Project provides support for an ever-expanding Big Data community within the Pentaho ecosystem. It is a plugin for the Pentaho Kettle engine which can be used within Pentaho Data Integration (Kettle), Pentaho Reporting, and the Pentaho BI Platform.

Building

It's a maven build, so mvn clean install is a typical default for a local build.

Pre-requisites

JDK 11 in your path. Maven 3.3.9 in your path. This settings.xml

How to use the custom settings.xml

Option 1: Copy this file into your /.m2 folder and name it "settings.xml". Warning: If you do this, it will become your default settings.xml for all maven builds.

Option 2: Copy this file into some other folder--possibly the project folder for the project you want to build and use the maven 's' option to build with this settings.xml file. Example: mvn -s public-settings.xml install.

The Pentaho profile defaults to pull all artifacts through the Pentaho public repository. If you want to try resolving maven plugin dependencies through the maven central repository instead of the Pentaho public repository, activate the "central" profile like this:

mvn -s -public-settings.xml -P central install

If your fails to resolve the jacoco-maven-plugin version 0.7.7-SNAPSHOT

The 0.7.7-SNAPSHOT property version for the jacoco-maven-plugin is defined in several releases of the Pentaho parent poms, but it is only available in the Pentaho artifact repositories. If you are trying to resolve through maven central or other public repositories you should override to get the latest version like this:

mvn -s -public-settings.xml -P central install -Djacoco-maven-plugin.version=0.7.7.201606060606

Further Reading

Additional documentation is available on the Community wiki: Big Data Plugin for Java Developers

License

Licensed under the Apache License, Version 2.0. See LICENSE.txt for more information.

More Repositories

1

pentaho-kettle

Pentaho Data Integration ( ETL ) a.k.a Kettle
Java
7,588
star
2

mondrian

Mondrian is an Online Analytical Processing (OLAP) server that enables business users to analyze large quantities of data in real-time.
Java
1,128
star
3

pentaho-platform

Pentaho BA Server Core
Java
467
star
4

pentaho-reporting

Java class library for generating reports.
Java
279
star
5

pdi-sdk-plugins

PDI SDK plugins
Java
110
star
6

pentaho-metadata

Java
67
star
7

pentaho-hadoop-shims

Hadoop Configurations
Java
50
star
8

pentaho-metadata-editor

Java
50
star
9

marketplace

Providing Pentaho, Partners, and Community Developers a marketplace for plugins within the BI Server product
Java
46
star
10

maven-parent-poms

Pentaho OSS Parent Poms
42
star
11

modeler

Pentaho Modeler
Java
40
star
12

marketplace-metadata

This project hosts the metadata related to plugins in Pentaho's marketplace, both BA Server and PDI
34
star
13

data-access

Pentaho Data Access Wizard
Java
32
star
14

metastore

Flexible Metadata, Data and Configuration information store
Java
26
star
15

kettle-storm

Java
22
star
16

pentaho-mongodb-plugin

Java
21
star
17

pentaho-data-mining

Pentaho DM (Weka) Plugins
Java
19
star
18

pentaho-metaverse

Java
18
star
19

pentaho-aggdesigner

Java
18
star
20

pentaho-platform-plugin-common-ui

JavaScript
14
star
21

pentaho-coding-standards

IDE specific code-style formatters, master CheckStyle template, and helpful developer Wiki
XSLT
13
star
22

pentaho-osgi-bundles

Repository of Pentaho-specific OSGI Bundles
Java
12
star
23

mql-editor

Java
10
star
24

pentaho-cloud-scripts

Collection of scripts for running Pentaho suite on various cloud providers.
Python
10
star
25

pentaho-engineering-samples

Samples provided by Pentaho Engineering which make use of public capabilities within the Pentaho Suite
Java
9
star
26

pentaho-platform-plugin-reporting

Java
9
star
27

pentaho-angular-seed

Seed Project for an AngularJS plugin into the Pentaho User Console (PUC)
9
star
28

pentaho-cwm

Java
8
star
29

pdi-osgi-bridge

Java
8
star
30

pentaho-commons-xul

Java
8
star
31

pdi-agile-bi-plugin

Agile BI plugin for PDI
8
star
32

hive-0.7.0

Pentaho Hive connector for CDH3
Java
8
star
33

pentaho-karaf-assembly

Customized version of a standard Apache Karaf distribution
JavaScript
8
star
34

pdi-teradata-tpt-plugin

Java
7
star
35

pentaho-jenkins-shared-library

Jenkins shared library for the Pentaho stack builds
Groovy
7
star
36

pentaho-vertica-bulkloader

Java
7
star
37

pentaho-platform-plugin-jpivot

JavaScript
7
star
38

pentaho-simple-jndi

Pentaho Fork of old Simple JNDI Project
Java
6
star
39

pdi-dataservice-server-plugin

Java
6
star
40

pentaho-mongo-utils

A set of tools to help with mongo connections
Java
6
star
41

pentaho-s3-vfs

kettle
5
star
42

pentaho-application-launcher

Java
5
star
43

pentaho-cassandra-plugin

Java
5
star
44

pentaho-commons-database

Java
4
star
45

pdi-platform-plugin

PDI platform plugin
Java
4
star
46

pentaho-data-profiling

4
star
47

maven-project-archetypes

Java
4
star
48

pentaho-versionchecker

Pentaho Version Checker
Java
4
star
49

pdi-dataservice-plugin

Java
4
star
50

pentaho-commons-gwt-modules

Java
4
star
51

pentaho-mondrianschemaworkbench-plugins

Java
3
star
52

pentaho-connections

Java
3
star
53

pdi-spark-plugin

3
star
54

mondrian-tck

Mondrian Test Compatibility Kit project
Java
3
star
55

pdi-platform-utils-plugin

Kettle steps to interact with BA Server functionalities
Java
3
star
56

pdi-vfs

Kettle-specific implementation of Apache VFS
3
star
57

pdi-weka-scoring-plugin

Java
3
star
58

pentaho-hdfs-vfs

Java
3
star
59

pentaho-reportwizard-core

Java
3
star
60

pentaho-chartbeans

Java
2
star
61

pentaho-data-refinery

Java
2
star
62

pdi-palo-core

Java
2
star
63

pentaho-commons-json

Java
2
star
64

apache-vfs-browser

Browser for Apache VFS
Java
2
star
65

pdi-weka-arff-output-plugin

Java
1
star
66

pentaho-actionsequence-dom

Java
1
star
67

pentaho-scheduler-plugin

pentaho-scheduler-plugin
Java
1
star
68

pentaho-maven-plugins

List of maven plugins created or managed by pentaho
Java
1
star
69

pentaho-twelve-days-visualizations

1
star
70

pentaho-registry

Java
1
star