• This repository has been archived on 05/Apr/2022
  • Stars
    star
    490
  • Rank 89,811 (Top 2 %)
  • Language
    Java
  • License
    Apache License 2.0
  • Created over 11 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Spring Hadoop Samples

spring-hadoop-samples is no longer actively maintained by VMware, Inc.

Sample Applications for Spring for Apache Hadoop

This repository contains several sample applications that show how you can use Spring for Apache Hadoop.

Note
These samples are built using version 2.2.0.RELEASE of Spring for Apache Hadoop project. For examples built against older versions check out the Git "tag" that corresponds to your desired version.

Overview of Spring for Apache Hadoop

Hadoop has a poor out of the box programming model. Writing applications for Hadoop generally turn into a collection of scripts calling Hadoop command line applications. Spring for Apache Hadoop provides a consistent programming model and declarative configuration model for developing Hadoop applications.

Together with Spring Integration and Spring Batch, Spring for Apache Hadoop can be used to address a wide range of use cases

  • HDFS data access and scripting

  • Data Analysis

    • MapReduce

    • Pig

    • Hive

  • Workflow

  • Data collection and ingestion

  • Event Streams processing

Features

  • Declarative configuration to create, configure, and parameterize Hadoop connectivity and all job types (MR/Streaming MR/Pig/Hive/Cascading)

  • Simplify HDFS API with added support for JVM scripting languages

  • Runner classes for MR/Pig/Hive/Cascading for small workflows consisting of the following steps HDFS operations โ†’ data analysis โ†’ HDFS operations

  • Helper โ€œTemplateโ€ classes for Pig/Hive/HBase

    • Execute scripts and queries without worrying about Resource Management Exception Handling and Translation

    • Thread-safety

  • Lightweight Object-Mapping for HBase

  • Hadoop components for Spring Integratio and Spring Batch

    • Spring Batch tasklets for HDFS and data analysis

    • Spring Batch HDFS ItemWriters

    • Spring Integration HDFS channel adapters

Additional Resources

Many of the samples were taken from the Oโ€™Reilly book Spring Data. Using the book as a companion to the samples is quite helpful to understanding the samples and the full feature set of what can be done using Spring technologies and Hadoop.

The main web site for Spring for Apache Hadoop

More Repositories

1

spring-mvc-showcase

Demonstrates the features of the Spring MVC web framework
Java
4,994
star
2

spring-security-oauth

Support for adding OAuth1(a) and OAuth2 features (consumer and provider) for Spring web applications.
Java
4,683
star
3

sagan

The spring.io site and reference application
HTML
3,127
star
4

spring-native

Spring Native is now superseded by Spring Boot 3 official native support
Java
2,738
star
5

spring-data-book

Spring Data - The Definitive Guide - Modern Data Access for Enterprise Java Developers
Java
1,379
star
6

greenhouse

Reference web application for Spring technologies and social destination for Spring developers.
Java
1,320
star
7

spring-android-samples

Spring for Android Sample Applications
Java
761
star
8

spring-cloud-gcp

Integration for Google Cloud Platform APIs with Spring
Java
704
star
9

spring-android

Support for Spring's RestTemplate within native Android applications
Java
704
star
10

spring-roo

Spring Roo is a next-generation rapid application development tool for Java developers. It focuses on higher productivity, stock-standard Java APIs, high usability, avoiding engineering trade-offs and facilitating easy Roo removal.
Java
695
star
11

spring-hadoop

Spring for Apache Hadoop is a framework for application developers to take advantage of the features of both Hadoop and Spring.
Java
624
star
12

spring-social

Allows you to connect your applications with SaaS providers such as Facebook and Twitter.
Java
615
star
13

spring-cloud-aws

All development has moved to https://github.com/awspring/spring-cloud-aws Integration for Amazon Web Services APIs with Spring
Java
586
star
14

spring-social-samples

Samples of using Spring Social
Java
532
star
15

spring-cloud-security

Security concerns for distributed applications implemented in Spring
Java
523
star
16

spring-xd

Spring XD makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration
Java
481
star
17

spring-scala

Scala
462
star
18

rest-shell

Command-line shell for interacting with Spring HATEOAS-compliant REST resources
Java
455
star
19

spring-data-keyvalue-examples

Examples using Spring Data Key Values features
XSLT
434
star
20

spring-security-saml

SAML extension for the Spring Security project
Java
417
star
21

spring-data-solr

Spring Data - Apache Solr integration
Java
385
star
22

reactive-streams-commons

A joint research effort for building highly optimized Reactive-Streams compliant operators.
Java
353
star
23

spring-integration-kafka

Java
325
star
24

authserver

Java
319
star
25

spring-security-oauth2-boot

Provides spring-security-oauth2 & Boot 2 integration (i.e. autoconfig)
Java
316
star
26

spring-ide

Spring Development Environment for Eclipse
Java
304
star
27

eclipse-integration-gradle

Gradle Tooling for Eclipse
Java
300
star
28

spring-batch-admin

Spring Batch Admin: runtime application and utilities for running Jobs with Spring Batch
Java
271
star
29

spring-social-facebook

Facebook API binding and connect support.
Java
244
star
30

sso

Java
238
star
31

spring-cloud-pipelines

[DEPRECATED] Codebase containing Concourse and Jenkins opinionated pipelines. Moved to https://github.com/CloudPipelines/
Shell
235
star
32

aws-maven

Java
215
star
33

platform

The lean and modular platform for modern applications
Groovy
215
star
34

sample-zuul-filters

Samples of custom Zuul 1 filters for use in Spring Cloud Netflix
Java
209
star
35

spring-integration-java-dsl

Java
193
star
36

top-spring-boot-docker

Spring Boot Docker:: Topical guide to using Docker and how to create container images for Spring Boot applications :: spring-boot
182
star
37

spring-mobile

Extensions to Spring MVC for developing mobile web applications.
Java
181
star
38

spring-xd-samples

Sample starter applications and code for use with the Spring XD project
Java
180
star
39

spring-security-javaconfig

Spring Security Java Configuration Support (to be merged with spring-security-config)
Java
176
star
40

spring-cloud-cluster

This project is now superseded by code in Spring Integration.
Java
155
star
41

head-first-reactive-with-spring-and-reactor

Java
153
star
42

grails-data-mapping

Grails Data Mapping Project
151
star
43

spring-data-document-examples

Examples using Spring Data Document features
Java
148
star
44

spring-cloud-etcd

Java
144
star
45

spring-mobile-samples

Spring Mobile Sample Applications
JavaScript
144
star
46

Spring-Integration-in-Action

Source code to accompany the book
Java
134
star
47

aws-refapp

Refernce app for spring-cloud-aws
Java
132
star
48

spring-social-twitter

Twitter API binding and connect support.
Java
120
star
49

toolsuite-distribution

the distribution build for the Spring Tool Suite and the Groovy/Grails Tool Suite
Shell
109
star
50

spring-sync

Enables efficient communication and data synchronization between clients and Spring server applications.
Java
107
star
51

springbox-cloud

Spring Cloud Reference Application
Java
107
star
52

understanding

105
star
53

zero-downtime-deployment

Code backing up the article about zero downtime deployment
Java
101
star
54

hystrix-dashboard

Java
99
star
55

spring-cloud-stream-app-starters

Starters for Spring Cloud Stream Apps
Java
93
star
56

reactor-samples

Sample code of how to do simple things in Reactor
Java
92
star
57

tensorflow

Java
91
star
58

spring-data-jdbc-ext

Spring Data JDBC Extensions. Support for database specific extensions to standard JDBC including support for Oracle RAC fast connection failover, AQ JMS support and support for using advanced data types.
Java
88
star
59

spring-social-github

Github API binding and connect support.
Java
87
star
60

reactor-spring

Reactor 2.0 Spring Components
Java
87
star
61

spring-data-rest-webmvc

Spring Data REST Exporter starter web application
Java
86
star
62

spring-boot-r2dbc

Experimental Spring Boot support for R2DBC
83
star
63

spring-init

Java
82
star
64

reactor-ipc

Crossing IO boundaries on the JVM with Reactive Streams
CSS
78
star
65

spring-framework-issues

User-contributed projects reproducing issues logged against Spring Framework GitHub issues. Note: this is not the Spring Framework issue tracker -->
Java
78
star
66

spring-cloud-loadbalancer

Exploratory repo for a load balancer implementation. Now part of spring-cloud-commons
Java
74
star
67

spring-social-linkedin

LinkedIn API binding and connect support.
Java
72
star
68

spring-test-htmlunit

Provides integration with Spring Test MVC and HtmlUnit
Java
71
star
69

html5expense

Expense reporting reference app demonstrating HTML5 and cross-platform mobile
JavaScript
71
star
70

scripts

Shell
68
star
71

spring-integration-dsl-scala

Spring Integration Scala DSL
Scala
67
star
72

gs-routing-and-filtering

Routing and Filtering :: Learn how to route and filter requests to a microservice using Netflix Zuul
Java
67
star
73

spring-cloud-dataflow-server-kubernetes

Spring Cloud Data Flow Implementation for Kubernetes
XSLT
65
star
74

spring-data-graph

Provides support to increase developer productivity in Java when using a graph database like Neo4j. Uses familiar Spring concepts such as a template classes for core API usage and provides an annotation based programming model using AspectJ.
Java
65
star
75

spring-gemfire-examples

Sample projects to get started with Spring Gemfire
Java
64
star
76

fortune-teller

Yet another great Spring Cloud sample app...
Java
60
star
77

zuul-server

Java
60
star
78

reactor-core-dotnet

Fluent reactive programming library for C# on top of Reactive-Streams, mirroring the Reactor-Core for JVM
C#
58
star
79

spring-flex

Spring BlazeDS Integration
Java
57
star
80

spring-data-solr-examples

Spring Data Solr - Examples
Java
57
star
81

spring-cloud-config-server-mongodb

Java
57
star
82

spring-integration-dsl-groovy

Groovy DSL for Spring Integration
Groovy
56
star
83

messaging-application

Sample application used for the presentation showing different test types for an event driven application
Java
56
star
84

spring-insight-plugins

Public Repository of Plugins for Spring Insight
Java
55
star
85

propdeps-plugin

New "provided" and "optiona;
Groovy
52
star
86

reactor-scala-extensions

A scala extension for Project Reactor's Flux and Mono
Scala
52
star
87

cdc-debezium

Change Data Capture (CDC) source that captures and streams change events from various databases. Leverages on Debezium and supports MySQL, PostgreSQL, MongoDB, Oracle and SQL Server databases.
Java
52
star
88

reactor-core-js

The Reactive-Streams based implementation of Reactor-Core in Javascript
JavaScript
51
star
89

spring-python

This project has moved to https://github.com/springpython/springpython. This repo is an archived fork and will not see more updates.
Python
49
star
90

spring-data-graph-examples

Examples using Spring Data Graph features
Java
49
star
91

spring-cloud-rsocket

This repository is now inactive. Please see https://github.com/rsocket-routing/
Java
49
star
92

flight627

prototype work towards cloud-based developer tooling
JavaScript
48
star
93

greenhouse-android

Greenhouse native Android client
Java
48
star
94

spring-tenancy

Spring Tenancy
Java
47
star
95

cloudpipelines-scripts

https://cloud.spring.io/cloudpipelines-scripts/
Shell
45
star
96

spring-security-saml-dsl

Spring security okta dsl.
Java
43
star
97

spring-hadoop-samples-old

Sample Applications for getting started with Spring for Apache Hadoop
Java
43
star
98

reactor-tools

A set of tools to improve Project Reactor's debugging and development experience.
Java
43
star
99

spring-cloud-stream-modules

Spring Boot based enterprise integration applications that provide integration with external systems
Java
42
star
100

spring-net-rest

Simplifies communication with HTTP servers, and enforces RESTful principles. It handles HTTP connections, leaving application code to provide URLs (with possible template variables) and extract results.
C#
42
star