• Stars
    star
    278
  • Rank 148,100 (Top 3 %)
  • Language
  • License
    Apache License 2.0
  • Created over 9 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Kerberos and Hadoop: The Madness beyond the Gate

Hadoop and Kerberos: The Madness beyond the Gate

The most merciful thing in the world, I think, is the inability of the human mind to correlate all its contents. We live on a placid island of ignorance in the midst of black seas of infinity, and it was not meant that we should voyage far. The sciences, each straining in its own direction, have hitherto harmed us little; but some day the piecing together of dissociated knowledge will open up such terrifying vistas of reality, and of our frightful position therein, that we shall either go mad from the revelation or flee from the light into the peace and safety of a new dark age.

The Call of Cthulhu, HP Lovecraft, 1926.

This manuscript discusses low-level issues related to Apache™ Hadoop® and Kerberos

Disclaimer

Just as the infamous Necronomicon is a collection of notes scrawled in blood as a warning to others, this book is

  1. Incomplete.
  2. Based on experience and superstition, rather than understanding and insight.
  3. Contains information that will drive the reader insane.

Reading this book implies recognition of these facts and that the reader, their estate and their heirs accept all risk and liability. The author is not responsible if anything happens to their Apache Hadoop cluster, including all the data stored in HDFS disappearing into an unknown dimension, or the YARN scheduler starting to summon pre-human deities.

You have been warned

Implementation notes.

  1. This is a work in progress book designed to built using the gitbook tool chain.

  2. It is hosted on github. Pull requests are welcome.

  3. All the content is Apache licensed.

  4. This is not a formal support channel for Hadoop + Kerberos problems. If you have a support contract with Cloudera then issues related to Kerberos may eventually reach the author. Otherwise: try

  5. The author is very much not a Kerberos expert, so (a) he can be wrong and (b) asking hard questions about it will generally get a "I have no idea whatsoever" answer.

More Repositories

1

winutils

Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)
Shell
2,499
star
2

cloudstore

Hadoop utility jar for troubleshooting integration with cloud object stores
Java
33
star
3

formality

Formal Methods, Maths and papers
TeX
23
star
4

zero-rename-committer

Paper: A Zero-rename committer for object stores
TeX
20
star
5

kdiag

standalone kdiag "kerberos diagnostics for Hadoop", for use on Hadoop 2.6+
Java
9
star
6

grumpy

Groovy Map Reduce Library
Groovy
8
star
7

speculate

Exploring speculation side-channel attacks in Java
Java
7
star
8

spark-cloud-examples

some examples of spark-cloud integration. Superceded by https://github.com/hortonworks-spark/cloud-integration
Scala
6
star
9

engineering-proposals

Hadoop/software engineering thoughts and proposals
5
star
10

cloudup

High performance upload of data to cloud storage via Hadoop FS clients
Java
5
star
11

validate-hadoop-client-artifacts

build/validate hadoop RCs. moved into apache hadoop itself.
Java
4
star
12

clusterconfigs

This is just a set of cluster configurations and scripts to share across machine
Shell
3
star
13

spark-timeline-integration

SPARK-1537 standalone: timeline server integration
Scala
2
star
14

languages

Play with random languages of the Past of Software
Standard ML
2
star
15

distributed-testing

Notes and perhaps a paper on distributed system testing
2
star
16

dissident

Dissident: ruby based twitter dissident bot
Ruby
2
star
17

whirr

Fork of Apache whirr with branches for patches and new features
Java
2
star
18

hadoop-mapreduce

Hadoop MapReduce with some patches
Java
2
star
19

steveloughran.github.io

1
star
20

datasets

datasets of things. Licence: Creative Commons 2.0. Use with Accreditation
1
star
21

renderize

demo YARN app to render things
Java
1
star
22

s3guard-spark

Integrate the Hadoop s3guard committer with Apache Spark
1
star