cerndb/2qpgconf2017

Stars
1
Language
Created about 7 years ago
Updated about 7 years ago

cerndb/2qpgconf2017

cerndb

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

CERN DB On Demand 2Q PGConf 2017 slides

dist-keras

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

spark-dashboard

Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

SparkPlugins

Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.

hdfs-metadata

Tool for gathering blocks and replicas meta data from HDFS. It also builds a heat map showing how replicas are distributed along disks and nodes.

SparkDLTrigger

Code and links to the data for the article "Machine Learning Pipelines with Modern Big DataTools for High Energy Physics"

Jupyter Notebook

grafana-mimir-cardinality-dashboards

Grafana Mimir dashboards used for cardinality exploration

Hadoop-Profiler

Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.

sparkMeasure

This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics.

SparkTraining

Material for the course "Introduction to Apache Spark APIs for Data Processing" https://sparktraining.web.cern.ch/

Jupyter Notebook

cern-sso-python

Python Re-implementation of the cern-get-sso-cookie functionality

flume-ng-audit-db

Apache Flume JDBC source, drop duplicated events interceptor, utility to infer Avro schema from table and much more!

linux-firewall-tool

Linux iptables automation tool. It manages the firewall on CERN 's DB Servers.

tf-spawner

TF-Spawner is an experimental tool for running TensorFlow distributed training on Kubernetes clusters.

wls-cern-sso

Oracle Weblogic CERN SSO integration packages

storage-api

Unified RESTful interface for managing CERNs data storage back-ends

zkpolicy

Zookeeper Policy Audit Tool (aka zkPolicy) for checking and enforcing ACLs on ZNodes.

SparkExecutorPlugins2.4

Spark Executor Plugins Examples for Spark 2.4

hadoop-xrootd

Mirror of CERN db/hadoop-xrootd. Hadoop-XRootD Filesystem Connector

hadoop-metrics-http-sink

Hadoop Metrics 2 plugin to push metrics to a HTTP end point (e.g. Elastic, Flume).

dbod-core

DB On Demand management infrastructure core library

dbod-web

Future DB On Demand Web Interface implementation

dbod-api

DB On Demand API

CERN-Hadoop-tutorials-ML-with-Apache-Spark

Tutorial materials for Analytics with Apache Spark and MLlib at CERN. https://indico.cern.ch/event/546003/

hloader

dbod-infra

dbod-webapp

netapp-api-python

A re-implementation of (parts of) NetApp's ZAPI in idiomatic Python using Requests

wls-cli

Weblogic CLI tool

elastalert

nile-webapp

Nile Service Web Interface

tomcat-sso-integration-components

Set of valves classes that helps CERN applications with the integration in the CERN Authentication

oracle-weblogic-1221-domain-ords-autodeploy

Oracle WebLogic docker image with ORDS deployed

coding-standards

Miscelenaeous coding standards or support files to use in IT-DB projects

hadoop-tutorials

Repository for hadoop tutorials code and guides

NotebooksExamples

This repository contains Jupyter notebook examples, intended to be linked with the SWAN Gallery

Jupyter Notebook

cern-openlab-oracle-hackzurich-2018

CERN openlab Oracle HackZurich 2018 collaboration