Explore @cerndb Open Source projects

CERN Database Group (@cerndb)

cerndb

Stars
1,060
Global Org. Rank 14,436 (Top 5 %)
Registered almost 12 years ago
Most used languages

Python
30.3 %

Java
27.3 %

Jupyter Notebook
9.1 %

Shell
6.1 %

Scala
6.1 %

Perl
6.1 %

TypeScript
6.1 %

TeX
3.0 %

Dockerfile
3.0 %

PLSQL 3.0 %
Location 🇨🇭 Switzerland
Country Total Rank 380
Country Ranking

Dockerfile
10

PLSQL 11

Scala
44

Perl
62

Python
96

Java
139

Jupyter Notebook
182

Shell
213

TeX
214

TypeScript
570

dist-keras

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

spark-dashboard

Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

SparkPlugins

Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.

hdfs-metadata

Tool for gathering blocks and replicas meta data from HDFS. It also builds a heat map showing how replicas are distributed along disks and nodes.

SparkDLTrigger

Code and links to the data for the article "Machine Learning Pipelines with Modern Big DataTools for High Energy Physics"

Jupyter Notebook

Hadoop-Profiler

Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.

grafana-mimir-cardinality-dashboards

Grafana Mimir dashboards used for cardinality exploration

sparkMeasure

This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics.

cern-sso-python

Python Re-implementation of the cern-get-sso-cookie functionality

SparkTraining

Material for the course "Introduction to Apache Spark APIs for Data Processing" https://sparktraining.web.cern.ch/

Jupyter Notebook

flume-ng-audit-db

Apache Flume JDBC source, drop duplicated events interceptor, utility to infer Avro schema from table and much more!

linux-firewall-tool

Linux iptables automation tool. It manages the firewall on CERN 's DB Servers.

tf-spawner

TF-Spawner is an experimental tool for running TensorFlow distributed training on Kubernetes clusters.

wls-cern-sso

Oracle Weblogic CERN SSO integration packages

storage-api

Unified RESTful interface for managing CERNs data storage back-ends

zkpolicy

Zookeeper Policy Audit Tool (aka zkPolicy) for checking and enforcing ACLs on ZNodes.

SparkExecutorPlugins2.4

Spark Executor Plugins Examples for Spark 2.4

hadoop-xrootd

Mirror of CERN db/hadoop-xrootd. Hadoop-XRootD Filesystem Connector

hadoop-metrics-http-sink

Hadoop Metrics 2 plugin to push metrics to a HTTP end point (e.g. Elastic, Flume).

dbod-core

DB On Demand management infrastructure core library

dbod-web

Future DB On Demand Web Interface implementation

dbod-api

DB On Demand API

CERN-Hadoop-tutorials-ML-with-Apache-Spark

Tutorial materials for Analytics with Apache Spark and MLlib at CERN. https://indico.cern.ch/event/546003/

hloader

dbod-infra

dbod-webapp

netapp-api-python

A re-implementation of (parts of) NetApp's ZAPI in idiomatic Python using Requests

wls-cli

Weblogic CLI tool

elastalert

nile-webapp

Nile Service Web Interface

tomcat-sso-integration-components

Set of valves classes that helps CERN applications with the integration in the CERN Authentication

oracle-weblogic-1221-domain-ords-autodeploy

Oracle WebLogic docker image with ORDS deployed

coding-standards

Miscelenaeous coding standards or support files to use in IT-DB projects

hadoop-tutorials

Repository for hadoop tutorials code and guides

NotebooksExamples

This repository contains Jupyter notebook examples, intended to be linked with the SWAN Gallery

Jupyter Notebook

cern-openlab-oracle-hackzurich-2018

CERN openlab Oracle HackZurich 2018 collaboration

2qpgconf2017

CERN DB On Demand 2Q PGConf 2017 slides