• Stars
    star
    207
  • Rank 189,769 (Top 4 %)
  • Language
    Java
  • License
    GNU Lesser Genera...
  • Created about 13 years ago
  • Updated over 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Hadoop library to read packet capture (PCAP) files

Hadoop PCAP library

License

This library is distributed under the LGPL.
See: https://raw.github.com/RIPE-NCC/hadoop-pcap/master/LICENSE

Repository

UPDATE: Since Bintray has been discontinued, the latest releases of hadoop-pcap are not available there, and you have to build them from source.

<repositories>
  <repository>
    <id>hadoop-pcap</id>
    <url>http://dl.bintray.com/hadoop-pcap/hadoop-pcap</url>
  </repository>
</repositories>

Screencast

We have created a screencast showing the use of the Hadoop PCAP SerDe in Hive using Amazon Elastic MapReduce.
You can find the video on YouTube: http://www.youtube.com/watch?v=FLxeQciax-Q

Components

This project consists of two components:

Library

Bundles the code used to read PCAPs. Can be used within MapReduce jobs to natively read PCAP files.
See: https://github.com/RIPE-NCC/hadoop-pcap/tree/master/hadoop-pcap-lib

SerDe

Implements a Hive Serializer/Deserializer (SerDe) to query PCAPs using SQL like commands.
See: https://github.com/RIPE-NCC/hadoop-pcap/tree/master/hadoop-pcap-serde

More Repositories

1

whois

RIPE Database whois code repository
Java
368
star
2

ripe-atlas-software-probe

Shell
239
star
3

ripe-atlas-tools

Official command-line client for RIPE Atlas
Python
181
star
4

ripe-atlas-cousteau

Python client for RIPE ATLAS API
Python
64
star
5

rpki-validator

Scala
64
star
6

rpki-validator-3

RIPE NCC RPKI Validator 3
Java
62
star
7

bgpdump

Utility and C Library for parsing MRT files
C
58
star
8

tracemon

TraceMON is a web application for visualising network topology generated by traceroutes reaching one or more targets in a network
JavaScript
55
star
9

ripe-atlas-sagan

A parsing library for RIPE Atlas measurement results
Python
47
star
10

ripe-atlas-probe-measurements

RIPE Atlas probe measurement source code
C
40
star
11

dnsmon

The RIPE NCC DNS Monitoring Service (DNSMON) provides a comprehensive, objective and up-to-date overview of the quality of the service offered by high-level Domain Name System (DNS) servers.
JavaScript
29
star
12

ripestat-text

Python
26
star
13

ripe-atlas-probe-doc

18
star
14

ipv6-security-lab

HTML
18
star
15

ipresource

Java
16
star
16

rpki-commons

Java
15
star
17

dnssec-labs

Shell
13
star
18

ripe-atlas-bigquery

JavaScript
13
star
19

atlas-dyndns

Dynamic DNS for RIPE Atlas
Python
11
star
20

peertools

Python
10
star
21

ipv6-workshop-tools

Python
9
star
22

rpki-core

RPKI back-end in RIPE NCC
Java
9
star
23

rpki-publication-server

Scala
8
star
24

bgp-security-lab

BGP Security network lab
HTML
8
star
25

rcdss

RIPE NCC CDS Scanner
Python
6
star
26

nro-delegated-stats

Scala
5
star
27

ripe-database-documentation

RIPE Database Documentation
4
star
28

nro-stats

NRO Stats
Java
3
star
29

rpki-irr-bgp-stats

Scala
3
star
30

rsyncit

RRDP -> rsync sync tool
Java
3
star
31

rpki-ta-0

Java
2
star
32

ris-docs

https://ris.ripe.net/docs/
2
star
33

rpki-validator-3-docker

Simple docker set-up for the RIPE NCC RPKI Validator 3 for use with docker hub
Dockerfile
1
star