matteoredaelli/ebot

Stars
326
Rank 129,027 (Top 3 %)
Language
Erlang
License
GNU General Publi...
Created over 14 years ago
Updated over 13 years ago

matteoredaelli/ebot

matteoredaelli

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Ebot, an Opensource Web Crawler built on top of a nosql database (apache couchdb, riak), AMQP database (rabbitmq), webmachine and mochiweb. Ebot is written in Erlang and it is a very scalable, distribuited and highly configurable web cawler. See wiki pages for more details

EBOT (http://www.redaelli.org/matteo-blog/projects/ebot/)
USAGE: see the wiki homepage (http://wiki.github.com/matteoredaelli/ebot/) and ebot_test.erl for details
LICENSE: GPL v3+, see file LICENSE
Copyright (c) 2010, 2011 - Matteo Redaelli at libero dot it

Tested with Linux (Ubuntu and Debian) and Erlang R13B03 and R14A

*******************************************************************************
* DOWNLOAD "TAG" releases and not the latest sources that could be unstable...
*******************************************************************************

pyspark-examples

pyspark sample scripts

twitterBot

A simple Twitter bot written in Elixir

predictoR

A forecasting tool for time series, Long Term Prediction.

twitter-r-utils

Twitter R utils

botkit-starter-web-rasa-nlu

botkit starter template using the web interface and rasa-nlu middleware

docker-mongodb-rpi

Docker image for Mongodb on Raspberry PI

qsense

Qsense is a python library and command line tool for QlikSense

ewg

Erlang Wordlist Generator

proloGraph

A demo for a REST server developed in prolog

ltp

Time series forecasting - log term predictions over timeseries

ragno

Simple web domains crawler written in erlang

r-istat

Some example R scripts for istat data

dump_tweets.R

dump_tweets.R is a tool for searching tweets and crawl (recursively) users from twitter. Data are then saved to a MySQL database and can finally be exported to .RData files

msad

msad is a python library and commandline for ActiveDirectory

apache-camel-blueprint-samples

node-express-rest-oracle-docker

sample of sharing (oracle) database tables via rest api using node.js, express in a docker container

dump_tweets.py

Incremental Dumper (to DB) of tweets from Twitters

oreste

Automatically exported from code.google.com/p/oreste

strategico

Automatically exported from code.google.com/p/strategico

BOTeo

etsdb

TimeSeries database

cryptoBot

extractTweets

extracting Tweets from Hadoop HDFS using Apache Scala

mdm.py

A generic and flexible Master Data Management tool written in Python

apollo-datasource-qliksense

Apollo datasource for Qliksense

talendcloud

steampipe-plugin-talend

steampipe-plugin-talend

twitteRutils

Useful functions on twitter data (timelines, search, people,..)

scrapy_web

Scrapy spiders for the web

qlik-cloud-devops-terraform-opentofu

Qlik Cloud devops with OpenTofu or Terraform

TwitterPopularTags

TwitterPopularTags: the famous example of Spark Streaming in a standalone project

talendcloud-go

Talend cloud API wrapper

extractTweets.py

apollo-datasource-ldap

LDAP datasource for apollo graphql server

tfbot

bot with tensorflow ML

aws_ext

dmcommunity-challenges

My solutions for challenges from https://dmcommunity.org/challenge/