Discover lintool/MapReduceAlgorithms Open Source project

Scalable Topic Modeling using Variational Inference in MapReduce

161

Mr.LDA

Reference implementations of data-intensive algorithms in MapReduce and Spark

149

bespin

A Hadoop toolkit for web-scale information retrieval research

Ivory

CS 451/651 431/631 Data-Intensive Distribute Computing (Winter 2018) at the University of Waterloo

bigdata-2018w

Scrapes citation statistics from Google Scholar

bigcows

Course homepages for courses that I've taught at the University of Maryland

UMD-courses

Open-Source Information Retrieval Reproducibility Challenge

IR-Reproducibility

Shell

my-data-is-bigger-than-your-data

My data is bigger than your data!

Spark Tutorial at the University of Maryland

SparkTutorial

bigdata-2016w

CS 489/698 Big Data Infrastructure (Winter 2016) at the University of Waterloo

A Java Wikipedia markup to plain text converter

wikiclean

Hadoop tools for manipulating ClueWeb collections

clueweb

Internet Archive "Save a Page" Plug-In for Chrome

chrome-archive-this-page

CS 451/651 Data-Intensive Distribute Computing (Fall 2018) at the University of Waterloo

bigdata-2018f

Lintools: tools by @lintool

tools

The Art and Science of Empirical Computer Science (Fall 2022)

art-science-empirical-cs-2022f

bigdata-2017w

CS 489/698 Big Data Infrastructure (Winter 2017) at the University of Waterloo

Tweet Analysis with Spark

TweetAnalysisWithSpark

Scala

robust04-analysis

Meta-Analysis of Robust04 Papers (Yang et al., SIGIR 2019)

A proof-of-concept in-browser JavaScript-based search engine

JScene

Anytime Ranking for Impact-Ordered Indexes

JASS

GrimmerSenatePressReleases

Grimmer's Senate Press Releases

Converting the Enron email collection to mbox format

Enron2mbox

Source code for: Nima Asadi, Jimmy Lin, and Arjen P. de Vries. Runtime Optimizations for Tree-Based Machine Learning Models. IEEE Transactions on Knowledge and Data Engineering, 26(9):2281-2292, 2014.

OptTrees

non-blind-review

My proposal for non-blind reviewing at *ACL

art-science-empirical-cs-2023f

The Art and Science of Empirical Computer Science (Fall 2023)

IR-Reproducibility2

The Replicability of IR Replicability Experiments

Shell

UROC-projects

Undergraduate Research Opportunities Conference sponsored by the University of Waterloo

ClueWeb09-TREC-LTR

learning-to-rank dataset extracted from ClueWeb09 using TREC judgments

Cassovary-vs-GraphJet

Performance comparison between Cassovary and GraphJet

bespin-data

Datasets for Bespin

Maven repo for some Anserini dependencies.

Tweets2013-stats

robust04-analysis-papers

AnseriniMaven

nyt-covid-map

Implementations of brute force scans for document retrieval in C

c-bfscan

MSMARCO-Document-Ranking-Archive.test

CSS

GiraphTutorial

Giraph Tutorial

MSMARCO-Document-Ranking-Archive

Real-time indexer and search engine

Zambezi

chrome-archive-this-page-crx

Packaged CRX distribution for Internet Archive "Save a Page" Plug-In

NSF-projects

NSF project homepages

CSS

bfscan

Document retrieval using brute force scans

Collection of tools for working with Wikipedia

wiki-tools

msmarco-docker

Dockerfile

tools-javadoc

Experimental runs from the Open-Source Information Retrieval Reproducibility Challenge.

hadoop1-data

IR-Reproducibility-exp

MAXScript

TweetTap

Simple program to tap the Twitter sample stream

Google Scholar Search Extension for Chrome

chrome-scholar-search-extension

Visualization of TREC Microblog Track relevance judgments

trec-mb-vis

Webgraph for ClueWeb09 Category B

clueweb09en01-webgraph

cs-big-cows

List of people with great achievements in Computer Science