Explore @paracrawl Open Source projects

ParaCrawl (@paracrawl)

paracrawl

Stars
100
Global Org. Rank 57,955 (Top 19 %)
Registered over 7 years ago
Most used languages

Python
26.7 %

Shell
13.3 %

C++
13.3 %

Go
13.3 %

PHP
6.7 %

Java
6.7 %

Perl
6.7 %

Rich Text Format 6.7 %

SCSS 6.7 %

extractor

corset

Corset is a web-based data selection portal that helps you getting relevant data from massive amounts of parallel data.

keops

Tool for manual evaluation of parallel sentences.

cirrus-scripts

Scripts for running bitextor/paracrawl/europat jobs on cirrus.ac.uk

synthesis

Data synthesis by contextualizing glossary translations

human-evaluations

Results of the human evaluation

Rich Text Format

europat-scripts

Scripts for obtaining patent data

tmxutil

Tools to generate & filter Europat tmx files.

embedding

Mine parallel corpora with embeddings

giashard

Sharding program for Paracrawl

opus-train

Automate download and training with OPUS corpora

Domain_Adaptation

InDomain detection is a tool designed to extract in-domain data from a large collections of data.

targeted-crawling

b64filter

Program for operating on one document per Base 64 encoded line files

giawarc

Processing utilities for Internet Archive