lonePatient/TorchBlocks

Stars
151
Rank 246,057 (Top 5 %)
Language
Python
License
MIT License
Created over 4 years ago
Updated over 1 year ago

lonePatient/TorchBlocks

lonePatient

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

A PyTorch-based toolkit for natural language processing

TorchBlocks

(Work in Progress!!)

A PyTorch-based toolkit for natural language processing

Requirements

torch>=1.10.0
tokenizers >= 0.7.0
transformers>=4.10.0
torchmetrics>=0.11.3

TorchBlocks requires Python 3.7+. We recommend installing TorchBlocks in a Linux or OSX environment.

Installation

Recommended (because of active development):

git clone https://github.com/lonePatient/TorchBlocks.git
cd TorchBlocks
python setup.py install

⚠️Note: This project is still in the development stage and some of the interfaces are subject to change.

Tutorials

Tutorial 1 (text classification): task_text_classification_cola.py
Tutorial 2 (siamese similarity): task_siamese_similarity_afqmc.py
Tutorial 3 (sequence labeling): task_sequence_labeling_ner_crf.py
Tutorial 4 (sentence similarity): task_sentence_similarity_lcqmc.py
Tutorial 5 (triple similarity): task_triple_similarity_epidemic.py
Tutorial 6 (sequence labeling): task_sequence_labeling_resume_beam_search_softmax.py
Tutorual 7 (sequence labeling): task_sequence_labeling_resume_global_pointer.py
Example scripts for each task: TorchBlocks/examples/

awesome-pretrained-chinese-nlp-models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

Bert-Multi-Label-Text-Classification

This repo contains a PyTorch implementation of a pretrained BERT model for multi-label text classification.

albert_pytorch

A Lite Bert For Self-Supervised Learning Language Representations

NeZha_Chinese_PyTorch

NEZHA: Neural Contextualized Representation for Chinese Language Understanding

lookahead_pytorch

pytorch implement of Lookahead Optimizer

daguan_2019_rank9

datagrand 2019 information extraction competition rank9

BiLSTM-CRF-NER-PyTorch

This repo contains a PyTorch implementation of a BiLSTM-CRF model for named entity recognition task.

Deep_Learning_For_Computer_Vision_With_Python

Deep Learning For Computer Vision With Python

BERT-chinese-text-classification-pytorch

This repo contains a PyTorch implementation of a pretrained BERT model for text classification.

electra_pytorch

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

CLUE_pytorch

CLUE baseline pytorch CLUE的pytorch版本基线

MobileBert_PyTorch

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

BERT-Attribute-Value-Extract

A Pytorch implementation of "Scaling Up Open Tagging from Tens to Thousands: Comprehension Empowered Attribute Value Extraction from Product Title" (ACL 2019).

multi-sample_dropout_pytorch

a simple pytorch implement of Multi-Sample Dropout

BERT-SDA

A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"

ERNIE-text-classification-pytorch

This repo contains a PyTorch implementation of a pretrained ERNIE model for text classification.

chinese-word2vec-pytorch

word2vec implementation for skip-gram in pytorch

bert-sentence-similarity-pytorch

This repo contains a PyTorch implementation of a pretrained BERT model for sentence similarity task.

label_smoothing_pytorch

pytorch implement of Label Smoothing

EvoNorms_PyTorch

Evolving Normalization-Activation Layers

NovoGrad-pytorch

pytorch implement of NovoGrad Optimizer

cw2vec-pytorch

cw2vec implementation in pytorch

train-bert-pytorch

knowledge-driven-dialogue-lic2019-rank5

2019语言与智能技术竞赛第5名方案

2021-GAIIC-Track1-idea

全球人工智能技术创新大赛【赛道一】

pytorch_fashionMNIST_practice

使用pytorch进行图像训练的模板

keras_learning

Jupyter Notebook

Contextual-Chinese-Strokes-Embeddings

Implementation of the language model for Contextual chinese strokes Embeddings with PyTorch

lonePatient.github.io

kaggle-camera-model-identification

IEEE's Signal Processing Society - Camera Model Identification

tensorflow-eager-examples

Examples of Eager Execution in tensorflow

char-cnn-text-classification

This repo contains a PyTorch implementation of a char-level CNN model for text classification.