sappho192/Tokenizers.DotNet sappho192/Tokenizers.DotNet

  • Stars
    star
    4
  • Rank 3,286,807 (Top 66 %)
  • Language
    C#
  • License
    MIT License
  • Created 3 months ago
  • Updated 26 days ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
sappho192/Tokenizers.DotNet
github

sappho192

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

[Unofficial] Simple .NET wrapper of HuggingFace Tokenizers library

More Repositories

1

ffxiv-ja-ko-translator

Japanese→Korean translator model specialized in Final Fantasy XIV based on BERT-Japanese & KoGPT2. (FFXIV translator)
C#
8
star
2

IronworksTranslator

Final Fantasy XIV live chat translator as WPF app
C#
7
star
3

BMSParser

Parsing BMS format which is for non-commercial rhythm game.
C++
3
star
4

EDMTranslator

.NET Text translator library based on LLM models, especially EncoderDecoderModel in HuggingFace
C#
2
star
5

BertJapaneseTokenizer

Minimal Tokenizer implementation of BertJapanese(cl-tohoku/bert-base-japanese) in C#
C#
2
star
6

AmaurotTranslator

Lightweight GUI Ja↔Ko translator
C#
2
star
7

OpenALExample-dotnet

Example code of OpenAL on dotnet core 3.1
C#
1
star
8

WatchDogDotNet

Kills orphan child processes when target parent process is gone
C#
1
star
9

dotnet-crawler-example

Webpage crawler example based on PuppeteerSharp and WPF.
C#
1
star
10

latex-exercise

LaTeX exercise with Github Action build system
TeX
1
star
11

ICENoticeBot

ASP.Net Core based Telegram bot that provides notice info in Inha ICE homepage (ice.inha.ac.kr)
C#
1
star
12

maestro-midi-parser

MAESTRO dataset parser written in C#
C#
1
star
13

aihub-translation-dataset

Code to merge some datasets in AIHub into single dataset
Python
1
star
14

HunterRecon

HTML
1
star
15

a-pile-of-idea

Archive of my random thoughts and ideas on programming, thesis, etc
1
star