dqbd/tiktokenizer dqbd/tiktokenizer

  • Stars
    star
    581
  • Rank 74,410 (Top 2 %)
  • Language
    TypeScript
  • License
    MIT License
  • Created about 1 year ago
  • Updated 14 days ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
dqbd/tiktokenizer
github

dqbd

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Online playground for OpenAPI tokenizers

Tiktokenizer

Tiktokenizer

Online playground for openai/tiktoken, calculating the correct number of tokens for a given prompt.

Special thanks to Diagram for sponsorship and guidance.

CleanShot.2023-03-02.at.22.58.11.mp4

Acknowledgments

More Repositories

1

bakalari-js

Bakaláři API v JavaScriptu
JavaScript
10
star
2

ts-math-evaluate

Type-level math expression evaluator for TypeScript.
TeX
10
star
3

nwpos

OSS EET pokladna
Java
3
star
4

cctv

NVR server for home surveillance
TypeScript
3
star
5

yakkovid

JavaScript
2
star
6

bakalari-crawler

Crawler for IS Bakalaři
PHP
2
star
7

earthview

Sets a random satellite image from Earth View with Google as a wallpaper.
JavaScript
2
star
8

bakalari-desktop

PC klient pro Bakaláři
JavaScript
1
star
9

music-matching

Audio fingerprinting and search
Jupyter Notebook
1
star
10

WigymAndroid

Neoficiální aplikace pro Wichterlovo gymnázium
Java
1
star
11

cuda-btree

Implementation of B-Trees on NVIDIA CUDA
Jupyter Notebook
1
star
12

anthropic-vercel-edge

JavaScript
1
star