• Stars
    star
    734
  • Rank 59,323 (Top 2 %)
  • Language
    Go
  • License
    BSD 3-Clause "New...
  • Created over 9 years ago
  • Updated 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

[mirror] Go text processing support

Go Text

Go Reference

This repository holds supplementary Go libraries for text processing, many involving Unicode.

CLDR Versioning

It is important that the Unicode version used in x/text matches the one used by your Go compiler. The x/text repository supports multiple versions of Unicode and will match the version of Unicode to that of the Go compiler. At the moment this is supported for Go compilers from version 1.7.

Download/Install

The easiest way to install is to run go get -u golang.org/x/text. You can also manually git clone the repository to $GOPATH/src/golang.org/x/text.

Contribute

To submit changes to this repository, see http://golang.org/doc/contribute.html.

To generate the tables in this repository (except for the encoding tables), run go generate from this directory. By default tables are generated for the Unicode version in core and the CLDR version defined in golang.org/x/text/unicode/cldr.

Running go generate will as a side effect create a DATA subdirectory in this directory, which holds all files that are used as a source for generating the tables. This directory will also serve as a cache.

Testing

Run

go test ./...

from this directory to run all tests. Add the "-tags icu" flag to also run ICU conformance tests (if available). This requires that you have the correct ICU version installed on your system.

TODO:

  • updating unversioned source files.

Generating Tables

To generate the tables in this repository (except for the encoding tables), run go generate from this directory. By default tables are generated for the Unicode version in core and the CLDR version defined in golang.org/x/text/unicode/cldr.

Running go generate will as a side effect create a DATA subdirectory in this directory which holds all files that are used as a source for generating the tables. This directory will also serve as a cache.

Versions

To update a Unicode version run

UNICODE_VERSION=x.x.x go generate

where x.x.x must correspond to a directory in https://www.unicode.org/Public/. If this version is newer than the version in core it will also update the relevant packages there. The idna package in x/net will always be updated.

To update a CLDR version run

CLDR_VERSION=version go generate

where version must correspond to a directory in https://www.unicode.org/Public/cldr/.

Note that the code gets adapted over time to changes in the data and that backwards compatibility is not maintained. So updating to a different version may not work.

The files in DATA/{iana|icu|w3|whatwg} are currently not versioned.

Report Issues / Send Patches

This repository uses Gerrit for code changes. To learn how to submit changes to this repository, see https://golang.org/doc/contribute.html.

The main issue tracker for the image repository is located at https://github.com/golang/go/issues. Prefix your issue with "x/text:" in the subject line, so it is easy to find.

More Repositories

1

go

The Go programming language
Go
118,032
star
2

dep

Go dependency management tool experiment (deprecated)
Go
12,894
star
3

groupcache

groupcache is a caching and cache-filling library, intended as a replacement for memcached in many cases.
Go
12,622
star
4

protobuf

Go support for Google's protocol buffers
Go
9,463
star
5

mock

GoMock is a mocking framework for the Go programming language.
Go
9,199
star
6

tools

[mirror] Go Tools
Go
7,145
star
7

mobile

[mirror] Go on Mobile
Go
5,619
star
8

oauth2

Go OAuth2
Go
5,070
star
9

lint

[mirror] This is a linter for Go source code. (deprecated)
Go
3,978
star
10

vscode-go

Go extension for Visual Studio Code
TypeScript
3,673
star
11

glog

Leveled execution logs for Go
Go
3,498
star
12

proposal

Go Project Design Documents
Go
3,263
star
13

crypto

[mirror] Go supplementary cryptography libraries
Go
2,900
star
14

net

[mirror] Go supplementary network libraries
Go
2,781
star
15

example

Go example projects
Go
2,429
star
16

geo

S2 geometry library in Go
Go
1,622
star
17

tour

[mirror] A Tour of Go
Go
1,524
star
18

vgo

[mirror] Versioned Go Prototype
Go
1,523
star
19

snappy

The Snappy compression format in the Go programming language.
Go
1,463
star
20

sys

[mirror] Go packages for low-level interaction with the operating system
Go
1,229
star
21

leveldb

The LevelDB key-value database in the Go programming language.
Go
1,135
star
22

gddo

Go Doc Dot Org
Go
1,107
star
23

pkgsite

[mirror] Home of the pkg.go.dev website
Go
1,101
star
24

sync

[mirror] concurrency primitives
Go
830
star
25

gofrontend

Go compiler frontend (gccgo)
Go
823
star
26

exp

[mirror] Experimental and deprecated packages
Go
821
star
27

freetype

The Freetype font rasterizer in the Go programming language.
Go
758
star
28

playground

[mirror] The Go Playground
Go
714
star
29

talks

Go talks
696
star
30

appengine

Go App Engine packages
Go
661
star
31

build

[mirror] Go's continuous build and release infrastructure (no stability promises)
Go
603
star
32

vulndb

[mirror] The Go Vulnerability Database
Go
535
star
33

image

[mirror] Go supplementary image libraries
Go
515
star
34

blog

[mirror] Go Blog (obsolete)
390
star
35

time

[mirror] Go supplementary time packages
Go
380
star
36

perf

[mirror] Performance measurement, storage, and analysis.
Go
363
star
37

website

[mirror] Home of the go.dev and golang.org websites
HTML
345
star
38

sublime-build

The official Sublime Text package for Go build system integration.
Python
341
star
39

vuln

[mirror] the database client and tools for the Go vulnerability database
Go
333
star
40

xerrors

Go
274
star
41

term

Go terminal and console support
Go
260
star
42

debug

[mirror] debugging tools
Go
225
star
43

mod

[mirror] Go module mechanics libraries
Go
183
star
44

dl

[mirror] go install golang.org/dl/go1.N@latest
Go
180
star
45

benchmarks

Benchmarks for the perf dashboard
Go
162
star
46

review

[mirror] Tool for working with Gerrit code reviews
Go
143
star
47

arch

[mirror] architecture code
Go
143
star
48

cwg

Community outreach Working Group
131
star
49

sublime-config

A library for Go environment configuration in Sublime Text
Python
84
star
50

govulncheck-action

[mirror] GitHub action for govulncheck
76
star
51

winstrap

Bootstrapping tools for windows builders
Go
48
star
52

scratch

[mirror] repository used for testing
Go
27
star
53

telemetry

[mirror] Go Telemetry services and libraries
Go
25
star
54

pkgsite-metrics

Code to serve pkg.go.dev/metrics [mirror]
Go
11
star
55

wiki

[mirror] Go Wiki
6
star
56

go-get-issue-15410

go-get-issue-15410
Go
3
star
57

.github

1
star
58

.allstar

1
star