Regex Persian Language

Regex for Persian (Farsi) Characters

عبارت منظم برای حروف فارسی

Collection of Regex for validating, filtering, sanitizing and finding Persian strings

Introduction

Because of historical matters, many Arabic characters get a way into Persian language and transformed it, In these years many efforts have been made by governmental and non-governmental organizations to revivification of authority of Persian language and this is one of them (really?!).

✴️ Notes

• Persian alphabet consists of 33 characters (including hamzah) and 3 vowel marks.

• The important part of this effort, is codepoints range, so you can create your own regex for validating, filtering and finding strings, just put the desired range in it. for example when string should only contains persian words and spaces just concat space codepoints and persian alpha codepoints in the final Regex and so on.

• Characters in table are sorted by codepoints

• Don't put Regex in multiline because space will be included.

• See tests after reading.

🔲 Codepoints Range

🔳 Space

This ranges include all kind of space, specially ZERO WIDTH NON-JOINER that use as half space and massively are using in Persian texts and NARROW NO-BREAK SPACE that is simmilar to previous character.

Keyabord shortcuts

ZERO WIDTH NON-JOINER

• Shift + B in Persian keyboard layout in Linux
• Ctrl + Shift + 2 in Persian keyboard layout in Windows

NARROW NO-BREAK SPACE

• Shift + Space in Persian keyboard layout in Linux

🔸 Allowed characters

U+0020
U+2000-U+200F
U+2028-U+202F

🔸 Implemention

# python
space_codepoints ='\u0020\u2000-\u200F\u2028-\u202F'

// php
$space_codepoints = '\x{0020}\x{2000}-\x{200F}\x{2028}-\x{202F}';

// javascript
var space_codepoints ='\u0020\u2000-\u200F\u2028-\u202F';

🔳 Persian alphabet

🔸 Allowed characters

U+0621-U+0628
U+062A-U+063A
U+0641-U+0642
U+0644-U+0648
U+064E-U+0651
U+0655
U+067E
U+0686
U+0698
U+06A9-U+06AF
U+06BE
U+06CC

🔸 Implemention

# python
persian_alpha_codepoints = '\u0621-\u0628\u062A-\u063A\u0641-\u0642\u0644-\u0648\u064E-\u0651\u0655\u067E\u0686\u0698\u06A9\u06AF\u06BE\u06CC'

// php
$persian_alpha_codepoints = '\x{0621}-\x{0628}\x{062A}-\x{063A}\x{0641}-\x{0642}\x{0644}-\x{0648}\x{064E}-\x{0651}\x{0655}\x{067E}\x{0686}\x{0698}\x{06A9}\x{06AF}\x{06BE}\x{06CC}';

// javascript
var persian_alpha_codepoints = '\u0621-\u0628\u062A-\u063A\u0641-\u0642\u0644-\u0648\u064E-\u0651\u0655\u067E\u0686\u0698\u06A9\u06AF\u06BE\u06CC';

🔳 Persian numbers

🔸 Allowed characters

U+06F0-U+06F9

🔸 Implemention

# python
persian_num_codepoints = '\u06F0-\u06F9'

// php
$persian_num_codepoints = '\x{06F0}-\x{06F9}';

// javascript
var persian_num_codepoints = '\u06F0-\u06F9';

🔳 Persian(Arabic) punctuation marks

🔸 Allowed characters

U+060C
U+061B
U+061F
U+0640
U+066A
U+066B
U+066C

✴️ for more common punctutation marks like ” | « | » | ?| ; | : | ...
see general punctuation page in unicode

# python
punctuation_marks_codepoints = '\u060C\u061B\u061F\u0640\u066A\u066B\u066C'

// php
$punctuation_marks_codepoints = '\x{060C}\x{061B}\x{061F}\x{0640}\x{066A}\x{066B}\x{066C}';

// javascript
var punctuation_marks_codepoints = '\u060C\u061B\u061F\u0640\u066A\u066B\u066C';

🔳 Most used Arabic characters in Persian texts.

🔸 Allowed characters

U+0629
U+0643
U+0649-U+064B
U+064D
U+06D5

🔸 Implemention

# python
additional_arabic_characters_codepoints = '\u0629\u0643\u0649-\u064B\u064D\u06D5'

// php
$additional_arabic_characters_codepoints ='\x{0629}\x{0643}\x{0649}-\x{064B}\x{064D}\x{06D5}';

// javascript
var additional_arabic_characters_codepoints = '\u0629\u0643\u0649-\u064B\u064D\u06D5';

🔳 Arabic numbers

🔸 Allowed characters

U+0660-U+0669

🔸 Implemention

# python
arabic_numbers_codepoints = '\u0660-\u0669'

// php
$arabic_numbers_codepoints ='\x{0660}-\x{0669}';

// javascript
var arabic_numbers_codepoints = '\u0660-\u0669';

🏁🏁🏁