• Stars
    star
    162
  • Rank 232,284 (Top 5 %)
  • Language
    Python
  • License
    The Unlicense
  • Created about 11 years ago
  • Updated over 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

reStructuredText linter

restructuredtext-lint

Build Status

reStructuredText linter

This was created out of frustration with PyPI; it sucks finding out your reST is invalid after uploading it. It is being developed in junction with a Sublime Text linter.

Getting Started

Install the module with: pip install restructuredtext_lint

import restructuredtext_lint
errors = restructuredtext_lint.lint("""
Hello World
=======
""")

# `errors` will be list of system messages
# [<system_message: <paragraph...><literal_block...>>]
errors[0].message  # Title underline too short.

CLI Utility

For your convenience, we present a CLI utility rst-lint (also available as restructuredtext-lint).

$ rst-lint --help
usage: rst-lint [-h] [--version] [--format {text,json}] [--encoding ENCODING]
                [--level {debug,info,warning,error,severe}]
                [--rst-prolog RST_PROLOG]
                path [path ...]

Lint reStructuredText files. Returns 0 if all files pass linting, 1 for an
internal error, and 2 if linting failed.

positional arguments:
  path                  File/folder to lint

optional arguments:
  -h, --help            show this help message and exit
  --version             show program's version number and exit
  --format {text,json}  Format of the output (default: "text")
  --encoding ENCODING   Encoding of the input file (e.g. "utf-8")
  --level {debug,info,warning,error,severe}
                        Minimum error level to report (default: "warning")
  --rst-prolog RST_PROLOG
                        reStructuredText content to prepend to all files
                        (useful for substitutions)

$ rst-lint README.rst
WARNING README.rst:2 Title underline too short.

Other tools

restructuredtext-lint is also integrated in other tools. A list can be found and updated in our wiki

https://github.com/twolfson/restructuredtext-lint/wiki/Integration-in-other-tools

PyPI issues

While a document may lint cleanly locally, there can be issues when submitted it to PyPI. Here are some common problems:

  • Usage of non-builtin lexers (e.g. bibtex) will pass locally but not be recognized/parsable on PyPI
    • This is due to PyPI not having a non-builtin lexer installed
    • Please avoid non-builtin lexers to avoid complications
    • For more information, see #27
  • Relative hyperlinks will not work (e.g. ./UNLICENSE)
    • According to Stack Overflow, hyperlinks must use a scheme (e.g. http, https) and that scheme must be whitelisted
    • Please use absolute hyperlinks (e.g. https://github.com/twolfson/restructuredtext-lint/blob/master/UNLICENSE)

Documentation

restructuredtext-lint exposes a lint and lint_file function

restructuredtext_lint.lint(content, filepath=None, rst_prolog=None)

Lint reStructuredText and return errors

  • content String - reStructuredText to be linted
  • filepath String - Optional path to file, this will be returned as the source
  • rst_prolog String - Optional content to prepend to content, line numbers will be offset to ignore this

Returns:

  • errors List - List of errors
    • Each error is a class from docutils with the following attrs
      • line Integer|None - Line where the error occurred
        • On rare occasions, this will be None (e.g. anonymous link mismatch)
      • source String - filepath provided in parameters
      • level Integer - Level of the warning
        • Levels represent 'info': 1, 'warning': 2, 'error': 3, 'severe': 4
      • type String - Noun describing the error level
        • Levels can be 'INFO', 'WARNING', 'ERROR', or 'SEVERE'
      • message String - Error message
      • full_message String - Error message and source lines where the error occurred
    • It should be noted that level, type, message, and full_message are custom attrs added onto the original system_message

restructuredtext_lint.lint_file(filepath, encoding=None, *args, **kwargs)

Lint a reStructuredText file and return errors

Returns: Same structure as restructuredtext_lint.lint

Extension

Under the hood, we leverage docutils for parsing reStructuredText documents. docutils supports adding new directives and roles via register_directive and register_role.

Sphinx

Unfortunately due to customizations in Sphinx's parser we cannot include all of its directives/roles (see #29). However, we can include some of them as one-offs. Here is an example of adding a directive from Sphinx.

https://github.com/sphinx-doc/sphinx/blob/1.3/sphinx/directives/code.py

sphinx.rst

Hello
=====
World

.. highlight:: python

    Hello World!

sphinx.py

# Load in our dependencies
from docutils.parsers.rst.directives import register_directive
from sphinx.directives.code import Highlight
import restructuredtext_lint

# Load our new directive
register_directive('highlight', Highlight)

# Lint our README
errors = restructuredtext_lint.lint_file('docs/sphinx/README.rst')
print errors[0].message # Error in "highlight" directive: no content permitted.

Examples

Here is an example of all invalid properties

rst = """
Some content.

Hello World
=======
Some more content!
"""
errors = restructuredtext_lint.lint(rst, 'myfile.py')
errors[0].line  # 5
errors[0].source  # myfile.py
errors[0].level  # 2
errors[0].type  # WARNING
errors[0].message  # Title underline too short.
errors[0].full_message  # Title underline too short.
                        #
                        # Hello World
                        # =======

Contributing

In lieu of a formal styleguide, take care to maintain the existing coding style. Add unit tests for any new or changed functionality. Test via nosetests.

Donating

Support this project and others by twolfson via donations.

http://twolfson.com/support-me

Unlicense

As of Nov 22 2013, Todd Wolfson has released this repository and its contents to the public domain.

It has been released under the UNLICENSE.

More Repositories

1

grunt-spritesmith

Grunt task for converting a set of images into a spritesheet and corresponding CSS variables
JavaScript
1,136
star
2

sexy-bash-prompt

Bash prompt with colors, git statuses, and git branches.
Shell
1,116
star
3

gulp.spritesmith

Convert a set of images into a spritesheet and CSS variables via gulp
JavaScript
1,080
star
4

spritesmith

Utility that takes sprites and converts them into a stylesheet and its coordinates
JavaScript
898
star
5

google-music-electron

Desktop app for Google Music on top of Electron
JavaScript
265
star
6

layout

Organize and layout items based on various algorithms
JavaScript
112
star
7

spritesheet-templates

Convert spritesheet data into CSS or CSS pre-processor data
JavaScript
106
star
8

sublime-hooks

Run Sublime commands on common event hooks (e.g. on_new, on_post_save).
Python
96
star
9

grunt-zip

Zip and unzip files via a grunt plugin
JavaScript
89
star
10

File-Watcher

Watch multiple files for changes
JavaScript
88
star
11

gif-encoder

Streaming GIF encoder
JavaScript
82
star
12

grunt-curl

Download files from the internet via grunt.
JavaScript
73
star
13

FindPlusPlus

Find code quickly in Sublime Text.
Python
62
star
14

sublime-files

An extracted backup of Sublime Text's files
Python
60
star
15

karma-electron

Karma launcher and preprocessor for Electron
JavaScript
59
star
16

google-music.js

Browser-side JS library for controlling Google Music
JavaScript
47
star
17

iframe2image

Convert an iframe to an image
JavaScript
47
star
18

grunt-jsmin-sourcemap

Grunt task for JSMin with sourcemap
JavaScript
44
star
19

foundry

Release manager for npm, bower, component, PyPI, git tags, and any command you want
JavaScript
41
star
20

computedStyle

Cross-browser currentStyle/getComputedStyle implementation
JavaScript
40
star
21

css-validator

Validate CSS via W3C's service
JavaScript
40
star
22

grunt-fontsmith

**DEPRECATED** Grunt plugin for composing SVGs into multiple fonts, a character mapping, and CSS variables
JavaScript
38
star
23

jojo

the 10 second blog-engine for hackers (in javascript)
JavaScript
36
star
24

twolfson.com-scripts

Scripts used for bootstrapping and deploying services for twolfson.com and its subdomains
Ruby
32
star
25

reverse-mustache

Reverse templating library for mustache, generating variables from a template's output
JavaScript
30
star
26

gifsockets

Stream never-ending animated GIFs
JavaScript
28
star
27

line-height

Calculate line-height of an HTML element (IE6 compatible)
JavaScript
27
star
28

commander-completion

Shell completion for commander.js
JavaScript
26
star
29

bookmarks

Webpage representing a collection of bookmarks
JavaScript
26
star
30

pixelsmith

Node based engine for `spritesmith` built of top of `get-pixels` and `save-pixels`.
JavaScript
23
star
31

sublime-plugin-tests

Testing framework for Sublime Text plugins
Python
22
star
32

source-map-index-generator

Generate source-maps from index mappings.
JavaScript
21
star
33

icomoon-phantomjs

**DEPRECATED** IcoMoon driver written in PhantomJS
JavaScript
20
star
34

sublime-edit-command-palette

Add/edit commands for your Command Palette
Python
19
star
35

css-controls

Cross-browser stylesheet creation and css rule creation/deletion (includes IE6 support)
JavaScript
18
star
36

dotfiles

A collection of my dotfiles (e.g. `.config`, `.bashrc`)
Shell
15
star
37

vagrant-lime

Vagrantfile for limetext/lime
14
star
38

grunt-html-prettyprinter

Grunt task that beautifies your HTML
JavaScript
13
star
39

twolfson.com

Repository for twolfson.com
JavaScript
13
star
40

function-to-string

Extract parameters and body of a function into strings
JavaScript
12
star
41

sublime-request

Make HTTP requests from Sublime Text
Python
11
star
42

ecma-variable-scope

AST utility to collect scope info for variables
JavaScript
11
star
43

nine-track

Record and playback HTTP requests
JavaScript
10
star
44

node-jsmin-sourcemap

JSMin with sourcemaps!
JavaScript
10
star
45

firefox-bookmarks

Extract information from your Firefox bookmarks
JavaScript
10
star
46

gmsmith

GM engine for spritesmith
JavaScript
10
star
47

record-a-cast

Select and record a portion of your desktop
JavaScript
9
star
48

shenzhen-io-solutions

@twolfson's solutions for Shenzhen I/O
9
star
49

katex-screenshot

Convert KaTeX to images via screenshots
JavaScript
9
star
50

google-music-webkit

Google Music desktop client via nw.js
JavaScript
9
star
51

completion

Completion library for CLI commands
JavaScript
9
star
52

fontsmith

**DEPRECATED** Collect SVGs into multiple fonts and a character code mapping
JavaScript
9
star
53

victorious-git

Play fanfare after triumphing over git conflicts
Shell
8
star
54

paypal-github-button

GitHub styled button for PayPal
JavaScript
8
star
55

spritesmith-engine-test

Common test suite for spritesmith engines
JavaScript
7
star
56

pinboard.js

Library for talking to the Pinboard API
JavaScript
7
star
57

cli-presentation

Give presentations from your terminal
JavaScript
7
star
58

esformatter-var-each

Esformatter plugin that converts comma `var` statements into separate `var` statements
JavaScript
6
star
59

esformatter-phonetic

Esformatter plugin that renames variables and functions to pronounceable names
JavaScript
6
star
60

git-sqwish

Squash commits without repetitive conflicts
Shell
6
star
61

listen-spawn

Run commands in your terminal via HTTP.
JavaScript
6
star
62

Style-Tile-SVG

Style tile template in SVG format
6
star
63

sublime-info

Gather information about Sublime Text
Python
5
star
64

develop-faster-presentation

Presentation on removing the tedium from creating, developing, and publishing repos.
JavaScript
5
star
65

whatsizeismybrowser

Determine the dimensions of your browser
JavaScript
5
star
66

canvassmith

node-canvas engine for spritesmith
JavaScript
5
star
67

json2fontcss

Converter from JSON to font variables for CSS
JavaScript
5
star
68

vagrant-nodebugme

Vagrant for `nodebugme`
Shell
4
star
69

grunt-install-init

Install a grunt init template
JavaScript
4
star
70

pngsmith

png engine for spritesmith
JavaScript
4
star
71

Facebook-Scraper

Javascript project to scrape friend data from Facebook's mobile site
JavaScript
4
star
72

spritesmith-engine-spec

Specification for spritesmith engines
Shell
4
star
73

phantomjssmith

PhantomJS engine for spritesmith
JavaScript
4
star
74

winfiles

Dotfiles variant for Windows
Shell
4
star
75

sublime-snippet-destroyer

Destroy all Sublime Text completions and snippets
Python
4
star
76

Resource-Collector

Collect the urls of all relative resources from a webpage and return them to a callback.
JavaScript
4
star
77

fix-travis-ci

Repair annoying repetitive issues with Travis CI
Shell
4
star
78

sublime-plugin-tests-base

Base layer for testing and assertion frameworks against Sublime Text
Python
3
star
79

Mason.js

HTML power tool that generates robust UI elements near-transparently
JavaScript
3
star
80

single-child

Spawn a single child process which kills itself on restart.
JavaScript
3
star
81

json-content-demux

Break up JSON from content in a JSON-first file
JavaScript
3
star
82

phantomjsify

Browserify transform to fallback node.js basics in PhantomJS
JavaScript
3
star
83

kaleidoscope

View multiple pages at the same time
JavaScript
3
star
84

controlpad

WindowPad functionality for Linux.
JavaScript
3
star
85

CSS-Off--2011-

Website created for the 2011 CSS Off by Unmatched Style
JavaScript
3
star
86

grunt-init-init

Create a grunt template from any grunt template
JavaScript
3
star
87

vagrant-gitlist

Plug and play Vagrantfile for GitList
3
star
88

arduino-playground

Playground environment for one-offs as I learn Arduino and electronics in general
C++
2
star
89

multi-image-mergetool

Resolve multiple image conflicts at the same time
JavaScript
2
star
90

sublime-installer

Shell script to install Sublime Text 2 and 3
Shell
2
star
91

object-fusion2

Another way to combine outline and content into an object.
JavaScript
2
star
92

sublime-js-var-shortcuts

Insert and delete shortcuts for JavaScript variables in Sublime Text
Python
2
star
93

gifsockets-middleware

Set of HTTP middlewares for gifsockets
JavaScript
2
star
94

ecma-scopes

Listing of block and lexical scope names for ECMAScript AST
JavaScript
2
star
95

foundry-release-git

git release library for foundry
JavaScript
2
star
96

trunkata

Truncation utility which preserves HTML content and can truncate by lines.
JavaScript
2
star
97

IndexedDB-Editor

Indexed DB Editor for MDN Dev Derby December 2011
2
star
98

lantern-wall

Documentation for a glowing lantern wall
C++
2
star
99

phantomjs-pixel-server

PhantomJS server that converts canvas actions into pixels
JavaScript
2
star
100

fs-memory-store

Filesystem store with in-memory cache
JavaScript
2
star