searxng/docs/dev/reST.rst

reST primer

KISS and readability

Instead of defining more and more roles, we at searx encourage our contributors to follow principles like KISS and readability.

We at searx are using reStructuredText (aka reST) markup for all kind of documentation, with the builders from the Sphinx project a HTML output is generated and deployed at github.io <.>.

The sources of Searx's documentation are located at docs. Run make docs-live <make docs-live> to build HTML while editing.

---

Contents

Sphinx and reST have their place in the python ecosystem. Over that reST is used in popular projects, e.g the Linux kernel documentation [kernel doc].

Content matters

The readability of the reST sources has its value, therefore we recommend to make sparse usage of reST markup / .. content matters!

reST is a plaintext markup language, its markup is mostly intuitive and you will not need to learn much to produce well formed articles with. I use the word mostly: like everything in live, reST has its advantages and disadvantages, some markups feel a bit grumpy (especially if you are used to other plaintext markups).

Soft skills

Before going any deeper into the markup let's face on some soft skills a trained author brings with, to reach a well feedback from readers:

• Documentation is dedicated to an audience and answers questions from the audience point of view.
• Don't detail things which are general knowledge from the audience point of view.
• Limit the subject, use cross links for any further reading.

To be more concrete what a point of view means. In the (docs) folder we have three sections (and the blog folder), each dedicate to a different group of audience.

Further reading

• Sphinx-Primer
• Sphinx markup constructs
• reST, docutils, docutils FAQ
• Sphinx, sphinx-doc FAQ
• sphinx config, doctree
• sphinx cross references
• intersphinx
• Sphinx's autodoc
• Sphinx's Python domain, Sphinx's C domain

User's POV: docs/user

A typical user knows about search engines and might have heard about meta crawlers and privacy.

Admin's POV: docs/admin

A typical Admin knows about setting up services on a linux system, but he does not know all the pros and cons of a searx setup.

Developer's POV: docs/dev

Depending on the readability of code, a typical developer is able to read and understand source code. Describe what a item aims to do (e.g. a function), describe chronological order matters, describe it. Name the out-of-limits condition and all the side effects a external developer will not know.

Basic inline markup

*italics* -- italics

one asterisk for emphasis

**boldface** -- boldface

two asterisks for strong emphasis and

foo() -- foo()

backquotes for code samples and literals.

\*foo is a pointer -- *foo is a pointer

If asterisks or backquotes appear in running text and could be confused with inline markup delimiters, they have to be escaped with a backslash (\*foo is a pointer).

Roles

A custom interpreted text role (ref <roles>) is an inline piece of explicit markup. It signifies that that the enclosed text should be interpreted in a specific way. The general syntax is :rolename:`content`.

Docutils supports the following roles:

• emphasis -- equivalent of *emphasis*
• strong -- equivalent of **strong**
• literal -- equivalent of literal
• subscript -- subscript text
• superscript -- superscript text
• title-reference -- for titles of books, periodicals, and other materials

Refer to Sphinx Roles for roles added by Sphinx.

Anchors & Links

Anchors

To refer a point in the documentation a anchor is needed. The reST template <reST template> shows an example where a chapter titled "Chapters" gets an anchor named chapter title. Another example from this document, where the anchor named reST anchor:

.. _reST anchor:

Anchors
-------

To refer a point in the documentation a anchor is needed ...

To refer anchors use the ref role markup:

Visit chapter :ref:`reST anchor`.
Or set hyperlink text manualy :ref:`foo bar <reST anchor>`.

:ref: role

Visist chapter reST anchor Or set hyperlink text manualy foo bar <reST anchor>.

link ordinary URL

If you need to reference external URLs use named hyperlinks to maintain readability of reST sources. Here is a example taken from this article:

.. _Sphinx Field Lists:
   https://www.sphinx-doc.org/en/master/usage/restructuredtext/field-lists.html

With the *named* hyperlink `Sphinx Field Lists`_, the raw text is much more
readable.

And this shows the alternative (less readable) hyperlink markup `Sphinx Field
Lists
<https://www.sphinx-doc.org/en/master/usage/restructuredtext/field-lists.html>`__.

Named hyperlink

With the named hyperlink Sphinx Field Lists, the raw text is much more readable.

And this shows the alternative (less readable) hyperlink markup Sphinx Field Lists.

smart references

With the power of sphinx.ext.extlinks and intersphinx referencing external content becomes smart. To refer ...

sphinx.ext.extlinks:

project's wiki article

Searx-instances

to docs public URL

dev/reST.html

files & folders from origin

docs/dev/reST.rst

a pull request

1756

a patch

af2cae6

a PyPi package

searx

a manual page man

bash

:project's wiki article:          :wiki:`Searx-instances`
:to docs public URL:              :docs:`dev/reST.html`
:files & folders from origin:     :origin:`docs/dev/reST.rst`
:a pull request:                  :pull:`1756`
:a patch:                         :patch:`af2cae6`
:a PyPi package:                  :pypi:`searx`
:a manual page man:               :man:`bash`

intersphinx:

external anchor

python:and

external doc anchor

jinja:templates

python code object

:pydatetime.datetime

flask code object

webapp is a :pyflask.Flask app

:external anchor:                 :ref:`python:and`
:external doc anchor:             :doc:`jinja:templates`
:python code object:              :py:obj:`datetime.datetime`
:flask code object:               webapp is a :py:obj:`flask.Flask` app

Intersphinx is configured in docs/conf.py:

intersphinx_mapping = {
    "python": ("https://docs.python.org/3/", None),
    "flask": ("https://flask.palletsprojects.com/", None),
"jinja": ("https://jinja.palletsprojects.com/", None),
}

To list all anchors of the inventory (e.g. python) use:

$ python -m sphinx.ext.intersphinx https://docs.python.org/3/objects.inv

Basic article structure

The basic structure of an article makes use of heading adornments to markup chapter, sections and subsections.

1. = with overline for document title
2. = for chapters
3. - for sections
4. ~ for subsections

reST template

.. _document title:

==============
Document title
==============

Lorem ipsum dolor sit amet, consectetur adipisici elit ..
Further read :ref:`chapter title`.

.. _chapter title:

Chapters
========

Ut enim ad minim veniam, quis nostrud exercitation ullamco
laboris nisi ut aliquid ex ea commodi consequat ...

Section
-------

lorem ..

Subsection
~~~~~~~~~~

lorem ..

List markups

Bullet list

List markup (ref <bullet-lists>) is simple:

- This is a bulleted list.

  1. Nested lists are possible, but be aware that they must be separated from
     the parent list items by blank line
  2. Second item of nested list

- It has two items, the second
  item uses two lines.

#. This is a numbered list.
#. It has two items too.

bullet list

• This is a bulleted list.
  1. Nested lists are possible, but be aware that they must be separated from the parent list items by blank line
  2. Second item of nested list
• It has two items, the second item uses two lines.

1. This is a numbered list.
2. It has two items too.

Definition list

definition term

Note that the term cannot have more than one line of text.

Definition lists (ref <definition-lists>) are created as follows:

term (up to a line of text)
   Definition of the term, which must be indented

   and can even consist of multiple paragraphs

next term
   Description.

definition list

term (up to a line of text)

Definition of the term, which must be indented

and can even consist of multiple paragraphs

next term

Description.

Quoted paragraphs

Quoted paragraphs (ref <block-quotes>) are created by just indenting them more than the surrounding paragraphs. Line blocks (ref <line-blocks>) are a way of preserving line breaks:

normal paragraph ...
lorem ipsum.

   Quoted paragraph ...
   lorem ipsum.

| These lines are
| broken exactly like in
| the source file.

Quoted paragraph and line block

normal paragraph ... lorem ipsum.

Quoted paragraph ... lorem ipsum.

These lines are
broken exactly like in
the source file.

Field Lists

bibliographic fields

First lines fields are bibliographic fields, see Sphinx Field Lists.

Field lists are used as part of an extension syntax, such as options for directives, or database-like records meant for further processing. Field lists are mappings from field names to field bodies. They marked up like this:

:fieldname: Field content
:foo:       first paragraph in field foo

        second paragraph in field foo

:bar:       Field content

Field List

fieldname

Field content

foo

first paragraph in field foo

second paragraph in field foo

bar

Field content

They are commonly used in Python documentation:

def my_function(my_arg, my_other_arg):
    """A function just for me.

    :param my_arg: The first of my arguments.
    :param my_other_arg: The second of my arguments.

    :returns: A message (just for me, of course).
    """

Further list blocks

• field lists (ref <field-lists>, with caveats noted in reST field list)
• option lists (ref <option-lists>)
• quoted literal blocks (ref <quoted-literal-blocks>)
• doctest blocks (ref <doctest-blocks>)