mirror of https://github.com/searxng/searxng.git synced 2024-05-09 23:22:39 +00:00

Markus Heiser fd814aac86 [mod] isolation of botdetection from the limiter

This patch was inspired by the discussion around PR-2882 [2].  The goals of this
patch are:

1. Convert plugin searx.plugin.limiter to normal code [1]
2. isolation of botdetection from the limiter [2]
3. searx/{tools => botdetection}/config.py and drop searx.tools
4. in URL /config, 'limiter.enabled' is true only if the limiter is really
   enabled (Redis is available).

This patch moves all the code that belongs to botdetection into namespace
searx.botdetection and code that belongs to limiter is placed in namespace
searx.limiter.

Tthe limiter used to be a plugin at some point botdetection was added, it was
not a plugin.  The modularization of these two components was long overdue.
With the clear modularization, the documentation could then also be organized
according to the architecture.

[1] https://github.com/searxng/searxng/pull/2882
[2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891

To test:

- check the app works without the limiter, check `/config`
- check the app works with the limiter and with the token, check `/config`
- make docs.live .. and read
  - http://0.0.0.0:8000/admin/searx.limiter.html
  - http://0.0.0.0:8000/src/searx.botdetection.html#botdetection

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>

2023-11-01 06:44:56 +01:00

938 B

Raw Permalink Blame History

Bot Detection

searx.botdetection

IP lists

searx.botdetection.ip_lists

Rate limit

searx.botdetection.ip_limit

searx.botdetection.link_token

Probe HTTP headers

searx.botdetection.http_accept

searx.botdetection.http_accept_encoding

searx.botdetection.http_accept_language

searx.botdetection.http_connection

searx.botdetection.http_user_agent

Config

searx.botdetection.config

938 B Raw Permalink Blame History