Markus Heiser
b35ef9789b
[pylint] engines/invidious.py
...
Fix remarks from pylint and remove usless comments
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 15:42:06 +01:00
Markus Heiser
e2ec6b4211
[fix] invidious engine: store random base_url in param
...
Two different threads ( = two different user queries) can call the request
function in a row and then the response function. The namespace will be same
since this is the same engine.
To keep exactly the same value ``base_url`` must be stored in params and then
retrieve using ``resp.search_params["base_url"]``.
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#discussion_r799324861
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 15:42:06 +01:00
Markus Heiser
ae804ddf40
Merge pull request #862 from return42/fix-858
...
[fix] solidtorrents engine - JSON API no longer exists
2022-02-04 14:38:36 +00:00
Markus Heiser
ddc2102a07
[fix] solidtorrents engine: store random bas_url in param
...
Two different threads ( = two different user queries) can call the request
function in a row and then the response function. The namespace will be same
since this is the same engine.
To keep exactly the same value ``base_url`` must be stored in params and then
retrieve using ``resp.search_params["base_url"]``.
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#discussion_r799324861
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:55:21 +01:00
Markus Heiser
d6061b7c8a
[mod] solidtorrents engine: add metadata & torrentfile
...
BTW: define min_len in eval_xpath_list of 'stats' list
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#pullrequestreview-872910744
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:53:42 +01:00
Markus Heiser
f9c4868142
[fix] solidtorrents engine: use get_torrent_size from searx.utils
...
Suggested-by: @dalf https://github.com/searxng/searxng/pull/862#pullrequestreview-872858489
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:53:42 +01:00
Markus Heiser
d92b3d96fd
[fix] solidtorrents engine: JSON API no longer exists
...
The API endpoint, we where using does not exist anymore. This patch is a
rewrite that parses the HTML page.
Related: https://github.com/paulgoio/searxng/issues/17
Closes: https://github.com/searxng/searxng/issues/858
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 14:53:37 +01:00
Markus Heiser
de32d543bc
Merge pull request #863 from searxng/dependabot/pip/master/black-22.1.0
...
Bump black from 21.12b0 to 22.1.0
2022-02-04 08:52:22 +00:00
Markus Heiser
2e5d562da3
Merge pull request #865 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/sharp-0.30.0
...
Bump sharp from 0.29.3 to 0.30.0 in /searx/static/themes/simple
2022-02-04 08:52:04 +00:00
Markus Heiser
964902e779
[fix] issue reported by pylint 22.1.0
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-04 09:45:35 +01:00
searxng-bot
cc99386523
[translations] update from Weblate
...
bf218121ba9e50fd258505badacbf882968e7f6b
2022-02-04 07:14:12 +00:00
dependabot[bot]
6eee2d8771
Bump sharp from 0.29.3 to 0.30.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.29.3 to 0.30.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.29.3...v0.30.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-02-04 07:10:14 +00:00
Alexandre Flament
9fae80facb
Merge pull request #618 from dalf/limiter
...
[enh] limiter plugin
2022-02-02 09:24:34 +01:00
Alexandre Flament
f79b0fce06
[enh] limiter plugin
...
can replace filtron:
* rate limite the number of request per IP and per (IP, User-Agent)
* block some bots
use Redis
data stored in Redis never contains the IP addresses, only HMAC using the secret_key
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-02 09:15:59 +01:00
Markus Heiser
07f7289e23
Merge pull request #849 from return42/fix-787
...
[fix] engines description - currency_convert.py
2022-02-01 07:19:05 +00:00
Markus Heiser
50a56532c4
[pylint] engines/currency_convert.py
...
Fix remarks from pylint
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-02-01 08:02:42 +01:00
Markus Heiser
314ea2dc61
Merge pull request #852 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-02-01 06:52:57 +00:00
Markus Heiser
4d0bd47ff0
Merge pull request #853 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-02-01 06:52:19 +00:00
Markus Heiser
20cbabff96
Merge pull request #851 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-02-01 06:48:54 +00:00
dalf
f4f90aa3a4
Update searx.data - update_firefox_version.py
2022-02-01 06:23:16 +00:00
dalf
7b402e1aa0
Update searx.data - update_ahmia_blacklist.py
2022-02-01 06:23:01 +00:00
dalf
1c47f4b6e0
Update searx.data - update_currencies.py
2022-02-01 06:23:00 +00:00
dalf
e78dc45d1e
Update searx.data - update_wikidata_units.py
2022-02-01 06:22:58 +00:00
Martin Fischer
14338e2c3b
[enh] generate navigation for help pages
2022-02-01 06:29:22 +01:00
Martin Fischer
c53c295573
[enh] make searx.user_help use an explicit TOC
...
When we have multiple help pages we want them
to be displayed in a specific order.
2022-02-01 06:29:22 +01:00
Martin Fischer
0f7bcd17b2
[build] /static
2022-02-01 06:29:19 +01:00
Martin Fischer
5012d06e72
[simple] allow .tabs to be used for help pages
2022-02-01 06:28:26 +01:00
Martin Fischer
fb9eedbf40
[enh] introduce /help route
...
Translation will be implemented in the future.
For now the "en" in /help/en/<pagename> is hardcoded.
2022-02-01 06:28:26 +01:00
Martin Fischer
b93711b45d
[help] remove link from about.md title
...
Now that about.html extends page_with_header.html
it already has a link to the start page and removing
the link makes it easier to extract the page title
from the Markdown for the following commit.
2022-02-01 06:28:26 +01:00
Martin Fischer
08bb3a5f3a
[pyright:basic] searx.user_help
2022-02-01 06:28:26 +01:00
Martin Fischer
e931590312
[build] /static
2022-02-01 06:22:44 +01:00
Martin Fischer
b6200563ba
[simple] improve margin of #linkto_preferences
...
Co-authored-by: Paul Braeuning <paul@paulgo.io>
2022-02-01 06:22:29 +01:00
Markus Heiser
15320b5eec
[fix] engines description - currency_convert.py
...
Currency engine has DuckDuckGo metadata
In the engine selector of the preferences window, the currency search engine has
the same metadata and wikidata url as duckduckgo, I'd assume there should be a
difference of some sort there clarifying what source the currency uses or, if
it's a duckduckgo service, at least clarifying that it's a currency service by
duck duck go.
Closes: https://github.com/searxng/searxng/issues/787
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-31 23:17:28 +01:00
Martin Fischer
743353dd09
[simple] add aria-label to preferences link
2022-01-31 12:00:11 +01:00
Martin Fischer
e7c0f4e877
[simple] link preferences on /about and /stats
...
We want to link the preferences from every page
(except of course the preferences page).
2022-01-31 11:57:24 +01:00
Martin Fischer
c82b9c68d2
Merge pull request #843 from not-my-profile/simple-page-with-header
2022-01-31 11:14:48 +01:00
Markus Heiser
60e7fee47a
Merge pull request #475 from return42/tineye
...
[enh] engine - add Tineye reverse image search
2022-01-31 08:51:35 +01:00
Alexandre Flament
2d5929cc59
[mod] searx.utils: more typing
2022-01-30 22:14:12 +01:00
Alexandre Flament
ebd3013a1a
[mod] tineye engine: minor changes
...
* remove "disable: false" in settings.yml
* use the json() method from httpx.Response (faster character encoding detection)
2022-01-30 20:49:22 +01:00
Léon Tiekötter
a6673a1a94
[fix] 1x engine
...
1x changed the XML result layout.
2022-01-30 19:48:40 +01:00
Martin Fischer
79dbbd4d99
[build] /static
2022-01-30 17:29:21 +01:00
Martin Fischer
6f0ec7e58f
[simple] introduce page_with_header.html template
...
Previously the preferences & stats templates contained the markup:
<a href="{{ url_for('index') }}"><h1><span>SearXNG</span></h1></a>
There are many things wrong with this:
1. the markup was duplicated
2. the CSS needed to be changed whenever a new page wanted to use this
header (since the CSS used page-specific selectors)
3. h1 should be reserved for the actual page title
(e.g. Preferences or Engine stats)
4. the image was set via CSS which also set:
span { visibility: hidden; }
which however removes the alternative text from the accessibility
tree (meaning screen readers will ignore it).
This commit fixes all these problems.
2022-01-30 17:29:21 +01:00
Markus Heiser
a6b879f19c
[mod] tineye engine: set engine_type to 'online_url_search'
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-30 16:30:52 +01:00
Markus Heiser
e92d40c854
[enh] implement a OnlineUrlSearchProcessor
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-30 16:05:08 +01:00
Alexandre Flament
0eacc46ee3
[mod] add documentation about searx.utils
...
This module is a toolbox for the engines.
Is should be documented.
In addition, searx/utils.py is checked by pylint.
2022-01-29 22:49:42 +01:00
Alexandre Flament
068155df88
[build] /static
2022-01-29 14:44:05 +01:00
Alexandre Flament
dc4caa5a39
[fix] simple theme: /preferences: cookies table is LTR
...
close #827
2022-01-29 14:42:12 +01:00
Martin Fischer
6a366c9807
Merge pull request #838 from dalf/remove_deprecated_code
...
[mod] remove deprecate code
2022-01-29 10:13:56 +01:00
Alexandre Flament
f3f61df6a0
[mod] remove deprecate code
...
remove code to support Python 3.5 and Python 3.6
2022-01-29 08:54:12 +01:00
Alexandre Flament
116802852d
[fix] ina engine
...
based on a45408e8e2
2022-01-28 22:33:41 +01:00
Markus Heiser
b7f74fbe42
[mod] tineye - add some documentation
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-28 09:06:44 +01:00
Allen
880555e263
[enh] engine - add Tineye reverse image search
...
Other optional parameter ..
`&sort=crawl_date`
can be appended to search_string to sort results by date.
`&domain=example.org`
can be implemented to search_string to get results from just one domain.
Public instances could get relatively fast timed-out for 3600s.
--
Merged from @allendema's commit [1] and slightly modfied / see [2].
Related-to: [1] 455b2b4460https://github.com/searx/searx/pull/3040
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-28 09:06:44 +01:00
searxng-bot
43a262497b
[translations] update from Weblate
...
80b990723235457738737f21f1658c803172618b5063d26169df6ff651bd2e18f6dea2a9d62301424d07658ce3798ef7bc99fe052811901d
2022-01-28 07:16:43 +00:00
Alexandre Flament
4f82ab36a9
Merge pull request #817 from not-my-profile/pyright-01
...
Pyright 01
2022-01-27 23:18:41 +01:00
Léon Tiekötter
0cbf73a1f4
Allow 'using_tor_proxy' to be set for each engine individually
...
Check 'using_tor_proxy' for each engine individually instead of checking globally
[fix] searx.network: update _rdns test to the last httpx version
Co-authored-by: Alexandre Flament <alex@al-f.net>
2022-01-27 22:37:02 +01:00
Martin Fischer
506169f312
[pyright] remove no longer needed assertion
...
The pyright bug[1] for which the assertion was added has been fixed.
[1]: https://github.com/microsoft/pyright/issues/2930
2022-01-27 22:17:16 +01:00
Martin Fischer
b767752d0c
[pyright:basic] searx.webapp
2022-01-27 22:17:16 +01:00
Martin Fischer
640c404844
[pyright:strict] searx.search.checker.background
2022-01-27 22:07:12 +01:00
Martin Fischer
7f89adc5f3
[pyright:strict] searx.shared.shared_abstract
2022-01-27 22:07:12 +01:00
Paul Braeuning
2c6bd2adf6
Merge pull request #825 from MontyQI/ui-changes
...
Simple theme uppercase buttons
2022-01-26 18:09:11 +01:00
Monty
f59afc8dd2
Uppercase buttons
2022-01-26 16:54:15 +01:00
Markus Heiser
ccffab3a43
Merge pull request #813 from MarcAbonce/change-wolfram-category
...
Move WolframAlpha away from Science category
2022-01-26 14:10:19 +01:00
Markus Heiser
e5f266065c
Merge pull request #824 from dalf/fix-simple-pref-checker
...
[fix] simple theme: don't crash when the checker is enabled
2022-01-25 23:01:31 +01:00
Alexandre Flament
dfb9ca527d
[fix] simple theme: don't crash when the checker is enabled
...
The macro "checkbox" in macros.html uses the macro "icon_small"
from icons.html
The commit imports icon_small in macros.html to fix the issue.
It works because the macros in macros.html are imported with the Jinja2 context.
See https://jinja.palletsprojects.com/en/3.0.x/templates/#import-visibility
close #819
2022-01-25 22:03:21 +01:00
Markus Heiser
10c9b9775d
[mod] improve setup of invidious engine
...
- My experience is, that a timeout of 5 sec is not need, I got fast response
less than a second.
- https://invidious.tube/ redirects to http://ww25.invidious.tube/
- in SearXNG defaults the http protocol is unsafe and raise an error
- https://ww25.invidious.tube has SSL_ERROR_UNSAFE_NEGOTIATION
Related-to: https://github.com/searxng/searxng/issues/821
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-25 19:02:11 +01:00
Alexandre Flament
81453a0eba
Merge pull request #811 from return42/enh-788
...
[mod] configuration to overwrite engine description
2022-01-25 06:55:12 +01:00
Alexandre Flament
576eab04d2
Merge pull request #802 from MontyQI/Icon-update
...
Changed preferences icon to settings icon in gruntfile
2022-01-24 22:05:55 +01:00
Marc Abonce Seguin
1311745f24
move WolframAlpha away from Science category
2022-01-23 23:24:02 -06:00
Markus Heiser
e0b284e427
[mod] configuration to overwrite engine description
...
Engine description can be configured, this is needed e.g. by custom search
engines. Here is an example of a command engine with a description in the about
section::
- name: locate
engine: command
command: ['locate', '{{QUERY}}']
disabled: true
categories: files
about:
description: local files
website: 'https://www.man7.org/linux/man-pages/man1/locate.1.html '
delimiter:
chars: ' '
keys: ['line']
Closes: https://github.com/searxng/searxng/issues/788
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-23 20:55:14 +01:00
Alexandre Flament
61853aa0fb
Merge pull request #799 from return42/brave-complete
...
Add autocompleter from Brave
2022-01-23 19:23:06 +01:00
Markus Heiser
e9588b70a6
[fix] brave autocompleter: charset_normalizer issues
...
Use httpx.Response.json() to avoid charset_normalizer issues:
DEBUG charset_normalizer : override steps (5) and chunk_size (512) as content does not fit (153 byte(s) given) parameters.
INFO charset_normalizer : ascii passed initial chaos probing. Mean measured chaos is 0.000000 %
DEBUG charset_normalizer : ascii should target any language(s) of ['Latin Based']
INFO charset_normalizer : ascii is most likely the one. Stopping the process.
[1] https://www.python-httpx.org/api/#response
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-23 17:22:13 +01:00
Markus Heiser
9c5bac4c43
[pylint] searx/autocomplete.py
...
Fix remarks from pylint, BTW set SPDX-License-Identifier.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-23 09:12:03 +01:00
Martin Fischer
105c5a6a98
[help] stop rendering documentation with Jinja2
...
To facilitate translation of the user documentation we move
the templating logic outside of the user documentation.
2022-01-23 08:01:55 +01:00
Martin Fischer
284ac8bfd8
[help] convert about.html to Markdown
...
To facilitate translation the new user documentation shall be written in
Markdown (which is more human-friendly than HTML and reStructuredText).
2022-01-23 08:01:55 +01:00
Martin Fischer
05149db4c1
[help] render user documentation once on startup
...
Currently we have two kinds of user documentation:
* the about page[1] which is written in HTML and part of the web
application and can therefore link instance-specific pages
(like e.g. the preferences) via Jinja variables
* the Sphinx documentation[2] which is written in reStructuredText
and cannot link instance-specific pages since it doesn't know
which instance the user is using
The plan is to integrate the user documentation currently in Sphinx
into the application, so that it can also link instance specific pages.
We also want to enable the user documentation to be translated.
This commit implements the first step in this endeavor (see #722 ).
[1]: searx/templates/__common__/about.html
[2]: docs/user/ (currently served at https://docs.searxng.org/user/ )
2022-01-23 08:01:55 +01:00
Alexandre Flament
382f4f8fb0
Merge pull request #801 from dalf/fix-checker
...
[fix] checker: fix image fetch
2022-01-22 19:29:29 +01:00
Monty
80530befdc
[build] /static
2022-01-22 17:23:43 +01:00
Monty
91ca5d1613
Changed preferences icon to settings icon in gruntfile
2022-01-22 17:14:19 +01:00
Alexandre Flament
5439dd5fb1
[fix] checker: fix image fetch
...
Since https://github.com/searxng/searxng/pull/354
the searx.network.stream(...) returns a tuple
This commits update the checker code according to
this function signature change.
2022-01-22 16:11:42 +01:00
Alexandre Flament
f01ddd1932
Merge pull request #775 from return42/redis-4.1.1
...
Revert "[hotfix] interim fix to get docker-build of CI without issues"
2022-01-22 15:56:15 +01:00
Allen
b8c98c4c0d
[enh] Add autocompleter from Brave
...
Raw response example: https://search.brave.com/api/suggest?q=how%20to:%20with%20j
Headers are needed in order to get a 200 response, thus Searx user-agent is used.
Other URL param could be '&rich=false' or '&rich=true'.
Cherry-pick: 71786bf9cb
2022-01-21 14:39:10 +01:00
searxng-bot
9b3122a84e
[translations] update from Weblate
...
f3f70b7dc66d23fbc2b9f7f7159ec4168184a23bc4b476d4eaf18ed5e7fec15699368a91a8b23af97af1ba210af5a3eea448183bea4f95cf2f3e7ac9c28ae5a8b664bd3b
2022-01-21 07:16:40 +00:00
Martin Fischer
96a1f79c6d
Merge pull request #773 from not-my-profile/typing
...
More typing
2022-01-18 16:28:32 +01:00
Markus Heiser
1a0760c10a
[fix] googel engine - "some results are invalids: invalid content"
...
Fix google issues listet in the `/stats?engine=google` and message::
some results are invalids: invalid content
The log is::
DEBUG searx : result: invalid content: {'url': 'https://de.wikipedia.org/wiki/Foo ', 'title': 'Foo - Wikipedia', 'content': None, 'engine': 'google'}
WARNING searx.engines.google : ErrorContext('searx/search/processors/abstract.py', 111, 'result_container.extend(self.engine_name, search_results)', None, 'some results are invalids: invalid content', ()) True
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-18 13:23:35 +01:00
Markus Heiser
f0102a95c9
[fix] google engine: remove adds and fix mobile_ui selector
...
1. Fix issue reported in comment [1]
2. Fix XPath selector for the response of google's mobile UI, reported in
comment [2]
[1] https://github.com/searxng/searxng/pull/777#issuecomment-1015121322
[2] https://github.com/searxng/searxng/pull/777#issuecomment-1015236238
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-18 11:05:45 +01:00
Alexandre Flament
b972df255a
Merge pull request #776 from mrpaulblack/simple-ltr-vars
...
[simple theme] dont hardcode border radius
2022-01-18 07:56:03 +01:00
Émilien Devos
6670063e0d
Update XPath for Google engine
2022-01-17 21:49:57 +00:00
mrpaulblack
6c1a64d4b3
[build] /static
2022-01-17 22:35:22 +01:00
mrpaulblack
7a0f5e6b19
[simple theme] dynamic border radius in CSS
2022-01-17 22:35:02 +01:00
Markus Heiser
e85744c254
Revert "[hotfix] interim fix to get docker-build of CI without issues"
...
This reverts interim fix from commit 50c4b58dbhttps://github.com/redis/redis-py/issues/1869
[2] https://github.com/redis/redis-py/commit/1fc1233f
[3] https://github.com/redis/redis-py/pull/1854
[4] https://github.com/redis/redis-py/issues/1880
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-17 18:03:29 +01:00
Martin Fischer
96655cbd4e
[typing] add type hints to webapp.py
2022-01-17 11:42:48 +01:00
Martin Fischer
193b0efd12
[typing] add results.UnresponsiveEngine
2022-01-17 11:42:48 +01:00
Martin Fischer
0c6a09cae3
[refactor] remove never used parameter
2022-01-17 11:42:48 +01:00
Martin Fischer
def62c3a47
[typing] add type hints for dictionaries
2022-01-17 11:42:48 +01:00
Martin Fischer
6d43cf7952
[typing] add optional attrs to Plugin
2022-01-17 11:42:48 +01:00
Martin Fischer
fdf562bc32
[typing] add results.Timing
2022-01-17 11:42:48 +01:00
Martin Fischer
1ed618222f
[typing] add ExtendedRequest
...
webapp.py monkey-patches the Flask request global.
This commit adds a type cast so that e.g. Pyright[1]
doesn't show "Cannot access member" errors everywhere.
[1]: https://github.com/microsoft/pyright
2022-01-17 11:18:17 +01:00
Alexandre Flament
0c036ae294
Merge pull request #750 from dalf/simple-rtl
...
Simple theme: implement RTL
2022-01-16 20:29:34 +01:00
Alexandre Flament
e07417848f
Merge pull request #695 from return42/fix-sp
...
[fix] startpage engine / modified API
2022-01-16 20:27:36 +01:00
Alexandre Flament
468619abcb
[build] /static
2022-01-16 18:52:46 +01:00
