Alexandre Flament
e64c3deab7
[mod] upgrade httpx 0.21.2
...
httpx 0.21.2 and httpcore 0.14.4 fix multiple issues:
* https://github.com/encode/httpx/releases/tag/0.21.2
* https://github.com/encode/httpcore/releases/tag/0.14.4
so most of the workarounds in searx.network have been removed.
2022-01-05 18:46:00 +01:00
Martin Fischer
a4c2cfb837
[enh] change categories_as_tabs from a list to a dict
...
The tab icon names are currently hard coded in the templates.
This commit lets us introduce an icon property in the future, e.g:
categories_as_tabs:
general:
icon: search-outline
2022-01-05 11:03:44 +01:00
Martin Fischer
b38036d519
[fix] stop setting superfluous cookies for "non tab categories"
2022-01-05 11:03:44 +01:00
Martin Fischer
3dd534e5c0
[refactor] make group_engines_in_tab more readable
2022-01-05 11:03:44 +01:00
Martin Fischer
d01e8aa8cc
[mod] introduce searx.engines.Engine for type hinting
2022-01-05 11:03:44 +01:00
Martin Fischer
3f76c9c96c
[enh] enable English dictionaries by default
...
These dictionaries are no longer part of the general category,
so they're no longer queried by default -> we can enable them
by default without degrading general query performance.
2022-01-05 11:03:44 +01:00
Martin Fischer
abe53946d4
[enh] display help text for "Other" engines tab in preferences
2022-01-05 11:03:44 +01:00
Martin Fischer
6f07d51b62
[mod] improve variable name
2022-01-05 11:03:44 +01:00
Martin Fischer
1e195f5b95
[mod] move group_engines_in_tab to searx.webutils
2022-01-05 11:03:44 +01:00
Martin Fischer
5d74bf3820
[enh] move dictionaries, Erowid & IMDb out of general category
...
The general category is the category that is searched by default.
From a privacy standpoint it doesn't make sense to send all general
queries to specialized search engines that cannot deal with those
queries anyway.
2022-01-05 11:03:44 +01:00
Martin Fischer
ab90e2ac49
[enh] show categories not in any tab category in "Other" preferences tab
...
Previously we didn't have a good place to put search engines that don't
fit into any of the tab categories. This commit automatically puts
search engines that don't belong to any tab category in an "other"
category, that is only displayed in the user preferences (and not above
search results).
2022-01-05 11:03:44 +01:00
Martin Fischer
4ac6b5d32d
[build] /static
2022-01-05 11:03:44 +01:00
Martin Fischer
a12cb6a807
[simple] improve styling of subcategory table headers in preferences
2022-01-05 11:03:44 +01:00
Martin Fischer
20a5e43e35
[enh] display language of engines in preferences
2022-01-05 11:03:44 +01:00
Martin Fischer
31e206361f
[enh] group engines in preference tabs
2022-01-05 11:03:44 +01:00
Martin Fischer
b02f762687
[enh] add more categories
2022-01-05 11:00:11 +01:00
Markus Heiser
d7b4306444
[fix] links in comments - https://docs.searxng.org/
...
fixed links from https://searxng.github.io/searxng/ to https://docs.searxng.org/
2022-01-04 16:04:49 +01:00
Markus Heiser
a6cfab93fa
[enh] add redis connector searx/shared/redisdb.py
...
Add a redis connector, the default DB connector is a socket at::
unix:///usr/local/searxng-redis/run/redis.sock?db=0
To set up a redis instance simply use::
$ ./manage redis.build
$ sudo -H ./manage redis.install
A hint for developers:
To get access rights to this instance, your developer account needs to be added
to the *searxng-redis* group::
$ sudo -H ./manage redis.addgrp "${USER}"
# don't forget to logout & login to get member of group
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-03 20:56:39 +01:00
Alexandre Flament
41ae5aea2b
[fix] disabling all engines in a category makes the bang search in general
...
with this commit, there is no result
2022-01-03 20:23:46 +01:00
Martin Fischer
8e9ad1ccc2
[enh] introduce categories_as_tabs
...
Previously all categories were displayed as search engine tabs.
This commit changes that so that only the categories listed under
categories_as_tabs in settings.yml are displayed.
This lets us introduce more categories without cluttering up the UI.
Categories not displayed as tabs can still be searched with !bangs.
2022-01-03 07:01:49 +01:00
Martin Fischer
df34b1ddcf
[enh] settings.yml: allow granular overwrites for about
2022-01-03 07:01:49 +01:00
Martin Fischer
8a0810cedc
[fix] bang syntax for categories with spaces
2022-01-03 07:01:49 +01:00
Alexandre Flament
458b7fb72d
Merge pull request #610 from return42/img-load-error
...
[fix] simple theme: hide the image if img load fails
2022-01-02 22:34:15 +01:00
Alexandre Flament
d83aa2b0d2
Merge pull request #613 from return42/pylint-bing-images
...
[pylint] Bing (Images) engine
2022-01-02 22:00:55 +01:00
Alexandre Flament
76cbfbbdda
reference docs.searxng.org
2022-01-02 21:18:29 +01:00
Markus Heiser
3cdf2d6570
Update searx.data - update_languages.py
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-01 18:37:35 +01:00
Markus Heiser
21d7c8b367
Merge pull request #676 from return42/fix-bing-lang
...
Fix issues on running update_languages.py
2022-01-01 18:12:47 +01:00
Markus Heiser
61ce0c2244
[fix] bing engines: fetch_supported_languages
...
The Request to and the Response from https://www.bing.com/account/general has
been changed.
[1] https://github.com/searxng/searxng/pull/672#discussion_r777104919
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-01 17:31:38 +01:00
Alexandre Flament
6b49f32d3e
Merge pull request #670 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-01-01 12:16:50 +01:00
Markus Heiser
3dcba2f67c
Merge pull request #671 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-01-01 12:08:26 +01:00
Markus Heiser
877293c470
Merge pull request #673 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-01-01 12:08:02 +01:00
dalf
127da09fc9
Update searx.data - update_wikidata_units.py
2022-01-01 06:25:06 +00:00
dalf
291483af53
Update searx.data - update_currencies.py
2022-01-01 06:25:02 +00:00
dalf
a0016250ec
Update searx.data - update_ahmia_blacklist.py
2022-01-01 06:24:59 +00:00
dalf
184242d36b
Update searx.data - update_firefox_version.py
2022-01-01 06:24:49 +00:00
Markus Heiser
021b4a0a02
Merge pull request #667 from searxng/dependabot/pip/master/pygments-2.11.0
...
Bump pygments from 2.10.0 to 2.11.0
2021-12-31 09:29:29 +01:00
Markus Heiser
efbcaaab3b
[build] /static
2021-12-31 09:14:38 +01:00
Markus Heiser
391e4b57c9
make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-31 09:12:22 +01:00
searxng-bot
db4885f7d4
[translations] update from Weblate
...
055a6080d028dfd7d2f3b9981b882f56f8e524a370eafa9c7eb20cec3cb754a4
2021-12-31 07:17:50 +00:00
Markus Heiser
f087d01e24
[build] /static
2021-12-29 14:33:54 +01:00
Markus Heiser
f75199b1ec
[fix] simple theme: hide the image if img load fails
...
Add event listener to query selector::
'#urls img.image'
From the user point of view, I think it is better to hide the image:
img_load_error.svg is helplful in the image category because it still allows to
select the image. IMO, in the news category, the fact there is a missing image
won't help to choose the links. From a developer point of view, the place holder
is signal that may be the engine needs to be updated (at least give a look). The
browser console should show the same information too, but it requires some
additional steps. [1]
[1] https://github.com/searxng/searxng/pull/610#issuecomment-997640132
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-29 14:30:16 +01:00
Markus Heiser
7966fd3bbd
Merge pull request #663 from dalf/mod_secret_key
...
changes about the secret_key
2021-12-29 13:33:27 +01:00
Markus Heiser
8f3a7feb47
[mod] implement is_hmac_of() in webutils / close to new_hmac()
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>, Alexandre Flament
2021-12-28 23:04:06 +01:00
Markus Heiser
dc4f1f705d
[pylint] Bing (Images) engine
...
Fix remarks from pylint and remove obsolete try/except block
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-28 14:43:39 +01:00
Markus Heiser
6d7a38a912
[pylint] Bing (Videos) engine
...
Fix remarks from pylint and remove obsolete try/except block
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-28 14:33:05 +01:00
Alexandre Flament
7d4834ac4d
[mod] webutils.py: remove dead code
...
secret_key can't be bytes (see settings_default.py)
2021-12-28 10:14:38 +01:00
Alexandre Flament
d784870209
[fix] use hmac.compare_digest instead of ==
...
see https://docs.python.org/3/library/hmac.html#hmac.HMAC.hexdigest
2021-12-28 08:36:31 +01:00
Markus Heiser
d84226bf63
[fix] issues reported by pylint
...
Fix pylint issues from commit (3d96a983
2021-12-27 10:16:20 +01:00
Markus Heiser
3d96a9839a
[format.python] initial formatting of the python code
...
This patch was generated by black [1]::
make format.python
[1] https://github.com/psf/black
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27 09:26:22 +01:00
Markus Heiser
fcdc2c2cd2
[format.python] disable py code formatting for some hunks of code
...
Disable the python code formatting from python-black, where the readability of
code suffers by formatting.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27 09:16:03 +01:00
searxng-bot
568a4df297
[translations] update from Weblate
...
140448982db5cc5d7273ced4bac8f580472c882abc2c60a411f37c0010417e8a12d49b4ba1bfd8f6fa94d2056a121417bc9b6947
2021-12-24 07:18:11 +00:00
Martin Fischer
19339067c6
[del] remove geektimes (redirects to habrahabr)
2021-12-22 13:20:56 +01:00
Martin Fischer
fb037e7a83
[del] remove whaleslide (website is down)
...
Closes #639 .
2021-12-22 13:19:27 +01:00
Martin Fischer
e28c6bda35
[doc] introduce about.language and sort engines by it
2021-12-21 09:58:51 +01:00
Markus Heiser
c5d604f06f
[upd] engine_descriptions.json
...
Updated by:
./manage pyenv.cmd python3 \
./searxng_extra/update/update_engine_descriptions.py
Include documentation of new added engines:
- superuser
- stackoverflow
- askubuntu
- indb
- ...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-20 14:39:10 +01:00
Markus Heiser
6fb6e8c22a
Merge pull request #621 from not-my-profile/engines-table
...
[doc] Improve engines table
2021-12-20 14:02:29 +01:00
Martin Fischer
1fb1cca519
[doc] fix about.website for hoogle
2021-12-20 12:12:09 +01:00
Markus Heiser
7a215e07e7
Merge pull request #611 from return42/fix-bing
...
[fix] bing engine: fix paging support, show inital page.
2021-12-20 10:08:52 +01:00
Martin Fischer
06beffdf31
[doc] add about.website for wiby
2021-12-20 07:59:51 +01:00
Alexandre Flament
b5d4cac7e1
Merge pull request #615 from return42/pylint-reddit
...
[pylint] Reddit engine
2021-12-19 11:32:32 +01:00
mrpaulblack
c6b76aa429
[build] /static
2021-12-18 21:25:22 +01:00
mrpaulblack
414f1039d2
[fix] theme: build img_load_error.svg as svg
2021-12-18 21:24:59 +01:00
Markus Heiser
2af50c2588
[pylint] Reddit engine
...
Add Reddit engine to pylint process
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18 17:59:47 +01:00
Markus Heiser
6b85607274
[fix] bing engine: fix paging support, show inital page.
...
Follow up queries for the pages needed to be fixed.
- Split search-term in one for initial query and one for following queries.
- Set some headers in HTTP requests, bing needs for paging support.
- IMO //div[@class="sa_cc"] does no longer match in a bing response.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18 13:50:38 +01:00
Markus Heiser
b2177e5916
[pylint] Bing (Web) engine
...
Fix remarks from pylint and improved code-style. In preparation for a bug-fix
of the Bing (Web) engine I add this engine to the pylint-list.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-18 13:40:36 +01:00
Alexandre Flament
4da1e0026c
Merge pull request #609 from return42/fix-bing-news
...
[fix] engine bing-news: replace the http:// by https://
2021-12-18 00:01:40 +01:00
Markus Heiser
f41734a543
[fix] engine bing-news: replace the http:// by https://
...
BTW: add bing_news to the pylint process
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-17 13:25:50 +01:00
Alexandre Flament
f6b1264b5f
Merge pull request #584 from return42/drop-css-vendor
...
[mod] simple-theme: remove vendor CSS
2021-12-17 12:14:19 +01:00
searxng-bot
3cf9065478
[translations] update
...
1a891c1633bd07e77ba2434380d54b89af9e007c9d4e645c21dec08c
2021-12-17 07:17:56 +00:00
Alexandre Flament
6bb6f7ffc1
Merge pull request #602 from return42/fix-600
...
[fix] move engines gpodder and AZlyrics into category music
2021-12-16 18:18:16 +01:00
Markus Heiser
07f2a9ee3c
[fix] engine: MediathekViewWeb (mvw) disable by default
...
The MediathekViewWeb delivers only content for the german speaking area.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-15 19:03:35 +01:00
Markus Heiser
84836a5000
[build] /static
2021-12-15 14:47:43 +01:00
Markus Heiser
c020b90056
[mod] simple theme: remove vendor prefix of width: max-content
...
Remove no longer needed workarounds like `width: 1000px;`
and vendor prefix of max-content [1].
[1] https://developer.mozilla.org/en-US/docs/Web/CSS/max-content#browser_compatibility
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-15 14:43:15 +01:00
Markus Heiser
459f33a18e
[mod] simple-theme: remove vendor CSS
...
flexbox
Browser support for flexbox is excellent, and the majority of browsers do not
need a prefix at this point. Safari was the last of the major browsers to
remove prefixes, with the release of Safari 9 in 2015. [1]
user-select:
Vendor prefix of user-select is not needed, see 'Browser compatibility' [2].
[1] https://developer.mozilla.org/en-US/docs/Web/CSS/CSS_Flexible_Box_Layout/Backwards_Compatibility_of_Flexbox#status_in_browsers
[2] https://developer.mozilla.org/en-US/docs/Web/CSS/user-select#browser_compatibility
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-15 14:43:15 +01:00
Markus Heiser
715f578cda
[build] /static
2021-12-15 10:45:25 +01:00
Markus Heiser
c416464949
[fix] lazy loading of <img> tags
...
Images should include dimension attributes. Without `width` and `height`
specified, image dimensions are 0×0 pixels at first. ... In this case the
browser determines that all of them are visible to the user and decides to load
everything [1].
In CSS the `width` is set to a value and the `height` is unsed to scale the image
proportional in both dimensions.
[1] https://web.dev/browser-level-image-lazy-loading/#images-should-include-dimension-attributes
[2] https://caniuse.com/loading-lazy-attr
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-15 10:39:55 +01:00
Markus Heiser
709482088e
[fix] move engines gpodder and AZlyrics into category music
...
Closes: https://github.com/searxng/searxng/issues/600
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-15 09:43:56 +01:00
Markus Heiser
f287787c44
[simple theme] activate - SearXNG JavaScript Style Guide
...
Add the 'SearXNG JavaScript Style Guide' as one quality gate in the build chain
of the simple theme::
make themes.simple
make themes.simple.test
In the github CI the `themes.all` target enforce a `themes.simple`.
BTW: Remove 'jshint' left overs from 0ee316f3d
2021-12-14 07:50:53 +01:00
Markus Heiser
34f5e9c7a3
[fix] eslint --fix
...
automatically fix some of the problems reported by eslint rules::
$ ./manage nvm.bash
nvm-env$ npm --prefix searx/static/themes/simple run eslint-fix
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-14 07:31:58 +01:00
Markus Heiser
32cf24a272
[mod] eslint: add gruntfile.js to the files to lint
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-14 07:26:41 +01:00
Markus Heiser
06730588a6
[mod] SearXNG JavaScript Style Guide (eslint:recommended)
...
The SearXNG JavaScript Style Guide is a set of eslint rules [1] based on the
eslint:recommended [2] rules.
"extends": "eslint:recommended"
The additional rules adopted from the JavaScript Standard Style [3][4].
[1] https://eslint.org/docs/rules/
[2] https://github.com/kunalgolani/eslint-config/tree/master/packages/recommended
[3] https://standardjs.com/rules.html#javascript-standard-style
[4] https://github.com/standard/eslint-config-standard/blob/master/.eslintrc.json
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-14 06:50:26 +01:00
Markus Heiser
9fc27088ef
Merge pull request #583 from return42/fix-combo-with
...
[fix] simple theme: remove width 45% from language and time filters
2021-12-12 17:02:31 +01:00
Markus Heiser
8cc7c880ae
Merge pull request #587 from dalf/fix-gigablast
...
[fix] gigablast engine
2021-12-12 15:58:13 +01:00
searxng-bot
b994471233
[translations] update
...
030f3e59cedb4f9d8522e4cf
2021-12-11 18:11:41 +00:00
searxng-bot
5bf16d56f4
[translations] update
...
10790ace0026bde6e066d8cf174b9f9c0817e6456272320fe1281900882ced8059e8c950cfd72d008f3d6058b293c351840e1a989f045c63e24a23e0bf58a8706b5e4993dc9ab819b8b1423bfbfe865cafa65a98dded218c796599205a4100dc57fb7a9133eb893d2673c748
2021-12-10 07:17:45 +00:00
Alexandre Flament
2a262df0bb
Merge pull request #582 from return42/fix-autocomplete-csp
...
[fix] simple theme: make autocomplete-js CSP compliant
2021-12-08 20:28:35 +01:00
Markus Heiser
b5c9cc4ff3
Merge pull request #586 from dalf/remove-yggtorrent
...
[del] remove yggtorrent
2021-12-07 07:00:47 +01:00
Alexandre Flament
1a6207574e
[fix] gigablast engine
...
fetch extra params after 3000 seconds
2021-12-06 22:55:15 +01:00
Alexandre Flament
fbc2a6ab4b
[del] remove yggtorrent
...
yggtorrent is behind cloudflare now
close #580
2021-12-06 21:59:51 +01:00
Alexandre Flament
037cb7dd3d
[fix] imdb: don't crash when there is no result
2021-12-06 21:49:18 +01:00
Markus Heiser
5f902bbb0f
[fix] simple theme: remove width 45% from language and time filters
...
All three filters (`language`, `time_range` and `safesearch`) are rendered in
one line. A size of 45% for `language` and `time_range` left only 10% for the
`safesearch` filter. Solution: drop with from `language` and `time_range`.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-05 14:22:55 +01:00
Markus Heiser
d6d6585b26
[build] /static
2021-12-05 11:51:36 +01:00
Markus Heiser
2b26285a73
[fix] simple theme: make autocomplete-js CSP compliant
...
The CSP issue is, that the `_Position` function in the autocomplete-js set the
style attributes by `setAttribute("style", ...)`. Using `setAttribute` to set
the style attribute invokes the HTML parser and CSP is triggered [1].
This patch overwrite the `_Position` function of autocomplete-js.
BTW: remove trailing whitespace
[1] https://stackoverflow.com/a/57633533
Closes: https://github.com/searxng/searxng/issues/352
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-05 11:48:23 +01:00
Markus Heiser
f5a4906e3e
[build] /static
2021-12-04 11:31:04 +01:00
Markus Heiser
7d6a15a612
[fix] simple theme: make LESS sources available on non build hosts
...
Include the LESS source files directly in the `.map` files [1].
Drawback: `.map` files grow up in size, but this should not bother, because the
files are only loaded in debug mode.
[1] https://github.com/gruntjs/grunt-contrib-less#outputsourcefiles
[2] https://github.com/searxng/searxng/pull/575#issuecomment-984058868
Suggested-by: @dalf [2]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-04 11:22:40 +01:00
Alexandre Flament
b0774c7e37
Merge pull request #578 from searxng/translations_update
...
Update translations
2021-12-03 09:02:46 +01:00
searxng-bot
d65e841c55
[translations] update
...
b4860945df96994b007ea84d6ff99312
2021-12-03 07:17:47 +00:00
Markus Heiser
d26a746d7d
[build] /static
2021-12-01 21:12:06 +01:00
Markus Heiser
f54460a805
[fix] simple theme: make JS sources available on non build hosts
...
Include the source files directly in the `.map` files [1] for two reasons:
1. In the simple theme, modules from `./node_modules` are only available on
developer's build host (a `make node.env` is needed to get the sources). By
example; in the `searxng.min.js.map` file, the `autocomplete.js` is linked at
URL:
../node_modules/autocomplete-js/dist/autocomplete.js
2. Later, when client sources has been moved out of the `./static` URL [2] to
the `<repo-roo>/src` folder, all JS sources are no longer available.
Drawback: `.map` files grow up in size, but this should not bother, because the
files are only loaded in debug mode.
[1] https://github.com/gruntjs/grunt-contrib-uglify#sourcemapincludesources
[2] https://github.com/searxng/searxng/issues/141
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-01 21:09:26 +01:00
Alexandre Flament
ae49b5224c
Merge pull request #566 from dalf/simple-theme-smaller-build
...
[mod] simple theme: smaller build
2021-12-01 20:30:58 +01:00
