Bnyro
a7537a6935
[feat] search: add url formatting preference
2024-12-01 13:08:50 +01:00
Bnyro
cae07b9bf8
[build] /static
2024-11-29 20:24:06 +01:00
Bnyro
365c4d0643
[chore] search.js: remove leftovers from shift to multiselect categories PR
2024-11-29 20:24:06 +01:00
Markus Heiser
bb04699b17
[fix] unit tests: call searx.search.initialize in test's setUp
...
Depending on the order the unit tests are executed, the searx.search module is
initalized or not, issue reported in [1]::
Traceback (most recent call last):
File "searxng/tests/unit/test_results.py", line 72, in test_result_merge_by_title
self.container.extend('stract', [fake_result(engine='stract', title='short title')])
File "searxng/searx/results.py", line 243, in extend
histogram_observe(standard_result_count, 'engine', engine_name, 'result', 'count')
File "searxng/searx/metrics/__init__.py", line 49, in histogram_observe
histogram_storage.get(*args).observe(duration)
^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
To ensure that the searx.search module is initialized, the
- searx.engines.load_engines is replace by
- searx.search.initialize
[1] https://github.com/searxng/searxng/pull/3932#discussion_r1822406569
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-29 15:26:03 +01:00
Allen
6948689d2a
[enh] use longest title and test get_ordered_results()
2024-11-29 15:26:03 +01:00
Bnyro
94aafc83a6
[build] /static
2024-11-29 15:05:00 +01:00
Bnyro
6a9b97cad2
[feat] search: shift/ctrl click a category to select multiple categories
2024-11-29 15:05:00 +01:00
return42
6ca89e1319
[data] update searx.data - update_engine_traits.py
2024-11-29 14:57:06 +01:00
Markus Heiser
605f38b352
[fix] update_currencies.py: github CI has longer timeouts
...
Github action Update data - update_currencies [1]:
./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py
fails with ``httpcore.ReadTimeout`` / the default timeout is 3sec.
[1] https://github.com/searxng/searxng/actions/runs/12076864366/job/33703464399
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-29 14:50:17 +01:00
searxng-bot
2717ffd094
[l10n] update translations from Weblate
...
ba1cebf8b25da337e58379976e0fa080d13242ac0f2d2bb9c1d4b3768be588f13a63779a649d5494b7ce0636996f4ed2d9d02a34ef99de3ab1d94d18f56fa1dff38e0412e5c6694ec9e9e0864c625e848c84a87ab0528ebc3a97b340f5ea8e5fdd25adcf6b35d0ada0ec01bc7ca3c3051adffd7987d5c101710f862cf05ae7f4c00a82a25e9a1b8cd81e70180726a79aab7a56a81ed44ff7213b2b40d6951926fb18e823c291557b884908525fcc395fe2bf7267d21ac5278d18e3376ba638f5ad5c94c9b313aaa801da23b4961df86698f206973a117384054d5cba41d3f2194692ded48b1d84b77ff92ece96ac9
2024-11-29 14:23:56 +01:00
dependabot[bot]
2fc131bfd6
[upd] pypi: Bump typer-slim from 0.13.1 to 0.14.0
...
Bumps [typer-slim](https://github.com/fastapi/typer ) from 0.13.1 to 0.14.0.
- [Release notes](https://github.com/fastapi/typer/releases )
- [Changelog](https://github.com/fastapi/typer/blob/master/docs/release-notes.md )
- [Commits](https://github.com/fastapi/typer/compare/0.13.1...0.14.0 )
---
updated-dependencies:
- dependency-name: typer-slim
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-11-29 14:23:05 +01:00
Markus Heiser
540323a4b0
[mod] hardening xpath engine: ignore empty results
...
A SearXNG maintainer on Matrix reported a traceback::
File "searxng-src/searx/engines/xpath.py", line 272, in response
dom = html.fromstring(resp.text)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "searx-pyenv/lib/python3.11/site-packages/lxml/html/__init__.py", line 850, in fromstring
doc = document_fromstring(html, parser=parser, base_url=base_url, **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "searx-pyenv/lib/python3.11/site-packages/lxml/html/__init__.py", line 738, in document_fromstring
raise etree.ParserError(
lxml.etree.ParserError: Document is empty
I don't have an example to reproduce the issue, but the issue and this patch are
clearly recognizable even without an example.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-29 14:20:31 +01:00
dependabot[bot]
cf034488d5
[upd] pypi: Bump fasttext-predict from 0.9.2.2 to 0.9.2.4
...
Bumps [fasttext-predict](https://github.com/searxng/fasttext-predict ) from 0.9.2.2 to 0.9.2.4.
- [Release notes](https://github.com/searxng/fasttext-predict/releases )
- [Commits](https://github.com/searxng/fasttext-predict/compare/v0.9.2.2...v0.9.2.4 )
---
updated-dependencies:
- dependency-name: fasttext-predict
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-11-29 10:21:13 +01:00
dependabot[bot]
011cb672f1
[upd] pypi: Bump selenium from 4.26.1 to 4.27.1
...
Bumps [selenium](https://github.com/SeleniumHQ/Selenium ) from 4.26.1 to 4.27.1.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases )
- [Commits](https://github.com/SeleniumHQ/Selenium/commits )
---
updated-dependencies:
- dependency-name: selenium
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-11-29 10:20:53 +01:00
return42
32260a2738
[data] update searx.data - update_wikidata_units.py
2024-11-29 08:01:13 +01:00
return42
db60c91a94
[data] update searx.data - update_ahmia_blacklist.py
2024-11-29 08:00:56 +01:00
return42
2b9cc53082
[data] update searx.data - update_engine_descriptions.py
2024-11-29 07:59:55 +01:00
return42
a3d49d8d4f
[data] update searx.data - update_firefox_version.py
2024-11-29 07:58:23 +01:00
Bnyro
0ca2520115
[feat] json/xpath engine: config option for method and body
2024-11-28 09:53:21 +01:00
Bnyro
5a9c1c6b5b
[fix] crowdview engine: html tags in title and content
2024-11-28 06:19:55 +01:00
Markus Heiser
7b6b772e34
[fix] wikicommons engine: remove HTML tags from result items
...
BTW: humanize filesize (Bytes) to KB, MB, GB ..
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-28 06:05:45 +01:00
Markus Heiser
342d321196
[fix] google engine: remove <script> tags from result items
...
In some results, Google returns a <script> tag that must be removed before
extracting the content.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-27 13:49:45 +01:00
Austin-Olacsi
55481a6377
[fix] findthatmeme engine URLs have changed
2024-11-27 11:08:23 +01:00
Markus Heiser
78f5300830
[chore] drop sjp engine: WEB side has changed a long time ago
...
The WEB page (PL only) has changed and there is now also a kind of CAPTCHA.
There is currently no possibility to restore the function of this engine.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-26 15:45:02 +01:00
Markus Heiser
ac0c6cc2d1
[chore] remove invalid base_url from settings.yml engines
...
The engines do not have / do not need a property `base_url`, lets remove it from
the settings.yml
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-26 10:06:07 +01:00
Markus Heiser
36a6f9c95f
[fix] engine: Library of Congress - image & thumb links
...
The properties `item.service_medium` and `item.thumb_gallery` are not given for
every result item. It is more reliable to use the first (thumb) and
last (image) URL in the list of of URLs in `image_url`.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-26 09:36:59 +01:00
Bnyro
66f6495a22
[fix] duckduckgo extra: crashes and returns no results
2024-11-25 17:00:52 +01:00
Bnyro
5bf3fbc93b
[fix] openmetrics: value is None if there's no data
2024-11-25 16:57:03 +01:00
Bnyro
bad070b4bc
[build] /static
2024-11-25 09:34:02 +01:00
Markus Heiser
cf8c36f351
[mod] add CSS (LESS) to xsl style to view rss in browser
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-25 09:34:02 +01:00
Markus Heiser
5fbea0b62d
[refactor] <type> element isn't a part of the RSS 2.0 spec [1]
...
[1] https://cyber.harvard.edu/rss/rss.html
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-25 09:34:02 +01:00
Bnyro
eb59b4604a
[feat] rss: add xsl style to view rss in browser
2024-11-25 09:34:02 +01:00
Bnyro
98f9a380ed
[chore] rss: rename from searx to SearXNG
2024-11-25 09:34:02 +01:00
Grant Lanham
68b4961b81
[test] add additional tests for preferences
2024-11-24 19:55:21 +01:00
Grant Lanham
c02268d56e
[fix] remove unknown_params from preferences
2024-11-24 19:55:21 +01:00
Bnyro
8744dd3c71
[feat] metrics: support for open metrics
2024-11-24 14:25:49 +01:00
Markus Heiser
7927baf545
[upd] github CI: actions/cache@v3 to actions/cache@v4
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-24 14:07:07 +01:00
Bnyro
e4961142e3
[build] /static
2024-11-24 12:41:57 +01:00
Bnyro
f31a3a2053
[chore] *: fix typos detected by typos-cli
2024-11-24 12:41:57 +01:00
Markus Heiser
0253c10b52
[feat] engine: add adobe stock video and audio engines
...
The engine has been revised; there is now the option ``adobe_content_types``
with which it is possible to configure engines for video and audio from the
adobe stock. BTW this patch adds documentation to the engine.
To test all three engines in one use a search term like::
!asi !asv !asa sound
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-24 11:56:12 +01:00
Bnyro
f20a7632f1
[feat] engine: add adobe stock photos
2024-11-24 11:56:12 +01:00
Markus Heiser
0f9694c90b
[clean] Internet Archive Scholar search API no longer exists
...
Engine was added in #2733 but the API does no longer exists. Related:
- https://github.com/searxng/searxng/issues/4038
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-23 17:59:38 +01:00
Markus Heiser
ccc4f30b20
[doc] update quantities on the intro page
...
The quantities on the intro page were partly out of date / example; we already
have 210 engines and not just 70. To avoid having to change the quantities
manually in the future, they are now calculated from the jinja context
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-23 16:33:08 +01:00
Markus Heiser
c4b874e9b0
[fix] engine Library of Congress: fix API URL loc.gov -> www.loc.gov
...
Avoid HTTP 404 and redirects. Requests to the JSON/YAML API use the base url [1]
https://www.loc.gov/{endpoint}/?fo=json
[1] https://www.loc.gov/apis/json-and-yaml/requests/
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-23 13:02:24 +01:00
Markus Heiser
7c4e4ebd40
[log] warning with URL in case of 'raise_for_httperror'
...
In order to be able to implement error handling, it is necessary to know which
URL triggered the exception / the URL has not yet been logged.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-23 11:33:19 +01:00
searxng-bot
b8f1a329d3
[l10n] update translations from Weblate
...
6581d89b3a342903eb61d3236b9cd03e8cc5a2399e23a9a5bcc06d4364e5ef8e3a127ec8
2024-11-22 10:02:42 +01:00
dependabot[bot]
67f7548573
[upd] pypi: Bump typer-slim from 0.13.0 to 0.13.1
...
Bumps [typer-slim](https://github.com/fastapi/typer ) from 0.13.0 to 0.13.1.
- [Release notes](https://github.com/fastapi/typer/releases )
- [Changelog](https://github.com/fastapi/typer/blob/master/docs/release-notes.md )
- [Commits](https://github.com/fastapi/typer/compare/0.13.0...0.13.1 )
---
updated-dependencies:
- dependency-name: typer-slim
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-11-22 09:59:26 +01:00
dependabot[bot]
f40fc2dd4f
[upd] pypi: Bump setproctitle from 1.3.3 to 1.3.4
...
Bumps [setproctitle](https://github.com/dvarrazzo/py-setproctitle ) from 1.3.3 to 1.3.4.
- [Changelog](https://github.com/dvarrazzo/py-setproctitle/blob/master/HISTORY.rst )
- [Commits](https://github.com/dvarrazzo/py-setproctitle/compare/version-1.3.3...version-1.3.4 )
---
updated-dependencies:
- dependency-name: setproctitle
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-11-22 09:58:19 +01:00
Markus Heiser
10d3af84b8
[fix] engine: duckduckgo - don't quote query string
...
The query string send to DDG must not be qouted.
The query string was URL-qouted in #4011 , but the URL-qouted query string result
in unexpected *URL decoded* and other garbish results as reported in #4019
and #4020 . To test compare the results of a query like::
!ddg Häuser und Straßen :de
!ddg Häuser und Straßen :all
!ddg 房屋和街道 :all
!ddg 房屋和街道 :zh
Closed:
- [#4019 ] https://github.com/searxng/searxng/issues/4019
- [#4020 ] https://github.com/searxng/searxng/issues/4020
Related:
- [#4011 ] https://github.com/searxng/searxng/pull/4011
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-17 18:14:22 +01:00
dependabot[bot]
4b57bc3db1
[upd] pypi: Bump flask from 3.0.3 to 3.1.0
...
Bumps [flask](https://github.com/pallets/flask ) from 3.0.3 to 3.1.0.
- [Release notes](https://github.com/pallets/flask/releases )
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst )
- [Commits](https://github.com/pallets/flask/compare/3.0.3...3.1.0 )
---
updated-dependencies:
- dependency-name: flask
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-11-15 13:23:24 +01:00
