[fix] brave engine: add sec-fetch headers and source=web argument

The intention is to reduce the "TooManyRequestsException".

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
This commit is contained in:
Markus Heiser 2025-03-02 10:34:19 +01:00 committed by Markus Heiser
parent b0beb307ca
commit 8984d7ae02

View file

@ -30,7 +30,6 @@ Configured ``brave`` engines:
brave_category: news
- name: brave.goggles
brave_category: goggles
time_range_support: true
paging: true
...
@ -207,6 +206,7 @@ def request(query, params):
args = {
'q': query,
'source': 'web',
}
if brave_spellcheck:
args['spellcheck'] = '1'
@ -237,6 +237,11 @@ def request(query, params):
logger.debug("cookies %s", params['cookies'])
params['headers']['Sec-Fetch-Dest'] = "document"
params['headers']['Sec-Fetch-Mode'] = "navigate"
params['headers']['Sec-Fetch-Site'] = "same-origin"
params['headers']['Sec-Fetch-User'] = "?1"
def _extract_published_date(published_date_raw):
if published_date_raw is None: