mirrors/bookwyrm
1
0
Fork 1
mirror of https://github.com/bookwyrm-social/bookwyrm.git synced 2024-06-29 18:30:38 +00:00
Code Issues Projects Releases Wiki Activity
7093 commits 16 branches 36 tags 94 MiB
Commit graph

188 commits

Author SHA1 Message Date
Mouse Reeve 0adda36da7 Remove search endpoints from Connector 
Instead of having individual search functions that make individual
requests, the connectors will always be searched asynchronously
together. The process_seach_response combines the parse and format
functions, which could probably be merged into one over-rideable
function.

The current to-do on this is to remove Inventaire search results that
are below the confidence threshhold after search, which used to happen
in the `search` function.
 2022-05-30 10:37:24 -07:00
Mouse Reeve 9c03bf782e Make an async request to all search connectors 
This is the untest first pass at re-arranging remote search to work in
parallel rather than sequence. It moves a couple functions around
(raise_not_valid_url, for example, needs to be in connector_manager.py
now to avoid circular imports). It adds a function to Connector objects
that generates a search result (either to the isbn endpoint or the free
text endpoint) based on the query, which was previously done as part of
the search.

I also lowered the timeout to 8 seconds by default.
 2022-05-30 10:15:22 -07:00
Mouse Reeve 72d6a4ce52 Log info, not exception, for expected errors 2022-03-11 14:55:54 -08:00
Mouse Reeve 39691bed3a Merge branch 'main' into openlibrary-author-fields 2022-02-16 18:06:04 -08:00
Mouse Reeve 3e635f497e Adds some simple url validation 2022-02-03 15:11:01 -08:00
Mouse Reeve 194c69f512 Fixes return values of null responses 2022-02-02 07:09:35 -08:00
Mouse Reeve 754e24812b Check image extensions before saving 2022-02-01 21:18:25 -08:00
Mouse Reeve 9611815b44 Extract wikipedia and inventaire ids 2022-01-30 12:02:18 -08:00
Mouse Reeve 44dad43f36 Load new fields via connector 2022-01-30 11:41:33 -08:00
Mouse Reeve b18c69e186 Make search timeouts configurable 2022-01-07 07:42:05 -08:00
Mouse Reeve 3545085a7d Fixes tests 2021-12-14 14:19:27 -08:00
Mouse Reeve 09f5218f9c Fixes accept header 2021-12-14 13:47:09 -08:00
Mouse Reeve 6e61e4d52c
Merge pull request #1578 from bookwyrm-social/improve-compatibility 
Improve federation compability with Hubzilla and Zap
 2021-12-09 11:06:04 -08:00
Mouse Reeve 02313f40b8 Adds update from inventaire link for books 2021-12-05 13:48:05 -08:00
Mouse Reeve 071da7d4fb Handle various link generation needs 2021-12-05 13:38:15 -08:00
Mouse Reeve 4085714764 Update openlibrary author with ISNI 2021-12-05 13:26:22 -08:00
Mouse Reeve d7e4e6aa1e Adds openlibrary update for book 2021-12-05 13:02:42 -08:00
Mouse Reeve b824841cb3 Adds update logic to connectors 2021-12-05 12:47:27 -08:00
Mouse Reeve 6dd7eebd98 Fixes tests 2021-11-16 10:16:28 -08:00
Mouse Reeve d3e4c7e8d9 Removes change to boolean logic 2021-10-27 10:40:37 -07:00
Mouse Reeve 07446fa7d2 Adds more tests for the inventaire connector 2021-10-27 10:03:09 -07:00
Mouse Reeve 8ba875af4a Improve federation compability with Hubzilla and Zap 
Co-authored-by: hubzilla <redmatrix@users.noreply.github.com>
Fixes #1564
 2021-10-26 14:41:06 -07:00
Mouse Reeve 1033d3d045 Updates connector tests 2021-09-30 11:33:04 -07:00
Mouse Reeve 5dd2aac600 Merge branch 'main' into search-refactor 2021-09-30 10:41:30 -07:00
Mouse Reeve d36ef2bcf1 Pylint change 2021-09-29 12:42:28 -07:00
Mouse Reeve 32391dd64d Python formatting 2021-09-29 12:38:31 -07:00
Mouse Reeve 0aef011258 Don't use the format detail if it maps directly 2021-09-29 12:29:17 -07:00
Mouse Reeve 123b23728f Infer format in openlibrary import 2021-09-29 12:21:19 -07:00
Mouse Reeve 08f6a97653 Python formatting 2021-09-18 11:33:43 -07:00
Mouse Reeve acfb1bb376 Updating string format synatx part 2 2021-09-18 11:32:00 -07:00
Mouse Reeve 18591c7b56 Fixes circular import 2021-09-16 11:30:04 -07:00
Mouse Reeve fbe05623ff Updates first_search_result functionality 2021-09-16 11:07:36 -07:00
Mouse Reeve 1f06d1a1d8 Removes local connector 2021-09-14 15:26:36 -07:00
Mouse Reeve aa91361fe4 Fixes celery kwarg for queue 2021-09-07 17:09:44 -07:00
Mouse Reeve de3f18655c Set priorities on tasks 2021-09-07 16:33:43 -07:00
Mouse Reeve 332a712d84 Safely handle work with no editions error 2021-08-23 15:59:58 -07:00
Mouse Reeve ad0fff7030 Prevent overwriting data on import form outside data source 2021-08-17 10:08:07 -07:00
Mouse Reeve 55d84d50ee Fixes loading editions from inventaire 2021-08-08 15:55:49 -07:00
Mouse Reeve 62b6bfe1ee Annotation and filtering order 2021-06-26 18:55:09 -07:00
Mouse Reeve 6470033ac9 Fixes search query syntax 
mad about the lack of django docs on this, jeez
 2021-06-26 16:20:18 -07:00
Mouse Reeve 61785cee66 Set defualt min confidence to 0 2021-06-26 09:12:23 -07:00
Mouse Reeve deb1b9943a Uses simple dictionary as backup for english dictionary 
Creates search vectors with stop words if the english version is empty,
and uses a SearchQuery OR with simple and english on the view side.
 2021-06-24 10:56:27 -07:00
Mouse Reeve 7c15fbbb0b More efficient search index 
Co-authored-by: asmr-hex <0.0@asmr.software>
 2021-06-23 16:54:59 -07:00
Mouse Reeve 7a44a9b516 Use catch-all requests exception 2021-06-20 09:23:57 -07:00
Mouse Reeve 95a19a44f8 Don't error out when invalid urls are entered 2021-06-20 09:13:57 -07:00
Mouse Reeve 9e5c7053e9 More pylint fixes 2021-06-18 14:29:24 -07:00
Mouse Reeve 4479864008 Updates code for linter 2021-06-18 14:12:56 -07:00
Mouse Reeve 321554f17e
Merge pull request #1181 from bookwyrm-social/search-cleanup 
Minor simplifications to search queries
 2021-06-17 14:57:17 -07:00
Mouse Reeve 59643c02a3 Python formatting 2021-06-17 14:48:19 -07:00
Mouse Reeve 5d3639e47f Minor simplications to search queries 2021-06-17 14:46:58 -07:00