Commit graph

97 commits

Author SHA1 Message Date
Mouse Reeve
9c03bf782e Make an async request to all search connectors
This is the untest first pass at re-arranging remote search to work in
parallel rather than sequence. It moves a couple functions around
(raise_not_valid_url, for example, needs to be in connector_manager.py
now to avoid circular imports). It adds a function to Connector objects
that generates a search result (either to the isbn endpoint or the free
text endpoint) based on the query, which was previously done as part of
the search.

I also lowered the timeout to 8 seconds by default.
2022-05-30 10:15:22 -07:00
Mouse Reeve
72d6a4ce52 Log info, not exception, for expected errors 2022-03-11 14:55:54 -08:00
Mouse Reeve
3e635f497e Adds some simple url validation 2022-02-03 15:11:01 -08:00
Mouse Reeve
194c69f512 Fixes return values of null responses 2022-02-02 07:09:35 -08:00
Mouse Reeve
754e24812b Check image extensions before saving 2022-02-01 21:18:25 -08:00
Mouse Reeve
b18c69e186 Make search timeouts configurable 2022-01-07 07:42:05 -08:00
Mouse Reeve
3545085a7d Fixes tests 2021-12-14 14:19:27 -08:00
Mouse Reeve
09f5218f9c Fixes accept header 2021-12-14 13:47:09 -08:00
Mouse Reeve
6e61e4d52c
Merge pull request #1578 from bookwyrm-social/improve-compatibility
Improve federation compability with Hubzilla and Zap
2021-12-09 11:06:04 -08:00
Mouse Reeve
071da7d4fb Handle various link generation needs 2021-12-05 13:38:15 -08:00
Mouse Reeve
4085714764 Update openlibrary author with ISNI 2021-12-05 13:26:22 -08:00
Mouse Reeve
d7e4e6aa1e Adds openlibrary update for book 2021-12-05 13:02:42 -08:00
Mouse Reeve
b824841cb3 Adds update logic to connectors 2021-12-05 12:47:27 -08:00
Mouse Reeve
8ba875af4a Improve federation compability with Hubzilla and Zap
Co-authored-by: hubzilla <redmatrix@users.noreply.github.com>
Fixes #1564
2021-10-26 14:41:06 -07:00
Mouse Reeve
5dd2aac600 Merge branch 'main' into search-refactor 2021-09-30 10:41:30 -07:00
Mouse Reeve
d36ef2bcf1 Pylint change 2021-09-29 12:42:28 -07:00
Mouse Reeve
32391dd64d Python formatting 2021-09-29 12:38:31 -07:00
Mouse Reeve
0aef011258 Don't use the format detail if it maps directly 2021-09-29 12:29:17 -07:00
Mouse Reeve
123b23728f Infer format in openlibrary import 2021-09-29 12:21:19 -07:00
Mouse Reeve
08f6a97653 Python formatting 2021-09-18 11:33:43 -07:00
Mouse Reeve
acfb1bb376 Updating string format synatx part 2 2021-09-18 11:32:00 -07:00
Mouse Reeve
18591c7b56 Fixes circular import 2021-09-16 11:30:04 -07:00
Mouse Reeve
1f06d1a1d8 Removes local connector 2021-09-14 15:26:36 -07:00
Mouse Reeve
ad0fff7030 Prevent overwriting data on import form outside data source 2021-08-17 10:08:07 -07:00
Mouse Reeve
7a44a9b516 Use catch-all requests exception 2021-06-20 09:23:57 -07:00
Mouse Reeve
95a19a44f8 Don't error out when invalid urls are entered 2021-06-20 09:13:57 -07:00
Mouse Reeve
4479864008 Updates code for linter 2021-06-18 14:12:56 -07:00
Mouse Reeve
cf3869ad32 Adds timeouts to get requests 2021-06-17 12:34:54 -07:00
Mouse Reeve
d7a8dd5e19 Removes outdated field form abstract connector 2021-05-11 13:20:17 -07:00
Mouse Reeve
e7c5b77b4c Removes unused connector fields and adds active boolean 2021-05-11 09:54:04 -07:00
Mouse Reeve
a2621bce12 Fixes getting authors from work data 2021-04-30 15:48:52 -07:00
Mouse Reeve
485d20696b Fixes loading inventaire data by language code 2021-04-30 12:50:35 -07:00
Mouse Reeve
8eec3eca5b Don't spin out infinite load data tasks 2021-04-28 16:42:27 -07:00
Mouse Reeve
6551c59c45 Don't store default edition in the dataase 2021-04-28 16:05:17 -07:00
Mouse Reeve
3faacffaca Associated expanded editions with correct work 2021-04-28 13:28:07 -07:00
Mouse Reeve
7b65291a59 Python formatting for the new Black standard 2021-04-26 14:43:29 -07:00
Mouse Reeve
64c2313a5d Merge branch 'main' into inventaire 2021-04-26 14:22:05 -07:00
Mouse Reeve
3ade2d3bb1 New version of black, new whitespace 2021-04-26 09:15:42 -07:00
Mouse Reeve
1903812b1d Class method for checking if urls are blocked 2021-04-10 11:44:29 -07:00
Mouse Reeve
63d37c281d Handle invalid authors when importing books 2021-04-07 08:59:33 -07:00
Mouse Reeve
4112862924 Fixes search data and new activitypub fields 2021-04-06 18:00:54 -07:00
Mouse Reeve
82c2f2eeb1 Adds more author identifier fields 2021-04-06 17:46:06 -07:00
Mouse Reeve
22ebe60c0a Use custom data extractor for inventaire connector 2021-04-06 12:29:06 -07:00
Mouse Reeve
fba44206ac Adds separate view and load links for book search results 2021-04-06 12:17:58 -07:00
Mouse Reeve
d482c66ad4 Adds inventaire connector stub
And changes formatters to accept the key as well as value
2021-04-06 11:58:07 -07:00
Mouse Reeve
05fcfbc66f Show more data about books in search 2021-03-13 13:55:20 -08:00
Mouse Reeve
393ea625a2
Merge pull request #726 from mouse-reeve/search-tests
Search tests
2021-03-13 09:27:46 -08:00
Mouse Reeve
d3b1941eaa Uses get_data helper in isbn search (plus test) 2021-03-13 09:07:19 -08:00
Mouse Reeve
2ab913018d Use get_data helper when executing searches 2021-03-13 08:52:36 -08:00
Mouse Reeve
919b166241 Catch error in serializing unknown boosts 2021-03-13 08:13:20 -08:00