rafaelcaricio/moviewyrm
1
0
Fork 0
forked from mirrors/bookwyrm
Code Issues 4 Pull requests Projects Releases Wiki Activity
7096 commits 16 branches 11 tags 32 MiB
Commit graph

98 commits

Author SHA1 Message Date
Mouse Reeve
0adda36da7 Remove search endpoints from Connector 
Instead of having individual search functions that make individual
requests, the connectors will always be searched asynchronously
together. The process_seach_response combines the parse and format
functions, which could probably be merged into one over-rideable
function.

The current to-do on this is to remove Inventaire search results that
are below the confidence threshhold after search, which used to happen
in the `search` function.
 2022-05-30 10:37:24 -07:00
Mouse Reeve
9c03bf782e Make an async request to all search connectors 
This is the untest first pass at re-arranging remote search to work in
parallel rather than sequence. It moves a couple functions around
(raise_not_valid_url, for example, needs to be in connector_manager.py
now to avoid circular imports). It adds a function to Connector objects
that generates a search result (either to the isbn endpoint or the free
text endpoint) based on the query, which was previously done as part of
the search.

I also lowered the timeout to 8 seconds by default.
 2022-05-30 10:15:22 -07:00
Mouse Reeve
72d6a4ce52 Log info, not exception, for expected errors 2022-03-11 14:55:54 -08:00
Mouse Reeve
3e635f497e Adds some simple url validation 2022-02-03 15:11:01 -08:00
Mouse Reeve
194c69f512 Fixes return values of null responses 2022-02-02 07:09:35 -08:00
Mouse Reeve
754e24812b Check image extensions before saving 2022-02-01 21:18:25 -08:00
Mouse Reeve
b18c69e186 Make search timeouts configurable 2022-01-07 07:42:05 -08:00
Mouse Reeve
3545085a7d Fixes tests 2021-12-14 14:19:27 -08:00
Mouse Reeve
09f5218f9c Fixes accept header 2021-12-14 13:47:09 -08:00
Mouse Reeve
6e61e4d52c
Merge pull request #1578 from bookwyrm-social/improve-compatibility 
Improve federation compability with Hubzilla and Zap
 2021-12-09 11:06:04 -08:00
Mouse Reeve
071da7d4fb Handle various link generation needs 2021-12-05 13:38:15 -08:00
Mouse Reeve
4085714764 Update openlibrary author with ISNI 2021-12-05 13:26:22 -08:00
Mouse Reeve
d7e4e6aa1e Adds openlibrary update for book 2021-12-05 13:02:42 -08:00
Mouse Reeve
b824841cb3 Adds update logic to connectors 2021-12-05 12:47:27 -08:00
Mouse Reeve
8ba875af4a Improve federation compability with Hubzilla and Zap 
Co-authored-by: hubzilla <redmatrix@users.noreply.github.com>
Fixes #1564
 2021-10-26 14:41:06 -07:00
Mouse Reeve
5dd2aac600 Merge branch 'main' into search-refactor 2021-09-30 10:41:30 -07:00
Mouse Reeve
d36ef2bcf1 Pylint change 2021-09-29 12:42:28 -07:00
Mouse Reeve
32391dd64d Python formatting 2021-09-29 12:38:31 -07:00
Mouse Reeve
0aef011258 Don't use the format detail if it maps directly 2021-09-29 12:29:17 -07:00
Mouse Reeve
123b23728f Infer format in openlibrary import 2021-09-29 12:21:19 -07:00
Mouse Reeve
08f6a97653 Python formatting 2021-09-18 11:33:43 -07:00
Mouse Reeve
acfb1bb376 Updating string format synatx part 2 2021-09-18 11:32:00 -07:00
Mouse Reeve
18591c7b56 Fixes circular import 2021-09-16 11:30:04 -07:00
Mouse Reeve
1f06d1a1d8 Removes local connector 2021-09-14 15:26:36 -07:00
Mouse Reeve
ad0fff7030 Prevent overwriting data on import form outside data source 2021-08-17 10:08:07 -07:00
Mouse Reeve
7a44a9b516 Use catch-all requests exception 2021-06-20 09:23:57 -07:00
Mouse Reeve
95a19a44f8 Don't error out when invalid urls are entered 2021-06-20 09:13:57 -07:00
Mouse Reeve
4479864008 Updates code for linter 2021-06-18 14:12:56 -07:00
Mouse Reeve
cf3869ad32 Adds timeouts to get requests 2021-06-17 12:34:54 -07:00
Mouse Reeve
d7a8dd5e19 Removes outdated field form abstract connector 2021-05-11 13:20:17 -07:00
Mouse Reeve
e7c5b77b4c Removes unused connector fields and adds active boolean 2021-05-11 09:54:04 -07:00
Mouse Reeve
a2621bce12 Fixes getting authors from work data 2021-04-30 15:48:52 -07:00
Mouse Reeve
485d20696b Fixes loading inventaire data by language code 2021-04-30 12:50:35 -07:00
Mouse Reeve
8eec3eca5b Don't spin out infinite load data tasks 2021-04-28 16:42:27 -07:00
Mouse Reeve
6551c59c45 Don't store default edition in the dataase 2021-04-28 16:05:17 -07:00
Mouse Reeve
3faacffaca Associated expanded editions with correct work 2021-04-28 13:28:07 -07:00
Mouse Reeve
7b65291a59 Python formatting for the new Black standard 2021-04-26 14:43:29 -07:00
Mouse Reeve
64c2313a5d Merge branch 'main' into inventaire 2021-04-26 14:22:05 -07:00
Mouse Reeve
3ade2d3bb1 New version of black, new whitespace 2021-04-26 09:15:42 -07:00
Mouse Reeve
1903812b1d Class method for checking if urls are blocked 2021-04-10 11:44:29 -07:00
Mouse Reeve
63d37c281d Handle invalid authors when importing books 2021-04-07 08:59:33 -07:00
Mouse Reeve
4112862924 Fixes search data and new activitypub fields 2021-04-06 18:00:54 -07:00
Mouse Reeve
82c2f2eeb1 Adds more author identifier fields 2021-04-06 17:46:06 -07:00
Mouse Reeve
22ebe60c0a Use custom data extractor for inventaire connector 2021-04-06 12:29:06 -07:00
Mouse Reeve
fba44206ac Adds separate view and load links for book search results 2021-04-06 12:17:58 -07:00
Mouse Reeve
d482c66ad4 Adds inventaire connector stub 
And changes formatters to accept the key as well as value
 2021-04-06 11:58:07 -07:00
Mouse Reeve
05fcfbc66f Show more data about books in search 2021-03-13 13:55:20 -08:00
Mouse Reeve
393ea625a2
Merge pull request #726 from mouse-reeve/search-tests 
Search tests
 2021-03-13 09:27:46 -08:00
Mouse Reeve
d3b1941eaa Uses get_data helper in isbn search (plus test) 2021-03-13 09:07:19 -08:00
Mouse Reeve
2ab913018d Use get_data helper when executing searches 2021-03-13 08:52:36 -08:00