Mouse Reeve
87fe984462
Combines search formatter and parser function
...
The parser was extracting the list of search results from the json
object returned by the search endpoint, and the formatter was converting
an individual json entry into a SearchResult object. This just merged
them into one function, because they are never used separately.
2022-05-30 12:52:31 -07:00
Mouse Reeve
0adda36da7
Remove search endpoints from Connector
...
Instead of having individual search functions that make individual
requests, the connectors will always be searched asynchronously
together. The process_seach_response combines the parse and format
functions, which could probably be merged into one over-rideable
function.
The current to-do on this is to remove Inventaire search results that
are below the confidence threshhold after search, which used to happen
in the `search` function.
2022-05-30 10:37:24 -07:00
Mouse Reeve
9c03bf782e
Make an async request to all search connectors
...
This is the untest first pass at re-arranging remote search to work in
parallel rather than sequence. It moves a couple functions around
(raise_not_valid_url, for example, needs to be in connector_manager.py
now to avoid circular imports). It adds a function to Connector objects
that generates a search result (either to the isbn endpoint or the free
text endpoint) based on the query, which was previously done as part of
the search.
I also lowered the timeout to 8 seconds by default.
2022-05-30 10:15:22 -07:00
Mouse Reeve
72d6a4ce52
Log info, not exception, for expected errors
2022-03-11 14:55:54 -08:00
Mouse Reeve
3e635f497e
Adds some simple url validation
2022-02-03 15:11:01 -08:00
Mouse Reeve
194c69f512
Fixes return values of null responses
2022-02-02 07:09:35 -08:00
Mouse Reeve
754e24812b
Check image extensions before saving
2022-02-01 21:18:25 -08:00
Mouse Reeve
b18c69e186
Make search timeouts configurable
2022-01-07 07:42:05 -08:00
Mouse Reeve
3545085a7d
Fixes tests
2021-12-14 14:19:27 -08:00
Mouse Reeve
09f5218f9c
Fixes accept header
2021-12-14 13:47:09 -08:00
Mouse Reeve
6e61e4d52c
Merge pull request #1578 from bookwyrm-social/improve-compatibility
...
Improve federation compability with Hubzilla and Zap
2021-12-09 11:06:04 -08:00
Mouse Reeve
071da7d4fb
Handle various link generation needs
2021-12-05 13:38:15 -08:00
Mouse Reeve
4085714764
Update openlibrary author with ISNI
2021-12-05 13:26:22 -08:00
Mouse Reeve
d7e4e6aa1e
Adds openlibrary update for book
2021-12-05 13:02:42 -08:00
Mouse Reeve
b824841cb3
Adds update logic to connectors
2021-12-05 12:47:27 -08:00
Mouse Reeve
8ba875af4a
Improve federation compability with Hubzilla and Zap
...
Co-authored-by: hubzilla <redmatrix@users.noreply.github.com>
Fixes #1564
2021-10-26 14:41:06 -07:00
Mouse Reeve
5dd2aac600
Merge branch 'main' into search-refactor
2021-09-30 10:41:30 -07:00
Mouse Reeve
d36ef2bcf1
Pylint change
2021-09-29 12:42:28 -07:00
Mouse Reeve
32391dd64d
Python formatting
2021-09-29 12:38:31 -07:00
Mouse Reeve
0aef011258
Don't use the format detail if it maps directly
2021-09-29 12:29:17 -07:00
Mouse Reeve
123b23728f
Infer format in openlibrary import
2021-09-29 12:21:19 -07:00
Mouse Reeve
08f6a97653
Python formatting
2021-09-18 11:33:43 -07:00
Mouse Reeve
acfb1bb376
Updating string format synatx part 2
2021-09-18 11:32:00 -07:00
Mouse Reeve
18591c7b56
Fixes circular import
2021-09-16 11:30:04 -07:00
Mouse Reeve
1f06d1a1d8
Removes local connector
2021-09-14 15:26:36 -07:00
Mouse Reeve
ad0fff7030
Prevent overwriting data on import form outside data source
2021-08-17 10:08:07 -07:00
Mouse Reeve
7a44a9b516
Use catch-all requests exception
2021-06-20 09:23:57 -07:00
Mouse Reeve
95a19a44f8
Don't error out when invalid urls are entered
2021-06-20 09:13:57 -07:00
Mouse Reeve
4479864008
Updates code for linter
2021-06-18 14:12:56 -07:00
Mouse Reeve
cf3869ad32
Adds timeouts to get requests
2021-06-17 12:34:54 -07:00
Mouse Reeve
d7a8dd5e19
Removes outdated field form abstract connector
2021-05-11 13:20:17 -07:00
Mouse Reeve
e7c5b77b4c
Removes unused connector fields and adds active boolean
2021-05-11 09:54:04 -07:00
Mouse Reeve
a2621bce12
Fixes getting authors from work data
2021-04-30 15:48:52 -07:00
Mouse Reeve
485d20696b
Fixes loading inventaire data by language code
2021-04-30 12:50:35 -07:00
Mouse Reeve
8eec3eca5b
Don't spin out infinite load data tasks
2021-04-28 16:42:27 -07:00
Mouse Reeve
6551c59c45
Don't store default edition in the dataase
2021-04-28 16:05:17 -07:00
Mouse Reeve
3faacffaca
Associated expanded editions with correct work
2021-04-28 13:28:07 -07:00
Mouse Reeve
7b65291a59
Python formatting for the new Black standard
2021-04-26 14:43:29 -07:00
Mouse Reeve
64c2313a5d
Merge branch 'main' into inventaire
2021-04-26 14:22:05 -07:00
Mouse Reeve
3ade2d3bb1
New version of black, new whitespace
2021-04-26 09:15:42 -07:00
Mouse Reeve
1903812b1d
Class method for checking if urls are blocked
2021-04-10 11:44:29 -07:00
Mouse Reeve
63d37c281d
Handle invalid authors when importing books
2021-04-07 08:59:33 -07:00
Mouse Reeve
4112862924
Fixes search data and new activitypub fields
2021-04-06 18:00:54 -07:00
Mouse Reeve
82c2f2eeb1
Adds more author identifier fields
2021-04-06 17:46:06 -07:00
Mouse Reeve
22ebe60c0a
Use custom data extractor for inventaire connector
2021-04-06 12:29:06 -07:00
Mouse Reeve
fba44206ac
Adds separate view and load links for book search results
2021-04-06 12:17:58 -07:00
Mouse Reeve
d482c66ad4
Adds inventaire connector stub
...
And changes formatters to accept the key as well as value
2021-04-06 11:58:07 -07:00
Mouse Reeve
05fcfbc66f
Show more data about books in search
2021-03-13 13:55:20 -08:00
Mouse Reeve
393ea625a2
Merge pull request #726 from mouse-reeve/search-tests
...
Search tests
2021-03-13 09:27:46 -08:00
Mouse Reeve
d3b1941eaa
Uses get_data helper in isbn search (plus test)
2021-03-13 09:07:19 -08:00
