Commit graph

60 commits

Author SHA1 Message Date
Joeri de Ruiter a901014e48 Change import of clean 2023-08-02 19:37:52 +02:00
Joeri de Ruiter ae5c27f3bb Sanitise description from Open Library 2023-08-02 19:30:40 +02:00
Joeri de Ruiter f4a4b59a14 Merge branch 'main' into markdown-import 2023-08-02 19:19:07 +02:00
Joeri de Ruiter 1a733746f2 Only remove surrounding p tags if there are no other p tags 2023-08-01 12:17:57 +02:00
Joeri de Ruiter 1a215e9b9e Convert description from Markdown to HTML when importing from Open Library 2023-08-01 11:45:46 +02:00
Joeri de Ruiter 2920973961 Some small improvements to annotations 2023-07-28 20:54:03 +02:00
Joeri de Ruiter f07d7b02f1 Type annotations and related changes for bookwyrm.connectors 2023-07-28 17:43:32 +02:00
Mouse Reeve e7b0a84ded
Merge pull request #2142 from bookwyrm-social/load-data-duration
Split expand book data task into per-edition tasks
2022-06-30 11:47:23 -07:00
Mouse Reeve d149e57494 Split expand book data task into per-edition tasks
Loading every edition in one task takes ages, and produces a large task
that clogs up the queue. This will create more, smaller tasks that will
finish more quickly.
2022-05-31 12:41:57 -07:00
Mouse Reeve 374fdcf467 Use relative list order ranking in openlibrary search
Set OpenLibrary search condifidence based on the provided result order,
just using 1/(list index), so the first has rank 1, the second 0.5, the
third 0.33, et cetera.
2022-05-31 10:22:49 -07:00
Mouse Reeve 83ee5a756f Filter intentaire results by confidence 2022-05-30 16:42:37 -07:00
Mouse Reeve 87fe984462 Combines search formatter and parser function
The parser was extracting the list of search results from the json
object returned by the search endpoint, and the formatter was converting
an individual json entry into a SearchResult object. This just merged
them into one function, because they are never used separately.
2022-05-30 12:52:31 -07:00
Mouse Reeve 9611815b44 Extract wikipedia and inventaire ids 2022-01-30 12:02:18 -08:00
Mouse Reeve 44dad43f36 Load new fields via connector 2022-01-30 11:41:33 -08:00
Mouse Reeve 4085714764 Update openlibrary author with ISNI 2021-12-05 13:26:22 -08:00
Mouse Reeve b824841cb3 Adds update logic to connectors 2021-12-05 12:47:27 -08:00
Mouse Reeve 5dd2aac600 Merge branch 'main' into search-refactor 2021-09-30 10:41:30 -07:00
Mouse Reeve 32391dd64d Python formatting 2021-09-29 12:38:31 -07:00
Mouse Reeve 0aef011258 Don't use the format detail if it maps directly 2021-09-29 12:29:17 -07:00
Mouse Reeve 123b23728f Infer format in openlibrary import 2021-09-29 12:21:19 -07:00
Mouse Reeve acfb1bb376 Updating string format synatx part 2 2021-09-18 11:32:00 -07:00
Mouse Reeve 18591c7b56 Fixes circular import 2021-09-16 11:30:04 -07:00
Mouse Reeve 1e9211018d Handle openlibrary redirects 2021-05-20 15:55:50 -07:00
Mouse Reeve 64c2313a5d Merge branch 'main' into inventaire 2021-04-26 14:22:05 -07:00
Mouse Reeve 3ade2d3bb1 New version of black, new whitespace 2021-04-26 09:15:42 -07:00
Mouse Reeve 63d37c281d Handle invalid authors when importing books 2021-04-07 08:59:33 -07:00
Mouse Reeve 82c2f2eeb1 Adds more author identifier fields 2021-04-06 17:46:06 -07:00
Mouse Reeve d482c66ad4 Adds inventaire connector stub
And changes formatters to accept the key as well as value
2021-04-06 11:58:07 -07:00
Mouse Reeve ad8257f8bd Formats changes 2021-03-13 14:04:41 -08:00
Mouse Reeve 05fcfbc66f Show more data about books in search 2021-03-13 13:55:20 -08:00
Mouse Reeve 76f1643269 Tests ignore edition openlibrary connector code
also removes print statements oops
2021-03-13 10:11:13 -08:00
Mouse Reeve 70296e760b Runs black 2021-03-08 08:49:10 -08:00
Henri Bourcereau 703ff60271 isbn search 2021-03-06 18:09:15 +01:00
Mouse Reeve 41cef9bdfd Catch expand book data load error 2021-02-10 17:54:49 -08:00
Mouse Reeve 661d49d9cc Ignore openlibrary editions with little to no metadata
Also fixes the isbn problem
2021-01-30 17:19:01 -08:00
Mouse Reeve ef42d29bd9 Discovery landing page 2021-01-03 11:10:04 -08:00
Mouse Reeve 86060f795d Updates tests 2021-01-02 08:55:42 -08:00
Mouse Reeve d828b0ead9 Remove books manager at long last 2021-01-02 08:14:28 -08:00
Mouse Reeve 03ed1cfa94 Small syntax changes in openlibrary connector 2020-12-31 11:03:30 -08:00
Mouse Reeve 171d09599c Fixes author path in openlibrary connector 2020-12-31 09:32:40 -08:00
Mouse Reeve c1e1bdac4b Fixes url formatting in openlibrary connector 2020-12-31 09:19:39 -08:00
Mouse Reeve ac261d7b1a Send connector with search result
also fix typo in get_work_from_edition_data function
2020-12-27 14:33:34 -08:00
Mouse Reeve c3d0e8e7f7 Fixes openlibrary import to prefer editions with covers 2020-12-21 11:47:47 -08:00
Mouse Reeve 3e61f48da2 Fixes loading more data 2020-12-19 16:16:39 -08:00
Mouse Reeve d3671d981f Use author activitypub in OL connector 2020-12-19 15:20:31 -08:00
Mouse Reeve 2128219b05 Use activitypub to_model de-serializer in openlibrary connector 2020-12-19 14:56:03 -08:00
Mouse Reeve 5cf9e24ae5 Fixes name import in openlibrary 2020-12-12 09:43:07 -08:00
Mouse Reeve c9433a3c7e Simplify bookwyrm connector abstract 2020-11-28 18:56:28 -08:00
Mouse Reeve 847014720e Refactors bookwyrm connector to use activitypub serializer 2020-11-24 16:05:00 -08:00
Mouse Reeve 0a2d762d3b Fixes error state when there are author duplicates
there shouldn't be, but it shouldn't crash a goodreads import either
2020-11-12 13:16:26 -08:00