Jeremy Benoist
6acadf8e98
Rewrote code & fix tests
2017-06-01 11:31:45 +02:00
Jeremy Benoist
d5c2cc54b5
Fix tests
2017-06-01 09:49:15 +02:00
Jeremy Benoist
432a24f502
CS
2017-06-01 09:48:14 +02:00
Jerome Charaoui
704803e182
Replace Wallabag v1 error strings with v2 strings
2017-06-01 09:48:14 +02:00
Jerome Charaoui
d0e9b3d640
Add disableContentUpdate import option
...
This commit also decouples the "import" and "update" functions inside
ContentProxy. If a content array is available, it must be passed to the
new importEntry method.
2017-06-01 09:48:14 +02:00
Jerome Charaoui
7aba665e48
Avoid returning objects passed by reference.
...
Objects are always passed by reference, so it doesn't make sense to
return an object which is passed by reference as it will always be the
same object. This change makes the code a bit more readable.
2017-06-01 09:43:01 +02:00
Jeremy Benoist
7a8ed3cee1
Add support for tag in Instapaper import
2017-05-31 10:38:00 +02:00
Nicolas Lœuillet
7aa5607f29
Merge pull request #3143 from wallabag/fix-wllbg2-import
...
Fixed is_starred for wallabag v2 import
2017-05-31 09:08:34 +02:00
Jeremy Benoist
047fdc767a
Add tests
2017-05-30 20:27:44 +02:00
Thomas Citharel
5d3deafd3e
CS
...
Signed-off-by: Thomas Citharel <tcit@tcit.fr>
2017-05-28 01:16:01 +02:00
Thomas Citharel
6bc6fb1f60
Move Tags assigner to a separate file
...
Signed-off-by: Thomas Citharel <tcit@tcit.fr>
2017-05-27 22:08:14 +02:00
Nicolas Lœuillet
4c707d087b
Fixed is_starred for wallabag v2 import
2017-05-24 15:36:41 +02:00
Nicolas Lœuillet
bb98fede2b
Fixed imports with is_starred and is_archived
2016-12-07 16:01:50 +01:00
Jerome Charaoui
3cd6da0b74
Allow fetching content on all import types
...
For better consistency, allow all types of imported entries to update,
which was already the case for Firefox and Chrome.
2016-12-03 00:12:20 -05:00
Jerome Charaoui
36e6ef52a1
Imported entries which fail to fetch get standard error body
2016-12-02 22:42:36 -05:00
Jeremy Benoist
9ab024b4f5
Add Pinboard import
2016-11-04 22:44:31 +01:00
Jeremy Benoist
e46fdf3096
CS
2016-11-02 07:26:14 +01:00
Jeremy Benoist
7816eb622d
Add entry.saved event to import & rest
2016-11-02 07:10:23 +01:00
Jeremy Benoist
5453500458
Requeue depending on producer
...
Browser import can requeue message from `parseEntry` but we should take care of the way import are handled (depending on the producer)
2016-10-20 21:17:45 +02:00
Jeremy Benoist
c7ea9b41f3
Add controller test for Instapaper
2016-09-27 20:27:08 +02:00
Jeremy Benoist
ff1a5362f7
Add Instapaper import
...
Also update ImportController with latest import (chrome, firefox & instapaper).
2016-09-27 20:27:08 +02:00
Jeremy Benoist
d6de23a100
Merge pull request #2192 from wallabag/import-browser-bookmarks
...
Import Firefox & Chrome bookmarks into wallabag
2016-09-26 14:47:02 +02:00
Jeremy Benoist
990adfb34c
Move prepareEntry to dedicated place
...
Yeah first try was ugly, now each part are in the dedicated place.
Also, the date is hardly truncated to 10 chars because Firefox date are 16 chars long and Chrome are 17 chars long. So instead of divised them by a huge number, I prefer to truncate them.
2016-09-26 07:30:02 +02:00
Jeremy Benoist
12d93e6896
Update Firefox file
...
With real data, the previous looks more than a Chrome converted file.
Also, fix date conversion (hope so).
2016-09-25 22:24:07 +02:00
Jeremy Benoist
27acc6ddb8
Fix bad date format in Browser import
2016-09-25 15:32:02 +02:00
Nicolas Lœuillet
bd206a84d8
Fixed tests by removing clear()
2016-09-25 12:29:19 +02:00
Thomas Citharel
64b1229b2d
fix tests
2016-09-25 12:29:19 +02:00
Thomas Citharel
2c61db30b7
cs & fixes
2016-09-25 12:29:19 +02:00
Thomas Citharel
59201088b4
bring chrome and firefox as separate imports
2016-09-25 12:29:18 +02:00
Nicolas Lœuillet
efe659ab84
Add Chrome path for Mac OS
2016-09-25 12:28:55 +02:00
Thomas Citharel
ae669126e7
Import Firefox & Chrome bookmarks into wallabag
2016-09-25 12:28:54 +02:00
Jeremy Benoist
401135852c
Use scheduled entity insertions to avoid tag duplicate
...
Using `getScheduledEntityInsertions()` we can retrieve not yet flushed but already persisted entities and then avoid tags duplication on import.
2016-09-25 12:03:49 +02:00
Jeremy Benoist
59b97fae99
Avoid losing entry when fetching fail
...
Instead of just say “Failed to save entry” we’ll save the entry at all cost and try to fetch content. If fetching content failed, the entry will still be saved at least, but without content.
2016-09-17 07:40:56 +02:00
Jeremy Benoist
fbb319f064
Missing some migrations
...
and CS
2016-09-16 22:58:33 +02:00
Jeremy Benoist
ebe0787e09
Moved Pocket token to user config
2016-09-16 22:22:25 +02:00
Jeremy Benoist
c80cc01afa
Change flash message for queued articles
2016-09-13 21:09:05 +02:00
Jeremy Benoist
b3437d58ae
Enable Redis async import
...
- using javibravo/simpleue
- internal config value are now `import_with_redis` & `import_with_rabbit` which are more clear
- if both option are enable rabbit will be choosen
- services imports related to async are now splitted into 2 files: `redis.yml` & `rabbit.yml`
-
2016-09-11 21:58:56 +02:00
Jeremy Benoist
7f7531171f
Retrieve created date from Pocket
2016-09-11 21:58:56 +02:00
Jeremy Benoist
13470c3596
Add test for RabbitMQ
...
Also update Symfony deps
2016-09-11 21:58:56 +02:00
Jeremy Benoist
8664069e1a
Fix DateTime & clear()
2016-09-11 21:58:55 +02:00
Jeremy Benoist
6d65c0a8b0
Add ability to define created_at for all import
...
At the moment only Readability & wallabag v2 import allow created_at import.
Pocket removed `time_added` field from their API v2 to v3...
And wallabag v1 doesn't export that value.
2016-09-11 21:58:55 +02:00
Jeremy Benoist
3aca0a9f00
CS
2016-09-11 21:58:55 +02:00
Jeremy Benoist
3849a9f323
Some cleanup & refactor
2016-09-11 21:58:55 +02:00
Jeremy Benoist
02f6489572
Retrieve all items from Pocket
...
5000 by 5000.
Also, retrieve newest item first.
2016-09-11 21:58:31 +02:00
Jeremy Benoist
c98db1b653
Convert other imports to Rabbit
2016-09-11 21:58:31 +02:00
Jeremy Benoist
ef75e1220e
Send every imported item to the queue
...
Instead of queing real Entry to process, we queue all the item to import from Pocket in a raw format.
Then, the worker retrieve that information, find / create the entry and save it.
2016-09-11 21:57:46 +02:00
Nicolas Lœuillet
40d2a29443
Replace RabbitMQ injection with CraueConfiguration
2016-09-11 21:57:09 +02:00
Nicolas Lœuillet
56c778b415
1st draft for rabbitMQ
2016-09-11 21:57:09 +02:00
Jeremy Benoist
88e88016b9
Clearing entities in the loop fail on Postgres
...
It looks like when you clear entities on Postgres some references are lost and tags are not saved :-/
2016-09-11 16:30:01 +02:00
Jeremy Benoist
58fadbc9df
Fix error on EntityManager clear
...
Introduced in the recent 2.5.5 release.
Also updated deps.
2016-09-11 15:53:16 +02:00
