Commit graph

45 commits

Author SHA1 Message Date
Zed 1ac389e7c7
GraphQL timeline (#812)
* Update deps

* Replace profile timeline with GraphQL endpoint

* Update GraphQL endpoint versions

* Use GraphQL for profile media tab

* Fix UserByRestId request

* Improve routing, fixes #814

* Fix token pool JSON

* Deduplicate GraphQL timeline endpoints

* Update list endpoints

* Use GraphQL for list tweets

* Remove debug leftover

* Replace old pinned tweet endpoint with GraphQL

* Validate tweet ID

* Minor token handling fix

* Hide US-only commerce cards

* Update config example

* Remove http pool and gzip from token pool

* Support tombstoned tweets in threads

* Retry GraphQL timeout errors

* Remove unnecessary 401 retry

* Remove broken timeout retry

* Update karax, use new bool attribute feature

* Update card test

* Fix odd edgecase with broken retweets

* Replace search endpoints, switch Bearer token

* Only parse user search if it's a list

* Fix quoted tweet crash

* Fix empty search query handling

* Fix invalid user search errors again
2023-04-21 14:41:30 +02:00
Zed 22b51b414b Fix typo to actually cache pinned tweets 2023-01-20 04:55:56 +01:00
Zed ff61d97a1d Optimize profile fetching and caching 2023-01-20 04:55:42 +01:00
Zed f10519c41a Minor RSS behavior improvements 2022-01-27 14:55:51 +01:00
Zed 091bb6813d Move RSS compression to Redis module, fix crash 2022-01-27 14:36:12 +01:00
Zed 27183f1a74 Use faster API to get pinned tweets 2022-01-23 07:45:01 +01:00
Zed 51ae076ea0 Rearchitect profile, support pins, Profile -> User 2022-01-23 07:23:09 +01:00
Zed a76ca3d60f Remove Redis pipelining 2022-01-20 02:22:32 +01:00
Zed f3d6f53f6d Rework profile cache behavior, fix suspended cache
Fixes #480
2022-01-16 20:32:45 +01:00
Zed 23f87c115a Add template to make Redis usage cleaner 2022-01-16 19:22:27 +01:00
Zed fcfc1ef497 Parse user stats as ints, not strings, cleanup 2022-01-16 03:32:18 +01:00
Zed ffcac982d0 Style fixes 2022-01-06 03:57:14 +01:00
Zed ab0c487778 Fix gallery caching to prevent redundant requests 2022-01-05 21:15:13 +01:00
Zed 74c4377198 More cleanup 2022-01-02 11:21:03 +01:00
Zed 9dd7419ecf Cleanup 2022-01-02 07:02:02 +01:00
Zed 5501752fdb Merge branch 'rework-list' 2021-12-30 20:51:24 +01:00
jackyzy823 a25bd0855b fix datetime fromFlatty 2021-12-30 13:30:12 +01:00
jackyzy823 35bb5f9132 Rework list api 2021-12-30 08:36:43 +01:00
Zed 80f7bc0a02 Cleanup 2021-12-30 01:48:48 +01:00
jackyzy823 52af6b2746 Implement user_id to screen_name router 2021-12-28 09:30:55 +01:00
Zed 73b5b60ac3 Add license headers
Closes #413
2021-12-27 02:37:38 +01:00
Zed a7e0f817c9 Replace Frosty with Flatty for de/serialization 2021-12-26 23:01:19 +01:00
Zed ca867be915 Fix Redis migration logic 2021-12-26 23:00:47 +01:00
Zed 7af71ec480 Fix compiler warnings 2021-12-20 04:18:44 +01:00
Vítor fd384ff33e
Add support for redis authentication (#420)
* Add support for redis authentication (Update redpool dependency)
 - Add configuration option `redisPassword`

* Reference `redisPassword` in nitter.conf
2021-08-07 00:53:16 +02:00
Zed 384b0a2033 Fix profile caching logic to ignore empty profiles 2021-01-07 22:04:01 +01:00
Zed cd4840363c Split IDs into buckets to reduce Redis mem usage 2021-01-03 03:51:15 +01:00
Zed c327f4cc06 Downgrade Frosty again to prevent OOM
It works, let's not fuck with it any more than necessary.
2021-01-02 19:27:11 +01:00
Zed 680cc429d6 Update frosty, add migration 2020-11-15 20:18:13 +01:00
Zed 320cb47bce Switch to supersnappy, update frosty 2020-11-15 01:21:56 +01:00
Zed bde3c3662d Silence some warnings 2020-06-22 03:50:16 +02:00
Zed 77da2e32c6 Use old api to optimize photo rails 2020-06-17 00:20:34 +02:00
Zed 61d27efd69 Optimize profile caching strategy 2020-06-09 18:19:20 +02:00
Zed 1b9fa40237 Silence Jester's query warning 2020-06-07 09:28:56 +02:00
Zed 908da72ba9 Use frosty instead of msgpack, compress everything 2020-06-07 08:50:40 +02:00
Zed 181ef3bca7 Use snappy for rss compression, refactor 2020-06-06 09:27:25 +02:00
Zed 2a654ea5cd Fix missing search params in rss cache 2020-06-05 16:29:22 +02:00
Zed f0db3a8bc2 Don't cache empty profile 2020-06-03 07:49:32 +02:00
Zed b4fe3d1f6a Prevent unnecessary profile cache 2020-06-03 00:03:41 +02:00
Zed d01f62c5ae Clean up cache code 2020-06-02 23:06:14 +02:00
Zed 548cb62ff2 Fix very strange cache bug
This happened once and I have no idea why, but it shouldn't cause a crash.
2020-06-02 22:15:04 +02:00
Zed 12fb55745d Quit with return code to indicate error 2020-06-02 18:05:54 +02:00
Zed 01faa784ea Add Redis connection error message 2020-06-02 18:05:54 +02:00
Zed 74534e8fef Use old user endpoint to avoid graphql rate limits 2020-06-02 18:05:54 +02:00
Zed 762d00b21d In with the new 2020-06-02 18:05:54 +02:00