Commit graph

769 commits

Author SHA1 Message Date
Zed
51c6605d3f Fix Twitter link replacements
Fixes #492
2021-12-30 05:11:05 +01:00
Zed
d96550fcce Minor code improvements 2021-12-30 04:18:40 +01:00
Zed
eed4d4033f Add canonical header to help search engines
Fixes #472
2021-12-30 04:17:58 +01:00
Zed
173dd8f016 Merge branch 'nicer-rss' 2021-12-30 02:22:39 +01:00
Zed
dcac7e4a26 Simplify default preferences handling
Closes #441
2021-12-30 02:10:42 +01:00
Zed
7590dc1cda Remove hardcoded replaceYouTube config fallback 2021-12-30 01:55:55 +01:00
Zed
80f7bc0a02 Cleanup 2021-12-30 01:48:48 +01:00
Zed
b0a5e38b3f Merge branch 'intent-userid' 2021-12-30 01:45:41 +01:00
Zed
ddc2be8439 Make gzip handling more robust 2021-12-30 01:39:00 +01:00
Zed
e3f6c72bf6 Skip list request if ID is empty 2021-12-29 08:03:00 +01:00
Zed
5e0eb02422 Improve withheld tweet rendering 2021-12-29 06:41:00 +01:00
Zed
ab94d9eb7d Bump css version 2021-12-29 06:25:52 +01:00
Zed
fb10bfc5e3 Revert breaking css change 2021-12-29 06:25:19 +01:00
jackyzy823
52af6b2746 Implement user_id to screen_name router 2021-12-28 09:30:55 +01:00
Zed
ebffb6d251
Merge pull request #443 from jackyzy823/proxy
Add proxy for outgoing request
2021-12-28 08:20:54 +01:00
Zed
c09a8d87d9 Attempt to fix occasional cursor error 2021-12-28 08:18:44 +01:00
jackyzy823
6aa913ad62 Add http proxy config 2021-12-28 07:49:49 +01:00
Zed
aa2fed19d7 Skip search requests when query is empty 2021-12-28 07:35:35 +01:00
Zed
1e1e034237 Improve Twitter regex 2021-12-28 07:01:52 +01:00
Zed
0a8fd2fce2 Improve enableRSS logic 2021-12-28 06:21:22 +01:00
Zed
9b202e414b Merge branch 'config-rss-toggle' 2021-12-28 06:18:21 +01:00
Zed
99d3c46af5 Improve API error handling 2021-12-28 05:41:41 +01:00
Zed
6bcbe0ea9f Handle decompression errors 2021-12-28 05:13:47 +01:00
Zed
4b356118a6 Bump css version 2021-12-27 18:20:33 +01:00
Zed
3f201ba846 Improve preferences page 2021-12-27 18:18:40 +01:00
Zed
3259223c9c Add more license headers 2021-12-27 02:43:27 +01:00
Zed
73b5b60ac3 Add license headers
Closes #413
2021-12-27 02:37:38 +01:00
Zed
9e413e1f8c Rename replaceUrl to replaceUrls 2021-12-27 02:27:49 +01:00
Zed
38df06e8f5 Add more link replacements to RSS preferences 2021-12-27 02:22:31 +01:00
Zed
3c45630062 Add Reddit link replacement support
Closes #306
Closes #353
2021-12-27 02:22:10 +01:00
Zed
91c0e032ee Avoid unnecessary string allocations in replaceUrl 2021-12-27 00:42:52 +01:00
Zed
a8c541954c Improve twitter.com regex string
Closes #236
Closes #237
Closes #304
2021-12-27 00:42:45 +01:00
Zed
5e5e290acc Revert "Use match instead of find, minor performance gain"
This reverts commit 759728e363.
2021-12-27 00:10:42 +01:00
Zed
759728e363 Use match instead of find, minor performance gain 2021-12-27 00:03:52 +01:00
Zed
df41405251 Fix misc Lighthouse complaints 2021-12-26 23:26:50 +01:00
Zed
a7e0f817c9 Replace Frosty with Flatty for de/serialization 2021-12-26 23:01:19 +01:00
Zed
ca867be915 Fix Redis migration logic 2021-12-26 23:00:47 +01:00
Zed
4dab817521 Minor cleanup 2021-12-26 06:55:58 +01:00
Zed
3da6c50cb8 Use gzip for API calls to lower bandwidth and RAM 2021-12-26 06:49:27 +01:00
Zed
5e49e94bf1 Refactor "withheld" parsing 2021-12-26 06:48:55 +01:00
Zed
2a40dd8059 Skip rail request if profile is protected 2021-12-26 05:02:57 +01:00
Zed
5b185c79de Improve token management logic 2021-12-20 04:19:11 +01:00
Zed
7af71ec480 Fix compiler warnings 2021-12-20 04:18:44 +01:00
alqeeu
89591b06bf
Fix user search parser (#483) 2021-12-19 21:28:13 +01:00
Rusty Bird
25191f7c40
Fix unescaped dot in Instagram regex (#471)
Similar to edb3751181 (#109)
2021-11-26 22:49:44 +01:00
jackyzy823
68136de07b
add new card kind, and do not raise error for unknown card kind (#467) 2021-11-20 23:12:33 +01:00
Timothy Bautista
2edf54d5b3 Add enableRSS setting in config file
Useful for instance owners who want to disable the RSS endpoint for
reasons such as abuse and not enough server resources to handle heavy
network traffic through that endpoint.

Resolves #437
2021-10-02 13:15:52 -06:00
mooons
5caf77481f
Add tweet card image (if any) to the timeline RSS feed. (#438) 2021-09-28 09:27:13 +02:00
alefvanoon
13a4580ce2
Add dir="auto" to Searchbox (#434) 2021-09-06 10:43:19 +02:00
Vítor
cf47c1b8ad
Handle withheld tweets (#429)
* Handle withheld tweets

* Fix format of parser.nim
2021-08-21 17:13:38 +02:00
Vítor
fd384ff33e
Add support for redis authentication (#420)
* Add support for redis authentication (Update redpool dependency)
 - Add configuration option `redisPassword`

* Reference `redisPassword` in nitter.conf
2021-08-07 00:53:16 +02:00
Faye Duxovni
9c19e70a03 truncate tweet text for titles of rss feed items 2021-07-21 19:05:01 -04:00
Faye Duxovni
26842fa0bf render linebreaks in tweets properly in RSS 2021-07-21 19:05:01 -04:00
Zed
df9f90f99c Fix http pool usage to prevent rate limit error 2021-07-18 03:36:27 +02:00
Zed
e183a9c789 Use replaceYouTube from config in rss
Fixes #372
2021-07-18 02:35:24 +02:00
Zed
2422a2b8b7 Default to Piped instead of Invidious 2021-07-18 02:15:22 +02:00
Ryan Koppenhaver
669aa2cd8b
parse token from int or str (#405) 2021-07-01 14:33:40 +02:00
3nprob
a859943871
Expand configuration (#368)
* Allow configuring httpMaxConns

default: 100

* Allow setting NITTER_CONF_FILE path env var

Co-authored-by: 3nprob <3nprob@3nprob>
2021-06-23 23:17:16 +02:00
Daveed9
46cf3e3a91
Changed procedure getRfc822Time to comply with RSS 2.0 spec (#404)
Co-authored-by: David Robinson <daveed@mailbox.org>
2021-06-23 23:15:51 +02:00
Mennaruuk
7a01f55dd3
Add "audiospace = "audiospace"" (#401)
To fix #390, at least temporarily.
2021-06-23 23:15:41 +02:00
decoy-walrus
15e1ba1322
Hack in support for the new twitter video format (#381)
This change adds ".m4s" and ".mp4" to the regex that modifies m3u8 playlist files proxied from twitter, and adds ".m4s" to the list of extensions proxied through nitter. The net effect is the new video format that twitter is using now should be supported.
2021-05-08 18:05:31 +02:00
Zed
4a38b270af Don't release empty tokens 2021-01-25 11:07:29 +01:00
Zed
67142bea6a Don't discard tokens on length errors 2021-01-25 11:04:36 +01:00
Zed
67e15bb492 Temporary (?) fix for false rate limits 2021-01-18 07:57:39 +01:00
Zed
51b1567af6 Improve token pool to prevent rate limits 2021-01-13 14:32:26 +01:00
Zed
e1b3e9db76 Add proper http support
Fixes #223
2021-01-08 02:36:06 +01:00
Zed
ecc8bc5a95 Slightly lower main tweet font size 2021-01-08 01:28:27 +01:00
Zed
ed7ecf7c8d Preload profile/tweet images, banners, and icons 2021-01-08 00:50:10 +01:00
Zed
768642a2cc Improve link preview headers 2021-01-07 23:58:29 +01:00
Zed
4e1d213488 Show error page when rate limited 2021-01-07 22:31:29 +01:00
Zed
2128b280b4 Minor cleanup 2021-01-07 22:04:19 +01:00
Zed
384b0a2033 Fix profile caching logic to ignore empty profiles 2021-01-07 22:04:01 +01:00
Zed
cd4840363c Split IDs into buckets to reduce Redis mem usage 2021-01-03 03:51:15 +01:00
Zed
b3b0654507 Use preloads and defer to speed up page loads 2021-01-03 01:39:23 +01:00
Zed
18988a6a55 Slightly lower Nitter navbar font size 2021-01-03 01:39:23 +01:00
Zed
93ec4b1e39 Fix max gif height 2021-01-02 20:11:02 +01:00
Zed
ced729c6d5 Limit height of card images 2021-01-02 19:27:49 +01:00
Zed
c327f4cc06 Downgrade Frosty again to prevent OOM
It works, let's not fuck with it any more than necessary.
2021-01-02 19:27:11 +01:00
Zed
680cc429d6 Update frosty, add migration 2020-11-15 20:18:13 +01:00
Zed
7ad6f581c2 Simpler gif fix 2020-11-15 18:11:22 +01:00
Zed
8912985beb Update css version query 2020-11-15 18:04:52 +01:00
Zed
0d4048a62e Fix inline gif regression 2020-11-15 18:03:51 +01:00
Zed
320cb47bce Switch to supersnappy, update frosty 2020-11-15 01:21:56 +01:00
Zed
3b5b4b7682 Improve tweet url and hashtag parsing 2020-11-15 01:03:04 +01:00
Zed
50218bcc4d Revert "Improve tweet url and hashtag parsing"
This reverts commit d67ed26817.
2020-11-14 23:37:07 +01:00
SolitudeSF
d67ed26817 Improve tweet url and hashtag parsing
Dry

Fixes
2020-11-14 23:28:22 +01:00
SolitudeSF
cad75845db Fix compilation error with nim 1.4.0 2020-11-10 15:55:41 +01:00
SolitudeSF
48aa8d8e48 Replace spaces in list name 2020-11-10 15:54:08 +01:00
Zed
1d0f95b79d Fix card video preview 2020-11-09 21:24:34 +01:00
Zed
af634231b9 Support card previews 2020-11-09 21:20:33 +01:00
bopol
ed91133b21 Change order of quoted replies 2020-11-08 13:32:18 +01:00
Zed
104dc95bd7 Fix quote video size 2020-11-08 04:30:38 +01:00
Zed
0ef85031a7 Add version query to css to force updates 2020-11-08 03:15:51 +01:00
Zed
4610ec6122 Increase user search avatar resolution 2020-11-08 03:09:40 +01:00
Zed
0f72b64ce2 Increase tweet avatar resolution 2020-11-08 02:56:06 +01:00
Zed
b389723bf5 Reduce main tweet font size on mobile 2020-11-08 02:50:03 +01:00
Zed
b6a49fc4cb Support quoted replies stat, update font 2020-11-08 02:21:58 +01:00
Zed
82fe5d8b78 Make bidirectional support a preference
Fixes #270
2020-11-08 00:41:12 +01:00
Zed
13bdd6497b Support bidirectional quote text 2020-11-08 00:06:37 +01:00
Zed
d358912790 Sanitize XML to remove invalid characters
Fixes #268
2020-11-07 23:53:49 +01:00
Zed
375cb1a243 Fix removal of logging on release 2020-11-07 23:16:47 +01:00
Zed
9f5042dbd3 Add missing entry type to entryId parser 2020-11-07 23:10:29 +01:00
Zed
3107ab0ab8 Fix content-length crash 2020-11-07 23:02:27 +01:00
Zed
2d7e12fcb8 Fix parsing censored tweets 2020-11-07 22:48:49 +01:00
Zed
509e1dc5e8 Remove leftover from wip stuff 2020-11-07 22:48:30 +01:00
Zed
bd97cea709 Update dependencies 2020-11-07 21:46:03 +01:00
Zed
3bd0488c66 Add http pool to reduce connection overhead 2020-11-07 21:31:03 +01:00
Zed
06f7a8d95f Fix parsing "Show more" without digits 2020-10-01 22:08:25 +02:00
110Percent
2c6cabb4ab Add image card for better third-party embedding 2020-08-21 16:07:55 +02:00
jtagcat
75fea828cb Change the default invidio.us (EoL) to snopyta's. 2020-08-21 15:49:16 +02:00
Kadin Buckton
e177759722 Fix firefox image sizes 2020-07-18 23:28:13 +02:00
Zed
514d1b3121 Add temporary token fail safe 2020-07-09 09:18:36 +02:00
Zed
38d4ba6298 Add liberapay logo 2020-07-04 13:20:54 +02:00
Zed
613e460b9e Add activate endpoint 2020-06-24 15:03:18 +02:00
Zed
4c1270b377 Use old API endpoint to fetch tokens 2020-06-24 15:02:34 +02:00
Zed
bde3c3662d Silence some warnings 2020-06-22 03:50:16 +02:00
Zed
db100bbf17 Temporary fix to prevent early token expiry 2020-06-19 09:45:24 +02:00
Zed
91f42c4c94 Nevermind. 2020-06-17 20:55:01 +02:00
Zed
51c7af082d We no longer know whether profiles are suspended 2020-06-17 17:19:08 +02:00
Zed
bc0ccb483a New query rules, big multi-user query optimization 2020-06-17 14:16:48 +02:00
Zed
2127af71b4 Partial fix for wrong multi-user twitter link 2020-06-17 14:15:13 +02:00
Zed
33f0ab0ba5 Always show retweets unless excluded in search 2020-06-17 14:12:38 +02:00
Zed
0e58c36bae Change user endpoint 2020-06-17 00:22:11 +02:00
Zed
77da2e32c6 Use old api to optimize photo rails 2020-06-17 00:20:34 +02:00
Zed
7e40af5611 Revert token change 2020-06-16 00:48:44 +02:00
Zed
6167e7dc49 Refactor fetch helper, fix list pagination 2020-06-15 16:44:14 +02:00
Zed
7643293f6b Fix tombstone parsing
Apparently they just got rid of the "epitaph", oh well
2020-06-12 08:01:31 +02:00
Zed
bd386b3acf Proper support for gif avatars
Fixes #160
2020-06-10 18:34:56 +02:00
Zed
e4cbbf2fd5 Show retweet and reply usernames in rss titles
Fixes #185
2020-06-10 17:52:21 +02:00
Zed
07492b7b39 Escape rss titles
Fixes #168
2020-06-10 17:17:17 +02:00
Zed
1811a23265 Parse alternative video title 2020-06-10 17:09:38 +02:00
Zed
179b3bc496 Parse video profile 2020-06-10 17:06:05 +02:00
Zed
4f6b8bad9e Lower avatar resolutions 2020-06-10 17:05:44 +02:00
Zed
754f88a448 Show avatars in quotes, improve css 2020-06-10 17:04:48 +02:00
Zed
0c9c37e886 Support even more obscure card types 2020-06-10 16:19:01 +02:00
Zed
09b85464bd Reenable logging for non-release builds 2020-06-09 20:29:05 +02:00
Zed
61d27efd69 Optimize profile caching strategy 2020-06-09 18:19:20 +02:00
Zed
ba9ba3a55e Add cookie note so we don't break the law 2020-06-09 17:01:30 +02:00
Zed
db45433ec4 Optimize usage of cookie preferences 2020-06-09 16:45:21 +02:00
Zed
310c5e936d Optional base64 support for proxy urls 2020-06-09 15:22:58 +02:00
Zed
1b9fa40237 Silence Jester's query warning 2020-06-07 09:28:56 +02:00
Zed
908da72ba9 Use frosty instead of msgpack, compress everything 2020-06-07 08:50:40 +02:00
Zed
a8553db66e Use small video previews 2020-06-07 08:40:17 +02:00
Zed
40ef23956a Catch connection closed errors 2020-06-07 08:23:05 +02:00
Zed
9c8c2cbe88 Use small image version for preview to save memory 2020-06-07 07:57:32 +02:00
Zed
34dd02df1b Add photo rail test 2020-06-07 07:57:15 +02:00
Zed
47c87f7068 Strip https://pbs.twimg.com from image urls 2020-06-07 07:55:57 +02:00
Zed
ea7222bc86 Optimize photo rail parser 2020-06-07 07:54:20 +02:00
Zed
be74cec48a Refactor instruction parsing 2020-06-07 07:53:40 +02:00
Zed
67313ac12a Use regex for hashtags instead 2020-06-06 10:28:55 +02:00
Zed
181ef3bca7 Use snappy for rss compression, refactor 2020-06-06 09:27:25 +02:00
Zed
68a5ac20b6 Proxy media instead of using file cache 2020-06-06 04:39:22 +02:00
Zed
1dcb191903 Improve quote css 2020-06-05 16:58:06 +02:00
Zed
2fe0d8daae Fix wrong error message when rss timeline is empty 2020-06-05 16:49:30 +02:00
Zed
1fecd63d78 Skip photo rails for rss 2020-06-05 16:49:10 +02:00
Zed
2a654ea5cd Fix missing search params in rss cache 2020-06-05 16:29:22 +02:00
Zed
1a9e5a6c72 Fix user search pagination 2020-06-05 00:11:05 +02:00
Zed
3ecda47c73 Improve hashtag regex
Fixes #178
2020-06-04 23:14:31 +02:00
Zed
240a6f9fd3 Fix poll percentages when 0 votes
Fixes #177
2020-06-04 22:56:14 +02:00
Zed
42421e58de Fix tweet ID parsing bug on 32-bit 2020-06-04 05:03:25 +02:00
Zed
f0db3a8bc2 Don't cache empty profile 2020-06-03 07:49:32 +02:00
Zed
22b0bce1ea One more time 2020-06-03 02:42:26 +02:00
Zed
85d972dc36 Add it back fully 2020-06-03 02:41:37 +02:00
Zed
a7e969e397 Add back promo_video_website
Doesn't exist when you search for it, but apparently it does exist.
2020-06-03 02:38:04 +02:00
Zed
4d650fd33e Support more cards, even the undocumented ones 2020-06-03 02:33:34 +02:00
Zed
b4fe3d1f6a Prevent unnecessary profile cache 2020-06-03 00:03:41 +02:00
Zed
d01f62c5ae Clean up cache code 2020-06-02 23:06:14 +02:00
Zed
9ad458ae25 Fix Twitter link for searches 2020-06-02 22:31:46 +02:00
Zed
548cb62ff2 Fix very strange cache bug
This happened once and I have no idea why, but it shouldn't cause a crash.
2020-06-02 22:15:04 +02:00
Zed
77f03425ef Preserve original UTC timestamp 2020-06-02 22:02:10 +02:00
Zed
3dc85639f4 Fix crash on token fetch failure 2020-06-02 20:37:55 +02:00
Zed
7acea6b9e0 Add user agent for media requests, improve error 2020-06-02 20:27:43 +02:00
Zed
80d963fab6 Fix crash when disk is full 2020-06-02 19:58:24 +02:00
Zed
2930293833 Fix relative timestamps 2020-06-02 19:30:31 +02:00
Zed
e453d9dd59 Add yet another card type 2020-06-02 18:05:54 +02:00
Zed
fb591e43b8 Switch to packedjson to try lowering memory usage 2020-06-02 18:05:54 +02:00
Zed
2fa76db099 Simplify error parser 2020-06-02 18:05:54 +02:00
Zed
2642e5efe4 More aggressive token strategy to combat bursts 2020-06-02 18:05:54 +02:00
Zed
baa28ea8bc Prevent crash when token missing 2020-06-02 18:05:54 +02:00
Zed
87d1e49f1a Remove unnecessary table 2020-06-02 18:05:54 +02:00
Zed
12fb55745d Quit with return code to indicate error 2020-06-02 18:05:54 +02:00
Zed
e0943eeec8 Minor optimizations 2020-06-02 18:05:54 +02:00
Zed
1fb78f8047 Minor token changes 2020-06-02 18:05:54 +02:00
Zed
dc79f736d0 Minor quote gif css improvement 2020-06-02 18:05:54 +02:00
Zed
01faa784ea Add Redis connection error message 2020-06-02 18:05:54 +02:00
Zed
4a43209386 Update readme 2020-06-02 18:05:54 +02:00
Zed
43e87f5174 Expand "bounced" tombstone match 2020-06-02 18:05:54 +02:00
Zed
10277bb58d More card kinds 2020-06-02 18:05:54 +02:00
Zed
74534e8fef Use old user endpoint to avoid graphql rate limits 2020-06-02 18:05:54 +02:00
Zed
39863703b3 Error stuff 2020-06-02 18:05:54 +02:00
Zed
0859d8c2d9 Add missing card kinds (specific parsers pending) 2020-06-02 18:05:54 +02:00
Zed
a2c0e1a21d Add missing tombstones 2020-06-02 18:05:54 +02:00
Zed
21fdbb88ec Fix RSS retweet rendering 2020-06-02 18:05:54 +02:00
Zed
1cb57401b6 Ignore trailing slashes for list routes 2020-06-02 18:05:54 +02:00
Zed
2a3bcaa9aa Fix retweet deduplication 2020-06-02 18:05:54 +02:00
Zed
ec86a55b48 Fix timestamp parsing in non-UTC timezones
Twitter always has +0000 in the timestamp despite being relative
to your IP geolocation. Shame on you, Twitter.
2020-06-02 18:05:54 +02:00
Zed
177e119441 Hotfix missing card type 2020-06-02 18:05:54 +02:00
Zed
e1fff6985b New configs 2020-06-02 18:05:54 +02:00
Zed
81d6d1ac7f Misc. changes 2020-06-02 18:05:54 +02:00
Zed
4c928fa8b0 Routing updates 2020-06-02 18:05:54 +02:00