gotosocial/internal/federation/dereferencing
kim acc95923da
[performance] processing media and scheduled jobs improvements (#1482)
* replace media workers with just runners.WorkerPool, move to state structure, use go-sched for global task scheduling

* improved code comment

* fix worker tryUntil function, update go-runners/go-sched

* make preprocess functions package public, use these where possible to stop doubled up processing

* remove separate emoji worker pool

* limit calls to time.Now() during media preprocessing

* use Processor{} to manage singular runtime of processing media

* ensure workers get started when media manager is used

* improved error setting in processing media, fix media test

* port changes from processingmedia to processing emoji

* finish code commenting

* finish code commenting and comment-out client API + federator worker pools until concurrency worker pools replaced

* linterrrrrrrrrrrrrrrr

---------

Signed-off-by: kim <grufwub@gmail.com>
2023-02-13 18:40:48 +00:00
..
account.go [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
account_test.go [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
announce.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
collectionpage.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
dereferencer.go [chore] small changes missed in previous dereferencer.GetAccount() PRs (#1467) 2023-02-10 20:15:23 +00:00
dereferencer_test.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
emoji.go [performance] processing media and scheduled jobs improvements (#1482) 2023-02-13 18:40:48 +00:00
emoji_test.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
error.go [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
finger.go [performance] Don't fetch avatar + header if uri hasn't changed (#1463) 2023-02-09 09:27:07 +01:00
handshake.go [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
instance.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
media.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
media_test.go [performance] media processing improvements (#1288) 2023-01-11 12:13:13 +01:00
status.go [chore] reformat GetAccount() functionality, support updating accounts based on last_fetch (#1411) 2023-02-03 20:03:05 +00:00
status_test.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00
thread.go [chore] Update/add license headers for 2023 (#1304) 2023-01-05 12:43:00 +01:00