dullbananas
aa125bdd9d
Add update_schema_file.sh ( #5908 )
...
* Add update_schema_file.sh
* Bush formatting
2025-07-30 13:59:40 -04:00
dullbananas
eae7f1ba02
Speed up init in start_dev_db.sh using no-sync option ( #5888 )
2025-07-26 20:13:54 -04:00
Dessalines
a5b0475436
Fast history no background ( #5873 )
...
* Finishing up post and comment actions
* Adding community_actions.
* instance and person actions
* Fixing person_actions.
* Fixing down migrations
* Adding person_content_combined.
* Search combined.
* Aggregates tables.
* Dont rename old tables
* Fixing some constraints.
* Convert bigints to ints
* Forgot a bigint.
* Rest of i64 -> i32
* Adding actions id columns.
* Fixing connection config.
* Formatting smoosh up.sql
* Use current_date instead of now
* Adding history tables for liked_combined
* Upping wal size
* Fix clippy
* Fixing clippy.
* Fixing i64
* Getting rid of let mut conn
* Adding the history status table.
* Adding published indexes to speed up history.
* Adding comment like history scanning.
* Fixing schema options setup.
* post_read history
* person_post_aggregates / read_comments history
* post_like history
* Fixing conflicts.
* Fixing clippy.
* Use constant batch_size.
* person content combined post and comment history.
* Fixing id scanning.
* post/comment_actions -> saved_combined history
* search history
* Post and comment aggregates -> post / comment history.
* Uncommenting full history building.
* Changing DB_BATCH_SIZE to i64
* Fixing clippy.
* Fix index names.
* Fixing diff check by removing indexes.
* Adding the uplete ignore actions::id columns.
* Fixing merge imports.
* Fixing submodule update
* Try trigger disabling.
* Fix clippy
* Remove history table, do faster bulk inserts. Smoosh first.
Comments about how this fast insert is done is within smoosh comments.
* Adding some timings.
* Fast person content combined history
* Adding search_combined
* Fix person saved combined unique names
* person_liked_combined
* Remove-aggregates
* Fixing up.sql issues
* Re-building schema.rs
* Fixing down migrations.
* Removing history updating.
* Format sql.
* Move postgres logging to customPostgresql.conf
* Try using postgres 16-alpine in CI
* Speeding up add_report_count.
* speed up inbox_combined
* Speeding up remove_post_sort_type_enums
* Fixing post_sort_type
* Speeding up person votes
* Fixing wrong conn.
* Fixing broken migrations
* Remove comment.
* Make sure to re-index table after re-enabling indexes.
* Removing id columns from actions tables.
* Fixing down migrations.
* Using create table as for smoosh migration
* create_table as for person_content_combined.
* Fixing person_content_combined uniques
* create table as for search_combined
* create table as for liked_combined
* create table as for inbox_combined.
* Fixing a few score types.
* Fixing id positions.
2025-07-23 17:43:23 -04:00
dullbananas
df4a79f4b6
Allow running all migrations with minimal dependencies ( #5841 )
...
* move schema_setup to separate crate
* remove lemmy_utils dependency
* add db_schema_setup/src/main.rs
* fix diesel.toml
* run diesel print-schema
* fix replaceable_schema paths
* remove unneeded dependencies
* taplo format
* fix duplicated cfg(test) attribute
* move replaceable_schema to crates/db_schema_setup/replaceable_schema
* warn if lemmy_db_schema_setup can be used instead of lemmy_server
2025-07-11 09:36:42 +02:00
Dessalines
9ccd647e02
Fixing docker_update.sh script to not add context. ( #5820 )
...
* Fixing docker_update.sh script to not add context.
Use docker build from a higher level to not load massive context.
* Adding a custom postgresql for testing.
* Fixing docker update
* Fixing dir.
* Fix rust log
* Add bash / shell file format checking.
* Adding shfmt package.
* Running bash format.
* Fixing bash fmt.
* Fixing bash fmt 2.
* Adding pgtune note.
2025-06-26 09:48:39 +02:00
dullbananas
6accb4110d
Fix db_perf.sh ( #5815 )
...
* db_perf.sh
* get_option function
2025-06-22 11:56:10 -04:00
Nutomic
66540f1fe7
Delete scripts/ts_bindings_check.sh ( #5797 )
2025-06-17 11:20:58 -04:00
dullbananas
bb63eaa794
Improve migration diff check and fix old migrations ( #5204 )
...
* Update schema.rs
* rename
* stuff
* finish new implementation of schema_setup::run (not including revert, test, etc.)
* fmt
* refactor
* fix sql
* migriation run command
* use trigger on migrations table
* add Options with disable_migrations field for test
* rename to enable_forbid_diesel_cli_trigger
* fix
* fix merge
* diff_checker (partial)
* Revert "diff_checker (partial)"
This reverts commit 6709882e14
.
* Revert "Revert "diff_checker (partial)""
This reverts commit d4bdda5d11
.
* diff check
* improve schema diff
* timestamp replacement
* ignore column order
* remove fedi_name default
* stuff
* improve diff
* stuff
* attempt parallel pg_dump
* attempt 2
* Revert "attempt 2"
This reverts commit a909d2d643
.
* Revert "attempt parallel pg_dump"
This reverts commit 592a127954
.
* improve diff check
* finish fixing migrations
* stuff
* use advisory lock
* stuff
* Update lib.rs
* fmt
* fmt
* clippy
* Update diff_check.rs
* Update .woodpecker.yml
* Update lib.rs
* Update lib.rs
* Update lib.rs
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update lib.rs
* re-run ci
* fmt
* fmt
* Update .woodpecker.yml
* Update .woodpecker.yml
* create separate database in ci
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* try to fix env var
* Update diff_check.rs
* Remove condition that's not needed anymore
* clippy
* exclude views and fast tables
* revert some migration changes
* fix
* fmt
* re-attempt checking character after skipped trigger name, and make code less confusing
* fmt
* fix
* rerun ci
* rerun ci
* fix strip_prefix order
* fix weird big Cargo.lock change by running `git checkout upstream/main Cargo.lock` then letting it auto update again
* fix
* remove installation commands that were removed in main branch
* Revert "remove installation commands that were removed in main branch"
This reverts commit fd65234a76
.
* move create_database_user woodpecker step to make diff less weird
* Fix migration duplication caused by merge
* optimize
* Merge remote-tracking branch 'upstream/main' into new-migration-diff-check
* fmt
* Revert "fmt"
This reverts commit 7d5652945f
.
* Revert "Merge remote-tracking branch 'upstream/main' into new-migration-diff-check"
This reverts commit 28bb1c7497
.
* fmt
* move diff dependency to db_schema_file
* stuff
* revert some migration changes
* stuff
* refactor pair selection
* fix all migrations
* clippy
* stuff
* remove thing from removed dbg
* remove use of BTreeSet::difference
* trim_matching_chunks_at_beginning_and_end
* use sorted_unstable itertools method
* display_diffs
* use aho-corasick for chunk filtering
* fsync=off
* remove some unimportant optimizations
* Revert "remove some unimportant optimizations"
This reverts commit f8d88ddcce
.
* Revert "use aho-corasick for chunk filtering"
This reverts commit 6b1f3e4416
.
* remove some unimportant optimizations
* refactor diff_check.rs
* clippers
2025-06-16 11:35:41 -04:00
Dessalines
42bd941f35
Upgrading ts-rs, and adding feature flag ( #5777 )
...
* Upgrading ts-rs, and adding feature flag.
- Lets us remove all the ts-optionals on every field.
- Should speed up compilation, and this feature is only needed for
lemmy-js-client.
- Fixes #5741
* Removing ts_optional_fields from enums
* Updating translations.
* Fix tests
* Fixing translations
* Adding ts-rs feature to ts_bindings script
* Consolidating optional fields and export to one line.
* Dont export federation_queue_state
2025-06-12 16:30:48 +02:00
Nutomic
896e8f1896
Parallel sql format ( #5773 )
...
* Parallel sql format
* change image
* -q
* unformatted
* Revert "unformatted"
This reverts commit 22e79fe4c5
.
* -q
2025-06-11 16:35:41 -04:00
Dessalines
9250460b11
Add endpoint to get Liked / Disliked comments and posts. ( #5616 )
...
* migration
* update code
* tests
* triggers
* fix
* fmt
* clippy
* post aggregate migration
* changes for post aggregate code
* wip: update tests for post aggregate
* format
* fix partialeq
* trigger fix
* fix post insert trigger
* wip
* reorder
* fixes
* community aggregate migration
* update code
* triggers
* person aggregate migration
* person aggregate code
* person triggers
* test fixes
* fix scheduled task
* update api tests
* site_aggregates to local_site migration
* site_aggregates code changes
* triggers, tests
* more fixes
* Rename PersonPostAggregates to PostActions
* Merge local_user_vote_display_mode into local_user
* fix schema
* Extracting pagination cursor utils into a trait.
- Fixes #5275
* Refactoring to avoid stack overflows.
* Fixing api_common feature.
* Adding pagination for GetBannedPersons.
- Must come after #5424
- Fixes #2847
* Starting to work on removing rest of page / limit.
* Issues with community pagination.
* Rename the traits and paginationcursor::new
* remove duplicate fields
* remove "aggregates" from index names
* uncomment indices
* if count = 0
* Using combined trait.
* remove commentaggregates
* Fix triggers in remove aggregates tables pr (#5451 )
* prevent all db_schema test errors
* fix the delete_comments_before_post problem in a way that doesn't affect the returned number of affected rows
* remove unnecessary recursion checks and add comment to remaining check
* clean up
* Fixing SQL format.
* Update triggers.sql
* Update triggers.sql
* Update triggers.sql
* Update triggers.sql
* remove update of deleted column
---------
Co-authored-by: Dessalines <tyhou13@gmx.com>
* rename migration
* Fix migration errors
* Move community.hidden to visibility (fixes #5458 )
* Removing empty files.
* Fixing person_saved_combined. (#5481 )
* Remove comment and post specific action structs. #5473
* Doing reports
* fix up migration by dropping index
* also add enum variant `LocalOnlyPublic`, rename `LocalOnly` to `LocalOnlyPrivate`
fixes #5351
* fix column order in down.sql
* wip
* Moving blocks.
* Adding a few more views.
* more wip
* fixes
* migration for modlog
* fix migration
* Working views and schema.
* Fix ts_optionals.
* wip
* db_schema compiling
* make the code compile
* Merging from main.
* lint
* Fixing SQL format.
* fix down migration
* Fixing api tests.
* Adding field comments for the actions tables.
* Refactoring CommunityFollower to include follow_state
* fix test
* make hidden status federate
* ts attr
* fix
* fix api test
* Update crates/api/src/reports/post_report/resolve.rs
Co-authored-by: Nutomic <me@nutomic.com>
* Addressing PR comments
* Fix ts export.
* update api client
* review
* Extracting filter_not_hidden_or_is_subscribed (#5497 )
* Extracting filter_not_hidden_or_is_subscribed
* Cleanup.
* Cleanup 2.
* Remove follower_state_helper function.
* Cleaning up some utils functions.
* rename hidden to unlisted
* Updating lemmy-js-client.
* Fixing a few cases.
* Fixing list_banned.
* Starting to convert to lemmy results.
* Fixing vote_view.
* Close to finishing up errors.
* Got compiling.
* Remove tracing for CI.
* Removing unused errors.
* Fixing merge from main.
* lower_name community_view sort.
* Syntax errors.
* Removing rest of Result from db_schema, db_views.
* Finally compiling again.
* fmt.
* Subpath tries again.
* Adding some more indexes./
* Fixing shear.
* Fix keyword_blocks test.
* @dullbananas fixes to Subpath, fixing comment tests.
* sql fmt
* Fixing unused error.
* API test fixing
* Moving read_only_posts to its own endpoint, sorted by read date.
- Fixes #5505
* Adding endpoint to list hidden posts.
- Fixes #5607
* Adding a first_id helper function.
* Fixing api_common
* Adding a person/liked endpoint for posts and comments.
- Fixes #4499
* Get rid of old liked_only filters.
* Formatting sql.
* Clippy
* Fixing view tests.
* SQL fmt
* Addressing PR comments
* Addressing PR comments 1.
* Using id desc.
* Addressing PR comments 2.
* Removing the reverse_timestamp keys for the post table.
* Make community_title and community_lower_name indexes desc
* Remove featured_community from post sort
* Forgot to drop index.
* Addressing PR comments
* Fixing clippy.
* Adding person_local column to post_actions and comment_actions
* Fixing pg_format
* Fixing pg_format 2
* Revert "Adding person_local column to post_actions and comment_actions"
This reverts commit e5145d8b07
.
* Adding local person check to liked and saved combined.
* Formatting sql.
* Adding local check to migration.
* Addressing PR comments
* Try to add versioned pg_formatter 1
* Try to add versioned pg_formatter 2
* Try to add versioned pg_formatter 3
* Try to add versioned pg_formatter 4
* Moving back to correct location.
---------
Co-authored-by: Felix Ableitner <me@nutomic.com>
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2025-06-02 11:15:27 +02:00
Nutomic
6bcbfb0a51
Cleanup root folder of repo ( #5712 )
...
* Move dev_pgdata folder to target dir
* Move security.md to .github
* Move db sockets to target folder
* change db url
* remove releases.md
2025-05-30 04:35:43 -04:00
dullbananas
f3f3a69708
Fix dump_schema.sh ( #5714 )
2025-05-29 21:01:53 -04:00
Felix Ableitner
87cbc2f370
Version 1.0.0-alpha.5
2025-05-26 10:15:58 +02:00
Nutomic
f0a0036ab5
Move db_views crates into subfolder ( #5662 )
...
* Move db_views crates into subfolder
* fix tests
2025-05-07 05:05:52 -04:00
Dessalines
e431fce02e
Remove rest of page limit ( #5429 )
...
* migration
* update code
* tests
* triggers
* fix
* fmt
* clippy
* post aggregate migration
* changes for post aggregate code
* wip: update tests for post aggregate
* format
* fix partialeq
* trigger fix
* fix post insert trigger
* wip
* reorder
* fixes
* community aggregate migration
* update code
* triggers
* person aggregate migration
* person aggregate code
* person triggers
* test fixes
* fix scheduled task
* update api tests
* site_aggregates to local_site migration
* site_aggregates code changes
* triggers, tests
* more fixes
* Rename PersonPostAggregates to PostActions
* Merge local_user_vote_display_mode into local_user
* fix schema
* Extracting pagination cursor utils into a trait.
- Fixes #5275
* Refactoring to avoid stack overflows.
* Fixing api_common feature.
* Adding pagination for GetBannedPersons.
- Must come after #5424
- Fixes #2847
* Starting to work on removing rest of page / limit.
* Issues with community pagination.
* Rename the traits and paginationcursor::new
* remove duplicate fields
* remove "aggregates" from index names
* uncomment indices
* if count = 0
* Using combined trait.
* remove commentaggregates
* Fix triggers in remove aggregates tables pr (#5451 )
* prevent all db_schema test errors
* fix the delete_comments_before_post problem in a way that doesn't affect the returned number of affected rows
* remove unnecessary recursion checks and add comment to remaining check
* clean up
* Fixing SQL format.
* Update triggers.sql
* Update triggers.sql
* Update triggers.sql
* Update triggers.sql
* remove update of deleted column
---------
Co-authored-by: Dessalines <tyhou13@gmx.com>
* rename migration
* Fix migration errors
* Move community.hidden to visibility (fixes #5458 )
* Removing empty files.
* Fixing person_saved_combined. (#5481 )
* Remove comment and post specific action structs. #5473
* Doing reports
* fix up migration by dropping index
* also add enum variant `LocalOnlyPublic`, rename `LocalOnly` to `LocalOnlyPrivate`
fixes #5351
* fix column order in down.sql
* wip
* Moving blocks.
* Adding a few more views.
* more wip
* fixes
* migration for modlog
* fix migration
* Working views and schema.
* Fix ts_optionals.
* wip
* db_schema compiling
* make the code compile
* Merging from main.
* lint
* Fixing SQL format.
* fix down migration
* Fixing api tests.
* Adding field comments for the actions tables.
* Refactoring CommunityFollower to include follow_state
* fix test
* make hidden status federate
* ts attr
* fix
* fix api test
* Update crates/api/src/reports/post_report/resolve.rs
Co-authored-by: Nutomic <me@nutomic.com>
* Addressing PR comments
* Fix ts export.
* update api client
* review
* Extracting filter_not_hidden_or_is_subscribed (#5497 )
* Extracting filter_not_hidden_or_is_subscribed
* Cleanup.
* Cleanup 2.
* Remove follower_state_helper function.
* Cleaning up some utils functions.
* rename hidden to unlisted
* Updating lemmy-js-client.
* Fixing a few cases.
* Fixing list_banned.
* Starting to convert to lemmy results.
* Fixing vote_view.
* Close to finishing up errors.
* Got compiling.
* Remove tracing for CI.
* Removing unused errors.
* Fixing merge from main.
* lower_name community_view sort.
* Syntax errors.
* Removing rest of Result from db_schema, db_views.
* Finally compiling again.
* fmt.
* Subpath tries again.
* Adding some more indexes./
* Fixing shear.
* Fix keyword_blocks test.
* @dullbananas fixes to Subpath, fixing comment tests.
* sql fmt
* Fixing unused error.
* API test fixing
* Adding a first_id helper function.
* Fixing api_common
* Addressing PR comments
* Addressing PR comments 1.
* Using id desc.
* Addressing PR comments 2.
* Removing the reverse_timestamp keys for the post table.
* Make community_title and community_lower_name indexes desc
* Remove featured_community from post sort
* Forgot to drop index.
---------
Co-authored-by: Felix Ableitner <me@nutomic.com>
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2025-04-15 21:24:46 -04:00
Nutomic
e4c87748bf
Move sql schema to separate Rust crate ( #5581 )
...
* Move db schema file to new crate
* db schema compiling
* wip
* db views
* compiling
* cleanup
* clippy
* fix path
* move some more files to new crate
* fixes
* fix
* fix
2025-04-03 19:21:27 -04:00
Felix Ableitner
253230a5cb
Run cargo check after updating translations to catch errors
2025-02-28 14:39:10 +01:00
Felix Ableitner
cd1da33fa1
Version 1.0.0-alpha.2
2025-02-28 14:33:44 +01:00
dullbananas
6b1b29419d
Add custom migration runner, forbid some diesel migration
commands, fix old migrations ( #4673 )
...
* Update schema.rs
* rename
* stuff
* finish new implementation of schema_setup::run (not including revert, test, etc.)
* fmt
* refactor
* fix sql
* migriation run command
* use trigger on migrations table
* add Options with disable_migrations field for test
* rename to enable_forbid_diesel_cli_trigger
* fix
* fix merge
* diff_checker (partial)
* Revert "diff_checker (partial)"
This reverts commit 6709882e14
.
* Revert "Revert "diff_checker (partial)""
This reverts commit d4bdda5d11
.
* diff check
* improve schema diff
* timestamp replacement
* ignore column order
* remove fedi_name default
* stuff
* improve diff
* stuff
* attempt parallel pg_dump
* attempt 2
* Revert "attempt 2"
This reverts commit a909d2d643
.
* Revert "attempt parallel pg_dump"
This reverts commit 592a127954
.
* improve diff check
* finish fixing migrations
* stuff
* use advisory lock
* stuff
* Update lib.rs
* fmt
* fmt
* clippy
* Update diff_check.rs
* Update .woodpecker.yml
* Update lib.rs
* Update lib.rs
* Update lib.rs
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update lib.rs
* re-run ci
* fmt
* fmt
* Update .woodpecker.yml
* Update .woodpecker.yml
* create separate database in ci
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* try to fix env var
* Update diff_check.rs
* Remove condition that's not needed anymore
* clippy
* exclude views and fast tables
* revert some migration changes
* fix
* fmt
* re-attempt checking character after skipped trigger name, and make code less confusing
* fmt
* fix
* rerun ci
* rerun ci
* fix strip_prefix order
* fix weird big Cargo.lock change by running `git checkout upstream/main Cargo.lock` then letting it auto update again
* fix
* remove installation commands that were removed in main branch
* Revert "remove installation commands that were removed in main branch"
This reverts commit fd65234a76
.
* move create_database_user woodpecker step to make diff less weird
* fix clippy
* Make diff check work just like before
* Move new migrations to the end
* Revert changes to old migrations
* don't assume that migrations are already sorted
* retry CI
* fix merge
* find migrations dir in debug mode using CARGO_MANIFEST_DIR variable instead of current working directory
* always use embedded migrations
* improve doc comments for migration subcommand
* clippy fix
* move cfg(test) attribute to diff_check.rs
* copy `o` variable instead of calling `o` function
* use chrono::TimeDelta Display implementation to show migration duration
2025-01-08 11:07:32 +01:00
Nutomic
ad90cd77f9
Implement private communities ( #5076 )
...
* add private visibility
* filter private communities in post_view.rs
* also filter in comment_view
* community follower state
* remove unused method
* sql fmt
* add CommunityFollower.approved_by
* implement api endpoints
* api changes
* only admins can create private community for now
* add local api tests
* fix api tests
* follow remote private community
* use authorized fetch for content in private community
* federate community visibility
* dont mark content in private community as public
* expose ApprovalRequired in api
* also check content fetchable for outbox/featured
* address private community content to followers
* implement reject activity
* fix tests
* add files
* remove local api tests
* dont use delay
* is_new_instance
* single query for is_new_instance
* return subscribed type for pending follow
* working
* need to catch errors in waitUntil
* clippy
* fix query
* lint for unused async
* diesel.toml comment
* add comment
* avoid db reads
* rename approved_by to approver_id
* add helper
* form init
* list pending follows should return items for all communities
* clippy
* ci
* fix down migration
* fix api tests
* references
* rename
* run git diff
* ci
* fix schema check
* fix joins
* ci
* ci
* skip_serializing_none
* fix test
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2024-11-07 05:49:05 -05:00
Dessalines
917e408735
Fix postgres connection options causing slow query speed. ( #5150 )
...
* Adding a query speed check.
* Fixing slow queries due to connection config options.
* Remove pointless set_config sql function.
* Removing pointless bool.
* Removing comment
* Removing test.sh changes.
* Add analyze to speed up query
* Trying to fix DB perf connection try #1
* Try encoding option
* Fix woodpecker
* Try to use path character.
* Fixing lemmy config location.
* Removing pointless connection options.
* Use OnceLock to create a once-init psql connection.
* Fixing comment.
* Fix host encoding for dev DB.
* Address PR comments.
* Revert query mut change.
2024-11-06 10:58:40 -05:00
Dessalines
df664d9d9a
Upgrading ts_rs to 10.0.0 ( #5163 )
...
* Upgrading ts_rs to 10.0.0
* Adding ts_option directives, and woodpecker test.
* Fixing ts_options.
2024-11-06 15:50:13 +01:00
dullbananas
101476df87
Make scripts work in path that contains spaces ( #4986 )
2024-08-22 17:33:00 +02:00
phiresky
a08642f813
federation: parallel sending per instance ( #4623 )
...
* federation: parallel sending
* federation: some comments
* lint and set force_write true when a request fails
* inbox_urls return vec
* split inbox functions into separate file
* cleanup
* extract sending task code to separate file
* move federation concurrent config to config file
* off by one issue
* improve msg
* fix both permanent stopping of federation queues and multiple creation of the same federation queues
* fix after merge
* lint fix
* Update crates/federate/src/send.rs
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
* comment about reverse ordering
* remove crashable, comment
* comment
* move comment
* run federation tests twice
* fix test run
* prettier
* fix config default
* upgrade rust to 1.78 to fix diesel cli
* fix clippy
* delay
* add debug to make localhost urls not valid in ap crate, add some debug logs
* federation tests: ensure server stop after test and random activity id
* ci fix
* add test to federate 100 events
* fix send 100 test
* different data every time so activities are distinguishable
* allow out of order receives in test
* lint
* comment about https://github.com/LemmyNet/lemmy/pull/4623#discussion_r1565437391
* move sender for clarity, add comment
* move more things to members
* update test todo comment, use same env var as worker test but default to 1
* remove else below continue
* some more cleanup
* handle todo about smooth exit
* add federate inboxes collector tests
* lint
* actor max length
* don't reset fail count if activity skipped
* fix some comments
* reuse vars
* format
* Update .woodpecker.yml
* fix recheck time
* fix inboxes tests under fast mode
* format
* make i32 and ugly casts
* clippy
---------
Co-authored-by: dullbananas <dull.bananas0@gmail.com>
2024-07-21 11:50:50 -04:00
Daniel Lo Nigro
8abbd56400
Switch PostgreSQL container to use pgautoupgrade ( #4892 )
...
* Switch PostgreSQL container to use pgautoupgrade
This handles automatically upgrading the data files to newer versions of PostgreSQL.
* Fixing other uses of postgres:16-alpine image.
* Simplifying upgrade scripts.
---------
Co-authored-by: Dessalines <tyhou13@gmx.com>
2024-07-17 09:59:21 +02:00
dullbananas
9120207314
Format replaceable_schema files in lint.sh ( #4868 )
2024-06-26 10:47:09 +02:00
Dessalines
b2a480f55c
Fixing sed command for postgres upgrade. ( #4791 )
...
- Context: https://github.com/LemmyNet/lemmy-ansible/issues/245
2024-06-07 12:39:23 -04:00
Dessalines
9236cf7d21
Remove ansible tagging lines. ( #4790 )
2024-06-07 11:26:43 -04:00
Dessalines
b0447ad94d
Upgrading lemmy-js-client version to 0.19.4 ( #4787 )
...
* Upgrading lemmy-js-client version to 0.19.4
* Upgrading deps before renovate.
2024-06-06 20:44:36 -04:00
Nutomic
af034f3b5e
Unit tests and cleanup for outgoing federation code ( #4733 )
...
* test setup
* code cleanup
* cleanup
* move stats to own file
* basic test working
* cleanup
* processes test
* more test cases
* fmt
* add file
* add assert
* error handling
* fmt
* use instance id instead of domain for stats channel
2024-05-27 09:34:58 -04:00
Tim Coombs
522f974e30
fix: use docker compose v2 ( #4622 )
...
* fix: use docker compose v2
* Using sudo tee.
* fix: correct postgres sed command
---------
Co-authored-by: Dessalines <tyhou13@gmx.com>
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-05-07 11:41:40 +02:00
dullbananas
4ba6221e04
Move SQL triggers from migrations into reusable sql file ( #4333 )
...
* stuff
* stuff including batch_upsert function
* stuff
* do things
* stuff
* different timestamps
* stuff
* Revert changes to comment.rs
* Update comment.rs
* Update comment.rs
* Update post_view.rs
* Update utils.rs
* Update up.sql
* Update up.sql
* Update down.sql
* Update up.sql
* Update main.rs
* use anyhow macro
* Create down.sql
* Create up.sql
* Create replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update utils.rs
* Update .woodpecker.yml
* Update sql_format_check.sh
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Create dump_schema.sh
* Update start_dev_db.sh
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* stuff
* Update replaceable_schema.sql
* Update .pg_format
* fmt
* stuff
* stuff (#21 )
* Update replaceable_schema.sql
* Update up.sql
* Update replaceable_schema.sql
* fmt
* update cargo.lock
* stuff
* Update replaceable_schema.sql
* Remove truncate trigger because truncate is already restricted by foreign keys
* Update replaceable_schema.sql
* fix some things
* Update replaceable_schema.sql
* Update replaceable_schema.sql
* Update .woodpecker.yml
* stuff
* fix TG_OP
* Psql env vars
* try to fix combine_transition_tables parse error
* Revert "try to fix combine_transition_tables parse error"
This reverts commit 75d00a4626
.
* refactor combine_transition_tables
* try to fix create_triggers
* fix some things
* try to fix combined_transition_tables
* fix sql errors
* update comment count in post trigger
* fmt
* Revert "fmt"
This reverts commit a5bcd0834b
.
* Revert "update comment count in post trigger"
This reverts commit 0066a4b42b
.
* fix everything
* Update replaceable_schema.sql
* actually fix everything
* refactor create_triggers
* fix
* add semicolons
* add is_counted function and fix incorrect bool operator in update_comment_count_from_post
* refactor comment trigger
* refactor post trigger
* fix
* Delete crates/db_schema/src/utils/series.rs
* subscribers_local
* edit migrations
* move migrations
* remove utils::series module declaration
* fix everything
* stuff
* Move sql to schema_setup dir
* utils.sql
* delete .pg_format
* Update .woodpecker.yml
* Update sql_format_check.sh
* Update .woodpecker.yml
* Merge remote-tracking branch 'upstream/main' into bliss
* fmt
* Create main.rs
* Update lib.rs
* Update main.rs
* Update .woodpecker.yml
* Update main.rs
* Update Cargo.toml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update triggers.sql
* YAY
* Update mod.rs
* Update Cargo.toml
* a
* Update Cargo.toml
* Update Cargo.toml
* Delete crates/db_schema/src/main.rs
* Update Cargo.toml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update utils.sql
* Update utils.sql
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update down.sql
* Update up.sql
* Update triggers.sql
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update triggers.sql
* Update down.sql
* Update .woodpecker.yml
* Update Cargo.toml
* Update .woodpecker.yml
* Update Cargo.toml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update .woodpecker.yml
* Update mod.rs
* Update Cargo.toml
* Update mod.rs
* make dump_schema.sh executable
* fix dump_schema.sh
* defer
* diff dumps
* fmt
* Update utils.sql
* Update .woodpecker.yml
* use correct version for pg_dump
* Update .woodpecker.yml
* Update .woodpecker.yml
* change migration date
* atomic site_aggregates insert
* temporarily repeat tests in CI
* drop r schema in CI migration check
* show ReceivedActivity::create error
* move check_diesel_migration CI step
* Update .woodpecker.yml
* Update scheduled_tasks.rs
* Update scheduled_tasks.rs
* update cargo.lock
* move sql files
* move rank functions
* filter post_aggregates update
* fmt
* cargo fmt
* replace post_id with id
* update cargo.lock
* avoid locking rows that need no change in up.sql
* only run replaceable_schema if migrations were run
* debug ci test failure
* make replaceable_schema work in CI
* Update .woodpecker.yml
* remove println
* Use migration revert and git checkout
* Update schema_setup.rs
* Fix
* Update schema_setup.rs
* Update schema_setup.rs
* Update .woodpecker.yml
---------
Co-authored-by: Nutomic <me@nutomic.com>
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2024-04-17 20:58:44 -04:00
dullbananas
0f6b13a4ec
Test coverage ( #4596 )
...
* update .gitignore
* add test-with-coverage.sh
* coverage gutters extension comment
* move lcov.info to target folder
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-04-11 10:32:07 +02:00
Dessalines
555f789269
Fixing custom_thumbnail updates. ( #4593 )
...
* Fixing custom_thumbnail updates.
* Fixing issue with image posts.
* Fixing upgrade deps script.
* Adding API tests for custom thumbnails.
* Remove pointless todo.
* Address PR comments.
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-04-10 10:59:46 -04:00
Nutomic
b4670988b5
Change exponential backoff algorithm for federation send ( #4597 )
...
* Limit federation send retry interval to one hour
* clippy
* avoid overflow
* change base for exp backoff
* ignore first error
* fix day duration
2024-04-09 19:33:01 -04:00
Nutomic
328a48c9f5
Remove error-type feature from lemmy-utils ( #4474 )
...
* Remove error-type feature from lemmy-utils
* fixes
---------
Co-authored-by: SleeplessOne1917 <28871516+SleeplessOne1917@users.noreply.github.com>
2024-02-27 11:13:52 -05:00
Dessalines
9367cbdb00
Upgrading from postgres 15 -> 16-alpine. ( #4426 )
...
- Includes an upgrade script.
- Fixes #4406
2024-02-07 11:21:02 +01:00
Dessalines
3647a46e86
Remove ansible tagging. ( #4417 )
...
- See https://github.com/LemmyNet/lemmy-ansible/issues/215
2024-01-31 10:46:13 +01:00
Nutomic
a09027c4c0
Silence warnings from ts-rs ( #4415 )
...
* Silence warnings from ts-rs
https://github.com/Aleph-Alpha/ts-rs/issues/108
* fmt
2024-01-29 09:22:53 -05:00
Dessalines
eb0dc2fda4
Moving from yarn to pnpm. ( #4414 )
...
* Moving from yarn to pnpm.
* Prettier check.
2024-01-29 11:38:39 +01:00
dullbananas
759f6d8a9a
Better query plan viewing experience ( #4285 )
...
* stuff
* stuff including batch_upsert function
* stuff
* do things
* stuff
* different timestamps
* stuff
* Revert changes to comment.rs
* Update comment.rs
* Update comment.rs
* Update post_view.rs
* Update utils.rs
* Update up.sql
* Update up.sql
* Update down.sql
* Update up.sql
* Update main.rs
* use anyhow macro
* replace get(0) with first()
* as_slice
* Update series.rs
* Update db_perf.sh
* Update and rename crates/db_schema/src/utils/series.rs to crates/db_perf/src/series.rs
* Update utils.rs
* Update main.rs
* Update main.rs
* Update .woodpecker.yml
* fmt main.rs
* Update .woodpecker.yml
* Instance::delete at end
* Update main.rs
* Update Cargo.toml
---------
Co-authored-by: Nutomic <me@nutomic.com>
2024-01-24 10:22:33 -05:00
Dessalines
70530a8ad2
Optimizing sql format check. ( #4268 )
...
* Optimizing sql format check.
* Fixing format testing.
* Fixing format testing 2.
2023-12-14 11:35:52 -05:00
Nutomic
a790a24c4d
Revert debug auth ( #4232 )
...
* Revert "Some changes to help debug auth problems on lemmy.ml (#4220 )"
This reverts commit 16ac893e15
.
* Rename auth cookie back to jwt
2023-12-05 11:22:08 -05:00
Nutomic
16ac893e15
Some changes to help debug auth problems on lemmy.ml ( #4220 )
...
* Some changes to help debug auth problems on lemmy.ml
* fix
* clippy
2023-12-01 09:18:29 -05:00
dullbananas
30f7135f32
Use rust 1.74.0 in CI and move clippy lints to Cargo.toml ( #4170 )
...
* ci rust 1.74.0
* do it
* Update .woodpecker.yml
* Update Cargo.toml
* Update lint.sh
* Update lib.rs
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2023-11-21 08:51:22 -05:00
Dessalines
8deb4e5752
Convert more responses to SuccessResponse. Fixes #2860 ( #4058 )
...
* Convert more responses to SuccessResponse. Fixes #2860
* Upgrading lemmy-js-client.
2023-10-19 13:21:05 -04:00
Anon
fe3ebea95a
Add logging for pictrs uploads ( #3927 )
...
* Add logging for pictrs uploads
* cleanup
2023-09-06 09:13:30 -04:00
Dessalines
be1389420b
Adding SQL format checking via pg_format
/ pgFormatter ( #3740 )
...
* SQL format checking, 1.
* SQL format checking, 2.
* SQL format checking, 3.
* SQL format checking, 4.
* SQL format checking, 5.
* Running pg_format
* Getting rid of comment.
* Upping pg_format version.
* Using git ls-files for sql format check.
* Fixing sql lints.
* Addressing PR comments.
2023-08-02 12:44:51 -04:00
cetra3
9256895635
Cache & Optimize Woodpecker CI ( #3450 )
...
* Try using drone cache plugin
* Try another path
* Include volume
* Fix formatting
* Include fmt
* Exclude cargo dir from prettier
* Don't override cargo
* Just do check
* Add cache key
* Use different cache plugin
* Add clippy
* Try minio
* Add quotes
* Try adding secrets
* Try again
* Again
* Use correct secret formation
* Add back clippy
* Use secret for the root bucket name
* Try drone cache instead
* Add region
* Add path-style option
* Include cargo clippy
* Include everything again
* Fix formatting
* Don't run clippy twice
* Add `allow` statements for tests to pass
* Adjust endpoint to be a secret
* Fix prettier
* Merge & fix tests
* Try to restart the woodpecker test
* Change the ENV var name
---------
Co-authored-by: Dessalines <dessalines@users.noreply.github.com>
2023-07-17 11:04:14 -04:00