gotosocial/CONTRIBUTING.md
tobi 64bd689e55
Test both dbs (#205)
* move scripts, allow testing both dbs with one cmd

* tidy + vendor

* update test.sh to ignore cache

* put test commands directly in drone.yml

* change CONTRIBUTING slightly

* go ham on the readme
2021-09-10 18:13:24 +02:00

10 KiB
Raw Blame History

Contributing

Hey! Welcome to the CONTRIBUTING.md for GoToSocial :) Thanks for taking a look, that kicks ass.

This document will expand as the project expands, so for now this is basically a stub.

Contributions are welcome at this point, since the API is fairly stable now and the structure is somewhat coherent.

Check the issues to see if there's anything you fancy jumping in on.

Table Of Contents

Communications

Before starting on something, please comment on an issue to say that you're working on it, and/or drop into the GoToSocial Matrix room here.

This is the recommended way of keeping in touch with other developers, asking direct questions about code, and letting everyone know what you're up to.

Code of Conduct

In lieu of a fuller code of conduct, here are a few ground rules.

  1. We DO NOT ACCEPT PRs from right-wingers, Nazis, transphobes, homophobes, racists, harassers, abusers, white-supremacists, misogynists, tech-bros of questionable ethics. If that's you, politely fuck off somewhere else.
  2. Any PR that moves GoToSocial in the direction of surveillance capitalism or other bad fediverse behavior will be rejected.
  3. Don't spam the general chat too hard.

Setting up your development environment

To get started, you first need to have Go installed. GtS is currently using Go 1.17, so you should take that too. See here.

Once you've got go installed, clone this repository into your Go path. Normally, this should be ~/go/src/github.com/superseriousbusiness/gotosocial.

Once that's done, you can try building the project: ./scripts/build.sh. This will build the gotosocial binary.

If there are no errors, great, you're good to go!

To work with the stylesheet for templates, you need Node.js, then run yarn install in web/source/. Recompiling the bundle.css is node build.js but can be automated with nodemon on file change: nodemon -w style.css build.js.

Golang forking quirks

One of the quirks of Golang is that it relies on the source management path being the same as the one used within go.mod and in package imports within individual Go files. This makes working with forks a bit awkward.

Let's say you fork GoToSocial to github.com/yourgithubname/gotosocial, and then clone that repository to ~/go/src/github.com/yourgithubname/gotosocial. You will probably run into errors trying to run tests or build, so you might change your go.mod file so that the module is called github.com/yourgithubname/gotosocial instead of github.com/superseriousbusiness/gotosocial. But then this breaks all the imports within the project. Nightmare! So now you have to go through the source files and painstakingly replace github.com/superseriousbusiness/gotosocial with github.com/yourgithubname/gotosocial. This works OK, but when you decide to make a pull request against the original repo, all the changed paths are included! Argh!

The correct solution to this is to fork, then clone the upstream repository, then set origin of the upstream repository to that of your fork.

See this blogpost for more details.

In case this post disappears, here are the steps (slightly modified):

Pull the original package from the canonical place with the standard go get command:

go get github.com/superseriousbusiness/gotosocial

Fork the repository on Github or set up whatever other remote git repo you will be using. In this case, I would go to Github and fork the repository.

Navigate to the top level of the repository on your computer. Note that this might not be the specific package youre using:

cd $GOPATH/src/github.com/superseriousbusiness/gotosocial

Rename the current origin remote to upstream:

git remote rename origin upstream

Add your fork as origin:

git remote add origin git@github.com/yourgithubname/gotosocial

Setting up your test environment

GoToSocial provides a testrig with a bunch of mock packages you can use in integration tests.

One thing that isn't mocked is the Database interface, because it's just easier to use an in-memory SQLite database than to mock everything out.

Standalone Testrig

You can also launch a testrig as a standalone server running at localhost, which you can connect to using something like Pinafore.

To do this, first build the gotosocial binary with ./scripts/build.sh.

Then, launch the testrig by invoking the binary as follows:

GTS_DB_TYPE="sqlite" GTS_DB_ADDRESS=":memory:" ./gotosocial --host localhost:8080 testrig start

To run Pinafore locally in dev mode, first clone the Pinafore repository, and run the following command in the cloned directory:

yarn run dev

The Pinafore instance will start running on localhost:4002.

To connect to the testrig, navigate to https://localhost:4002 and enter your instance name as localhost:8080.

At the login screen, enter the email address zork@example.org and password password.

Note the following constraints:

  • Since the testrig uses an in-memory database, the database will be destroyed when the testrig is stopped.
  • If you stop the testrig and start it again, any tokens or applications you created during your tests will also be removed. As such, you need to log out and in again every time you stop/start the rig.
  • The testrig does not make any actual external http calls, so federation will (obviously) not work from a testrig.

Running tests

There are a few different ways of running tests. Each requires the use of the -p 1 flag, to indicate that they should not be run in parallel.

SQLite

If you want to run tests as quickly as possible, using an SQLite in-memory database, use:

GTS_DB_TYPE="sqlite" GTS_DB_ADDRESS=":memory:" go test -p 1 ./...

Postgres

If you want to run tests against a Postgres database running on localhost, run:

GTS_DB_TYPE="postgres" GTS_DB_ADDRESS="localhost" go test -p 1 ./...

In the above command, it is assumed you are using the default Postgres password of postgres.

Both

Finally, to run tests against both database types one after the other, use:

./scripts/test.sh

Linting

We use golangci-lint for linting. To run this locally, first install the linter following the instructions here.

Then, you can run the linter with:

golangci-lint run --tests=false

Note that this linter also runs as a job on the Github repo, so if you make a PR that doesn't pass the linter, it will be rejected. As such, it's good practice to run the linter locally before pushing or opening a PR.

Another useful linter is golint, which catches some style issues that golangci-lint does not.

To install golint, run:

go get -u github.com/golang/lint/golint

To run the linter, use:

golint ./internal/...

Then make sure to run go fmt ./... to update whitespace and other opinionated formatting.

Updating Swagger docs

If you change swagger annotations on any of the API paths, you need to generate a new swagger file at ./docs/api/swagger.yaml. You can do this with:

./scripts/generateswagger.sh

Pushing to Docker

You can easily build a Docker container tagged with the current branch name using:

./scripts/dockerbuild.sh

Then, (assuming you have permissions to push to the GoToSocial Docker repository), run:

./scripts/dockerpush.sh

Note: you should never manually push a Docker container from your machine to latest -- we have a CI/CD flow for that. Only push a Docker container manually when you're testing changes on a branch!

CI/CD configuration

GoToSocial uses Drone for CI/CD tasks like running tests, linting, and building Docker containers. These runs are integrated with Github, and will be run on opening a pull request or merging into main.

The Drone instance for GoToSocial is here.

The drone.yml file is here -- this defines how and when Drone should run. Documentation for Drone is here.

Please note that the drone.yml file must be signed by the Drone admin account in order to be considered valid. This must be done every time the file is changed. This is to prevent tampering and hijacking of the Drone instance. See here.

To sign the file, first install and setup the drone cli tool. Then, run:

drone -t PUT_YOUR_DRONE_ADMIN_TOKEN_HERE -s https://drone.superseriousbusiness.org sign superseriousbusiness/gotosocial --save

Financial Compensation

Right now there's no structure in place for financial compensation for pull requests and code. This is simply because there's no money being made on the project apart from the very small weekly Liberapay donations.

If money starts coming in, I'll start looking at proper financial structures, but for now code is considered to be a donation in itself.