* feat: Configurable Unique Machine Identification
This change fixes Segfault on AWS App Runner with v2 #3625
The change introduces two new dependencies:
* github.com/drone/envsubst for supporting AWS ECS, which has its metadata endpoint described by an environment variable
* github.com/jarcoal/jpath so that only relevant data from a metadata response is used to identify the machine.
The change ads new configuration (see `defaults.yaml`):
* `Machine.Identification` enables configuration of how machines are uniquely identified - I'm not sure about the top level category `Machine`, as I don't have anything else to add to it. Happy to hear suggestions for better naming or structure here.
* `Machine.Identifiation.PrivateId` turns on or off the existing private IP based identification. Default is on.
* `Machine.Identification.Hostname` turns on or off using the OS hostname to identify the machine. Great for most cloud environments, where this tends to be set to something that identifies the machine uniquely. Enabled by default.
* `Machine.Identification.Webhook` configures identification based on the response to an HTTP GET request. Request headers can be configured, a JSONPath can be set for processing the response (no JSON parsing is done if this is not set), and the URL is allowed to contain environment variables in the format `"${var}"`.
The new flow for getting a unique machine id is:
1. PrivateIP (if enabled)
2. Hostname (if enabled)
3. Webhook (if enabled, to configured URL)
4. Give up and error out.
It's important that init configures machine identity first. Otherwise we could try to get an ID before configuring it. To prevent this from causing difficult to debug issues, where for example the default configuration was used, I've ensured that
the application will generate an error if the module hasn't been configured and you try to get an ID.
Misc changes:
* Spelling and gramatical corrections to `init.go::New()` long description.
* Spelling corrections to `verify_zitadel.go::newZitadel()`.
* Updated `production.md` and `development.md` based on the new build process. I think the run instructions are also out of date, but I'll leave that for someone else.
* `id.SonyFlakeGenerator` is now a function, which sets `id.sonyFlakeGenerator`, this allows us to defer initialization until configuration has been read.
* Update internal/id/config.go
Co-authored-by: Alexei-Barnes <82444470+Alexei-Barnes@users.noreply.github.com>
* Fix authored by @livio-a for tests
Co-authored-by: Livio Amstutz <livio.a@gmail.com>
* not working
* test ci
* correct path
* test
* test
* test
* remove k8s & test
* test
* test image
* typo
* test
* fix
* test
* fix
* test
* fix
* fix windows
* fix
* fix
* fix codecov
* fix with arch
* test
* test
* test
* test
* trial
* trial
* trial
* trial
* trial
* trial
* trial
* try
* try
* first improvement
* trial
* improve
* improve
* improve
* use bash
* trial
* random test
* wip
* test with goreleaser and semrel
* fix typo
* trial
* add buildx
* define default
* force buildkit
* use buildx
* debug GH docker
* use images
* debug docker
* work around image name issues
* trial
* test
* test with prebuilt image
* fix
* use load
* test
* use only docker
* trial
* test
* use load
* test
* test with docker driver
* trial
* trial
* trial
* use arm
* upload artifacts
* try to cache grpc base
* try to use a cache
* fall back
* test
* fix
* improve
* upload artifacts
* fix
* name things
* add tag if poc
* args for protos
* remove v2 build
Co-authored-by: Livio Amstutz <livio.a@gmail.com>
* early prototyp
* fix some errors
* remove docker image cache
* add comment
* add false
* typo
* test cache speed
* upload artifact
* remove tag
* seperate after build step
* debug
* debug
* debug
* debug
* debug
* test gh
* test
* test
* test
* test
* test golang
* test go
* test with release image
* fix
* use scratch to export
* test
* fix path
* ref
* typo
* debug
* test
* debug
* speed up docker
* test
* debug
* debug
* try scope
* test cache
* restore cache
* reenable operator build
* fix duplicate
* fix buildpush version
* test cache
* improve caching
* test release IF
* only run console and zitadel without dispatch
* test with reworked operator
* testing without release step
* lint yaml
* fix if
* improve wording
* enable release step & only notify sentry on main
* console from file system
* update docker file paths
* remove migration line
* add statik for operator
* console files using go 1.15
* fix console default path
* improve code QL
Co-authored-by: Livio Amstutz <livio.a@gmail.com>
