mirror of
https://github.com/zitadel/zitadel.git
synced 2025-12-28 14:57:17 +00:00
This PR initiates the rework of Zitadel's backend to state-persisted objects. This change is a step towards a more scalable and maintainable architecture. ## Changes * **New `/backend/v3` package**: A new package structure has been introduced to house the reworked backend logic. This includes: * `domain`: Contains the core business logic, commands, and repository interfaces. * `storage`: Implements the repository interfaces for database interactions with new transactional tables. * `telemetry`: Provides logging and tracing capabilities. * **Transactional Tables**: New database tables have been defined for `instances`, `instance_domains`, `organizations`, and `org_domains`. * **Projections**: New projections have been created to populate the new relational tables from the existing event store, ensuring data consistency during the migration. * **Repositories**: New repositories provide an abstraction layer for accessing and manipulating the data in the new tables. * **Setup**: A new setup step for `TransactionalTables` has been added to manage the database migrations for the new tables. This PR lays the foundation for future work to fully transition to state-persisted objects for these components, which will improve performance and simplify data access patterns. This PR initiates the rework of ZITADEL's backend to state-persisted objects. This is a foundational step towards a new architecture that will improve performance and maintainability. The following objects are migrated from event-sourced aggregates to state-persisted objects: * Instances * incl. Domains * Orgs * incl. Domains The structure of the new backend implementation follows the software architecture defined in this [wiki page](https://github.com/zitadel/zitadel/wiki/Software-Architecturel). This PR includes: * The initial implementation of the new transactional repositories for the objects listed above. * Projections to populate the new relational tables from the existing event store. * Adjustments to the build and test process to accommodate the new backend structure. This is a work in progress and further changes will be made to complete the migration. --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Iraq Jaber <iraq+github@zitadel.com> Co-authored-by: Iraq <66622793+kkrime@users.noreply.github.com> Co-authored-by: Tim Möhlmann <tim+github@zitadel.com>
113 lines
3.9 KiB
Go
113 lines
3.9 KiB
Go
// Package cache provides abstraction of cache implementations that can be used by zitadel.
|
|
package cache
|
|
|
|
import (
|
|
"context"
|
|
"time"
|
|
|
|
"github.com/zitadel/logging"
|
|
)
|
|
|
|
// Purpose describes which object types are stored by a cache.
|
|
type Purpose int
|
|
|
|
//go:generate enumer -type Purpose -transform snake -trimprefix Purpose
|
|
const (
|
|
PurposeUnspecified Purpose = iota
|
|
PurposeAuthzInstance
|
|
PurposeMilestones
|
|
PurposeOrganization
|
|
PurposeIdPFormCallback
|
|
)
|
|
|
|
// Cache stores objects with a value of type `V`.
|
|
// Objects may be referred to by one or more indices.
|
|
// Implementations may encode the value for storage.
|
|
// This means non-exported fields may be lost and objects
|
|
// with function values may fail to encode.
|
|
// See https://pkg.go.dev/encoding/json#Marshal for example.
|
|
//
|
|
// `I` is the type by which indices are identified,
|
|
// typically an enum for type-safe access.
|
|
// Indices are defined when calling the constructor of an implementation of this interface.
|
|
// It is illegal to refer to an idex not defined during construction.
|
|
//
|
|
// `K` is the type used as key in each index.
|
|
// Due to the limitations in type constraints, all indices use the same key type.
|
|
//
|
|
// Implementations are free to use stricter type constraints or fixed typing.
|
|
type Cache[I, K comparable, V Entry[I, K]] interface {
|
|
// Get an object through specified index.
|
|
// An [IndexUnknownError] may be returned if the index is unknown.
|
|
// [ErrCacheMiss] is returned if the key was not found in the index,
|
|
// or the object is not valid.
|
|
Get(ctx context.Context, index I, key K) (V, bool)
|
|
|
|
// Set an object.
|
|
// Keys are created on each index based in the [Entry.Keys] method.
|
|
// If any key maps to an existing object, the object is invalidated,
|
|
// regardless if the object has other keys defined in the new entry.
|
|
// This to prevent ghost objects when an entry reduces the amount of keys
|
|
// for a given index.
|
|
Set(ctx context.Context, value V)
|
|
|
|
// Invalidate an object through specified index.
|
|
// Implementations may choose to instantly delete the object,
|
|
// defer until prune or a separate cleanup routine.
|
|
// Invalidated object are no longer returned from Get.
|
|
// It is safe to call Invalidate multiple times or on non-existing entries.
|
|
Invalidate(ctx context.Context, index I, key ...K) error
|
|
|
|
// Delete one or more keys from a specific index.
|
|
// An [IndexUnknownError] may be returned if the index is unknown.
|
|
// The referred object is not invalidated and may still be accessible though
|
|
// other indices and keys.
|
|
// It is safe to call Delete multiple times or on non-existing entries
|
|
Delete(ctx context.Context, index I, key ...K) error
|
|
|
|
// Truncate deletes all cached objects.
|
|
Truncate(ctx context.Context) error
|
|
}
|
|
|
|
// Entry contains a value of type `V` to be cached.
|
|
//
|
|
// `I` is the type by which indices are identified,
|
|
// typically an enum for type-safe access.
|
|
//
|
|
// `K` is the type used as key in an index.
|
|
// Due to the limitations in type constraints, all indices use the same key type.
|
|
type Entry[I, K comparable] interface {
|
|
// Keys returns which keys map to the object in a specified index.
|
|
// May return nil if the index in unknown or when there are no keys.
|
|
Keys(index I) (key []K)
|
|
}
|
|
|
|
type Connector int
|
|
|
|
//go:generate enumer -type Connector -transform snake -trimprefix Connector -linecomment -text
|
|
const (
|
|
// Empty line comment ensures empty string for unspecified value
|
|
ConnectorUnspecified Connector = iota //
|
|
ConnectorMemory
|
|
ConnectorPostgres
|
|
ConnectorRedis
|
|
)
|
|
|
|
type Config struct {
|
|
Connector Connector
|
|
|
|
// Age since an object was added to the cache,
|
|
// after which the object is considered invalid.
|
|
// 0 disables max age checks.
|
|
MaxAge time.Duration
|
|
|
|
// Age since last use (Get) of an object,
|
|
// after which the object is considered invalid.
|
|
// 0 disables last use age checks.
|
|
LastUseAge time.Duration
|
|
|
|
// Log allows logging of the specific cache.
|
|
// By default only errors are logged to stdout.
|
|
Log *logging.Config
|
|
}
|