TheArchive/zitadel
1
0
Fork 0
mirror of https://github.com/zitadel/zitadel.git synced 2025-07-17 15:18:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
zitadel/internal/query
History
Tim Möhlmann b9c1cdf4ad
feat(projections): resource counters (#9979) 
# Which Problems Are Solved

Add the ability to keep track of the current counts of projection
resources. We want to prevent calling `SELECT COUNT(*)` on tables, as
that forces a full scan and sudden spikes of DB resource uses.

# How the Problems Are Solved

- A resource_counts table is added
- Triggers that increment and decrement the counted values on inserts
and deletes
- Triggers that delete all counts of a table when the source table is
TRUNCATEd. This is not in the business logic, but prevents wrong counts
in case someone want to force a re-projection.
- Triggers that delete all counts if the parent resource is deleted
- Script to pre-populate the resource_counts table when a new source
table is added.

The triggers are reusable for any type of resource, in case we choose to
add more in the future.
Counts are aggregated by a given parent. Currently only `instance` and
`organization` are defined as possible parent. This can later be
extended to other types, such as `project`, should the need arise.

I deliberately chose to use `parent_id` to distinguish from the
de-factor `resource_owner` which is usually an organization ID. For
example:

- For users the parent is an organization and the `parent_id` matches
`resource_owner`.
- For organizations the parent is an instance, but the `resource_owner`
is the `org_id`. In this case the `parent_id` is the `instance_id`.
- Applications would have a similar problem, where the parent is a
project, but the `resource_owner` is the `org_id`


# Additional Context

Closes https://github.com/zitadel/zitadel/issues/9957
2025-06-03 14:15:30 +00:00
..
projection
fix(eventstore): use decimal, correct mirror (#9914)
2025-05-28 21:54:18 +00:00
testdata
feat: saml application configuration for login version (#9351)
2025-02-13 16:03:05 +00:00
access_token.go
fix(eventstore): use decimal, correct mirror (#9914)
2025-05-28 21:54:18 +00:00
action_flow_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
action_flow.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
action_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
action.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
app_oidc_project_permission.sql
feat: permission check on OIDC and SAML service session API (#9304)
2025-02-11 18:45:09 +00:00
app_saml_project_permission.sql
feat: permission check on OIDC and SAML service session API (#9304)
2025-02-11 18:45:09 +00:00
app_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
app.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
auth_request_by_id.sql
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
auth_request_test.go
chore: update dependencies (#9784)
2025-05-19 10:16:49 +00:00
auth_request.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
authn_key_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
authn_key_user.sql
Merge commit from fork
2025-03-31 12:45:11 +02:00
authn_key.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
cache.go
refactor(handler): cache active instances (#9008)
2024-12-06 11:32:53 +00:00
certificate_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
certificate.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
converter.go
feat(api): feature flags (#7356)
2024-02-28 10:55:54 +02:00
current_state_test.go
fix(eventstore): use decimal, correct mirror (#9914)
2025-05-28 21:54:18 +00:00
current_state.go
fix(eventstore): use decimal, correct mirror (#9914)
2025-05-28 21:54:18 +00:00
custom_text_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
custom_text.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
debug_events_state_by_id.sql
feat: add debug events API (#8533)
2024-09-11 08:24:00 +00:00
debug_events_states.sql
feat: add debug events API (#8533)
2024-09-11 08:24:00 +00:00
debug_events.go
feat: add debug events API (#8533)
2024-09-11 08:24:00 +00:00
device_auth_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
device_auth.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
domain_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
domain_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
event.go
chore: remove bloating span (#7780)
2024-04-16 11:19:17 +00:00
execution_targets.sql
fix: correct handling of removed targets (#9824)
2025-04-30 12:58:10 +00:00
execution_test.go
fix: correct handling of removed targets (#9824)
2025-04-30 12:58:10 +00:00
execution.go
fix: correct handling of removed targets (#9824)
2025-04-30 12:58:10 +00:00
failed_events_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
failed_events.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
generic.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
iam_member_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
iam_member.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
idp_login_policy_link_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
idp_login_policy_link.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
idp_template_test.go
feat: federated logout for SAML IdPs (#9931)
2025-05-23 13:52:25 +02:00
idp_template.go
feat: federated logout for SAML IdPs (#9931)
2025-05-23 13:52:25 +02:00
idp_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
idp_user_link_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
idp_user_link.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
idp.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
instance_by_domain.sql
feat(fields): add instance domain (#9000)
2024-12-04 18:10:10 +00:00
instance_by_id.sql
feat(storage): generic cache interface (#8628)
2024-09-25 21:40:21 +02:00
instance_domain_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
instance_domain.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
instance_features_model.go
fix: remove action feature flag and include execution (#9727)
2025-04-28 11:24:50 +02:00
instance_features_test.go
fix: remove action feature flag and include execution (#9727)
2025-04-28 11:24:50 +02:00
instance_features.go
fix: remove action feature flag and include execution (#9727)
2025-04-28 11:24:50 +02:00
instance_test.go
feat: instance requests implementation for resource API (#9830)
2025-05-21 10:50:44 +02:00
instance_trusted_domain_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
instance_trusted_domain.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
instance.go
feat: instance requests implementation for resource API (#9830)
2025-05-21 10:50:44 +02:00
instanceindex_enumer.go
perf(cache): pgx pool connector (#8703)
2024-10-04 13:15:41 +00:00
introspection_client_by_id.sql
fix: correctly check app state on authentication (#8630)
2024-09-17 11:34:14 +00:00
introspection_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
introspection.go
fix: correctly check app state on authentication (#8630)
2024-09-17 11:34:14 +00:00
key_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
key.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
label_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
lockout_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
lockout_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
login_name.go
perf: remove owner removed columns from projections for oidc (#6925)
2023-11-20 17:21:08 +02:00
login_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
login_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
mail_template.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
member_roles.go
fix(query): realtime data on defined requests (#3726)
2022-06-14 07:51:00 +02:00
member.go
feat(/internal): Add User Resource Owner (#9168)
2025-01-15 09:40:30 +01:00
message_text_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
message_text.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
milestone_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
milestone.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
notification_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
notification_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
notification_provider_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
notification_provider.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
oidc_client_by_id.sql
feat: specify login UI version on instance and apps (#9071)
2024-12-19 10:37:46 +01:00
oidc_client_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
oidc_client.go
feat: specify login UI version on instance and apps (#9071)
2024-12-19 10:37:46 +01:00
oidc_settings_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
oidc_settings.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
org_domain_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
org_domain.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
org_member_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
org_member.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
org_metadata_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
org_metadata.go
feat(api): moving organization API resourced based (#9943)
2025-06-02 16:27:53 +00:00
org_test.go
fix(cache): prevent org cache overwrite by other instances (#10012)
2025-06-03 14:48:15 +02:00
org.go
fix(cache): prevent org cache overwrite by other instances (#10012)
2025-06-03 14:48:15 +02:00
orgindex_enumer.go
feat(cache): organization (#8903)
2024-11-21 08:05:03 +02:00
password_age_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
password_age_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
password_complexity_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
password_complexity_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
permission_example_test.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
permission_test.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
permission.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
prepare_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
privacy_policy_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
privacy_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_grant_member_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_grant_member.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_grant_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_grant.go
feat: project v2beta resource API (#9742)
2025-05-21 14:40:47 +02:00
project_member_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_member.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_role_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project_role.go
feat: project v2beta resource API (#9742)
2025-05-21 14:40:47 +02:00
project_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
project.go
feat: project v2beta resource API (#9742)
2025-05-21 14:40:47 +02:00
query_test.go
fix(setup): init projections (#7194)
2024-01-25 17:28:20 +01:00
query.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
quota_notifications_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
quota_notifications.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
quota_periods_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
quota_periods.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
quota_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
quota.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
resource_counts_list.sql
feat(projections): resource counters (#9979)
2025-06-03 14:15:30 +00:00
resource_counts_test.go
feat(projections): resource counters (#9979)
2025-06-03 14:15:30 +00:00
resource_counts.go
feat(projections): resource counters (#9979)
2025-06-03 14:15:30 +00:00
restrictions_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
restrictions.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
saml_request_by_id.sql
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
saml_request_test.go
chore: update dependencies (#9784)
2025-05-19 10:16:49 +00:00
saml_request.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
saml_sp_by_id.sql
feat: saml application configuration for login version (#9351)
2025-02-13 16:03:05 +00:00
saml_sp_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
saml_sp.go
feat: saml application configuration for login version (#9351)
2025-02-13 16:03:05 +00:00
search_query_test.go
fix: scim 2 filter: the username should be treated case-insensitive (#9257)
2025-01-29 15:22:22 +02:00
search_query.go
fix: scim 2 filter: the username should be treated case-insensitive (#9257)
2025-01-29 15:22:22 +02:00
secret_generator_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
secret_generators.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
security_policy.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
session.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
sessions_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
sms_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
sms.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
smtp_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
smtp.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
system_features_model.go
fix: remove action feature flag and include execution (#9727)
2025-04-28 11:24:50 +02:00
system_features_test.go
fix: remove action feature flag and include execution (#9727)
2025-04-28 11:24:50 +02:00
system_features.go
fix: remove action feature flag and include execution (#9727)
2025-04-28 11:24:50 +02:00
target_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
target.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
targets_by_execution_id.sql
feat: action v2 signing (#8779)
2024-11-28 10:06:52 +00:00
targets_by_execution_ids.sql
feat: action v2 signing (#8779)
2024-11-28 10:06:52 +00:00
user_auth_method_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_auth_method_types_required.sql
perf: improve scalability of session api (#9635)
2025-03-28 12:36:05 +00:00
user_auth_method.go
feat(permissions): project member permission filter (#9757)
2025-04-22 08:42:59 +00:00
user_by_id.sql
fix: scim v2 endpoints enforce user resource owner (#9273)
2025-01-30 16:43:13 +01:00
user_by_login_name.sql
fix: correctly use single matching user (by loginname) (#9865)
2025-05-08 07:32:41 +00:00
user_grant_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_grant.go
fix(eventstore): use decimal, correct mirror (#9914)
2025-05-28 21:54:18 +00:00
user_membership_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_membership.go
fix(eventstore): use decimal, correct mirror (#9914)
2025-05-28 21:54:18 +00:00
user_metadata_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_metadata.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_notify_by_id.sql
feat(users/v2): return prompt information (#9255)
2025-01-29 15:12:31 +00:00
user_notify_by_login_name.sql
fix: correctly use single matching user (by loginname) (#9865)
2025-05-08 07:32:41 +00:00
user_otp.go
refactor: rename package errors to zerrors (#7039)
2023-12-08 15:30:55 +01:00
user_password.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_personal_access_token_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_personal_access_token.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_schema_test.go
feat: add schema user create and remove (#8494)
2024-08-28 19:46:45 +00:00
user_schema.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
user.go
fix(api): correct mapping of user state queries (#9956)
2025-05-26 13:23:38 +02:00
userinfo_by_id.sql
feat(users/v2): return prompt information (#9255)
2025-01-29 15:12:31 +00:00
userinfo_client_by_id.sql
feat(oidc): optimize the userinfo endpoint (#7706)
2024-04-09 15:15:35 +02:00
userinfo_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
userinfo.go
feat(oidc): organization roles scope (#8120)
2024-06-14 10:00:43 +02:00
web_key_by_state.sql
fix(webkeys): remove include private key from projection index (#8436)
2024-08-16 11:41:09 +00:00
web_key_list.sql
fix(webkeys): remove include private key from projection index (#8436)
2024-08-16 11:41:09 +00:00
web_key_model.go
feat(v3alpha): web key resource (#8262)
2024-08-14 14:18:14 +00:00
web_key_public_keys.sql
fix(webkeys): remove include private key from projection index (#8436)
2024-08-16 11:41:09 +00:00
web_key_test.go
chore!: Introduce ZITADEL v3 (#9645)
2025-04-02 16:53:06 +02:00
web_key.go
feat(v3alpha): web key resource (#8262)
2024-08-14 14:18:14 +00:00
zitadel_permission.go
perf: remove owner removed columns from projections for oidc (#6925)
2023-11-20 17:21:08 +02:00