Silvan
1d84635836
feat(eventstore): add search table ( #8191 )
...
# Which Problems Are Solved
To improve performance a new table and method is implemented on
eventstore. The goal of this table is to index searchable fields on
command side to use it on command and query side.
The table allows to store one primitive value (numeric, text) per row.
The eventstore framework is extended by the `Search`-method which allows
to search for objects.
The `Command`-interface is extended by the `SearchOperations()`-method
which does manipulate the the `search`-table.
# How the Problems Are Solved
This PR adds the capability of improving performance for command and
query side by using the `Search`-method of the eventstore instead of
using one of the `Filter`-methods.
# Open Tasks
- [x] Add feature flag
- [x] Unit tests
- [ ] ~~Benchmarks if needed~~
- [x] Ensure no behavior change
- [x] Add setup step to fill table with current data
- [x] Add projection which ensures data added between setup and start of
the new version are also added to the table
# Additional Changes
The `Search`-method is currently used by `ProjectGrant`-command side.
# Additional Context
- Closes https://github.com/zitadel/zitadel/issues/8094
2024-07-03 15:00:56 +00:00
Tim Möhlmann
1890e28f79
fix(eventstore): retry push on primary key sequence collision ( #7420 )
...
* fix(eventstore): retry push on primary key sequence collision
* MaxRetries config option and unit test
2024-02-23 08:29:10 +00:00
Silvan
b5564572bc
feat(eventstore): increase parallel write capabilities ( #5940 )
...
This implementation increases parallel write capabilities of the eventstore.
Please have a look at the technical advisories: [05](https://zitadel.com/docs/support/advisory/a10005 ) and [06](https://zitadel.com/docs/support/advisory/a10006 ).
The implementation of eventstore.push is rewritten and stored events are migrated to a new table `eventstore.events2`.
If you are using cockroach: make sure that the database user of ZITADEL has `VIEWACTIVITY` grant. This is used to query events.
2023-10-19 12:19:10 +02:00
Silvan
39bdef35e7
chore: merge ( #5773 )
...
* feat: allow skip of success page for native apps (#5627 )
add possibility to return to callback directly after login without rendering the successful login page
* build next
* fix(console): disallow inline fonts, critical styles (#5714 )
fix: disallow inline
* fix(setup): step 10 for postgres (#5717 )
* fix(setup): smaller transactions (#5743 )
* fix: order by sequence by default
* test: add allowCreationDateFilter
* fix(step10): separate executions (#5754 )
* feat: allow skip of success page for native apps (#5627 )
add possibility to return to callback directly after login without rendering the successful login page
* build next
* fix(console): disallow inline fonts, critical styles (#5714 )
fix: disallow inline
* fix(setup): step 10 for postgres (#5717 )
* fix(setup): smaller transactions (#5743 )
* fix(step10): split statements
* fix(step10): split into separate execs
* chore: prerelease
* add truncate before insert
* fix: add truncate
* Merge branch 'main' into optimise-step-10
* chore: reset release definition
---------
Co-authored-by: Livio Spring <livio.a@gmail.com>
Co-authored-by: Max Peintner <max@caos.ch>
---------
Co-authored-by: Livio Spring <livio.a@gmail.com>
Co-authored-by: Max Peintner <max@caos.ch>
2023-04-28 14:56:51 +00:00
Silvan
e38abdcdf3
perf: query data AS OF SYSTEM TIME ( #5231 )
...
Queries the data in the storage layser at the timestamp when the call hit the API layer
2023-02-27 22:36:43 +01:00
Livio Spring
d21bb902f1
fix: push timeout ( #4882 ) ( #4885 )
...
* push with timeout
* test: config for eventstore
(cherry picked from commit b9156da76d0f03075589b50eafbf9f48160a0301)
Co-authored-by: Silvan <silvan.reusser@gmail.com>
2022-12-15 09:40:13 +00:00
Florian Forster
fa9f581d56
chore(v2): move to new org ( #3499 )
...
* chore: move to new org
* logging
* fix: org rename caos -> zitadel
Co-authored-by: adlerhurst <silvan.reusser@gmail.com>
2022-04-26 23:01:45 +00:00
Livio Amstutz
389eb4a27a
feat: run on a single port ( #3163 )
...
* start v2
* start
* run
* some cleanup
* remove v2 pkg again
* simplify
* webauthn
* remove unused config
* fix login path in Dockerfile
* fix asset_generator.go
* health handler
* fix grpc web
* refactor
* merge
* build new main.go
* run new main.go
* update logging pkg
* fix error msg
* update logging
* cleanup
* cleanup
* go mod tidy
* change localDevMode
* fix customEndpoints
* update logging
* comments
* change local flag to external configs
* fix location generated go code
* fix
Co-authored-by: fforootd <florian@caos.ch>
2022-02-14 17:22:30 +01:00
Livio Amstutz
8dcbbc87ca
fix: update config to commands (and queries) ( #1342 )
...
* fix: adaot config to commands (and queries)
* remove dependency on vv2 in v1
* add queries user to operator
* set password for queries on tests
* set password for queries on tests
* fix config
2021-02-24 11:17:39 +01:00
Fabi
d8e42744b4
fix: move v2 pkgs ( #1331 )
...
* fix: move eventstore pkgs
* fix: move eventstore pkgs
* fix: remove v2 view
* fix: remove v2 view
2021-02-23 15:13:04 +01:00
adlerhurst
23e6cad703
start implementing new eventstore on iam
2020-11-12 22:50:01 +01:00
Fabi
802bb56ea1
feat: project cache ( #48 )
...
* feat: eventstore repository
* fix: remove gorm
* version
* feat: pkg
* feat: add some files for project
* feat: eventstore without eventstore-lib
* rename files
* gnueg
* fix: key json
* fix: add object
* fix: change imports
* fix: internal models
* fix: some imports
* fix: global model
* fix: add some functions on repo
* feat(eventstore): sdk
* fix(eventstore): search query
* fix(eventstore): rename app to eventstore
* delete empty test
* remove unused func
* merge master
* fix(eventstore): tests
* fix(models): delete unused struct
* fix: some funcitons
* feat(eventstore): implemented push events
* fix: move project eventstore to project package
* fix: change project eventstore funcs
* feat(eventstore): overwrite context data
* fix: change project eventstore
* fix: add project repo to mgmt server
* feat(types): SQL-config
* fix: commented code
* feat(eventstore): options to overwrite editor
* feat: auth interceptor and cockroach migrations
* fix: migrations
* fix: fix filter
* fix: not found on getbyid
* fix: add sequence
* fix: add some tests
* fix(eventstore): nullable sequence
* fix: add some tests
* merge
* fix: add some tests
* fix(migrations): correct statements for sequence
* fix: add some tests
* fix: add some tests
* fix: changes from mr
* Update internal/eventstore/models/field.go
Co-Authored-By: livio-a <livio.a@gmail.com>
* fix(eventstore): code quality
* fix: add types to aggregate/Event-types
* fix(eventstore): rename modifier* to editor*
* fix(eventstore): delete editor_org
* fix(migrations): remove editor_org field,
rename modifier_* to editor_*
* fix: generate files
* fix(eventstore): tests
* fix(eventstore): rename modifier to editor
* fix(migrations): add cluster migration,
fix(migrations): fix typo of host in clean clsuter
* fix(eventstore): move health
* fix(eventstore): AggregateTypeFilter aggregateType as param
* code quality
* feat: add member funcs
* feat: add member model
* feat: add member events
* feat: add member repo model
* fix: project member funcs
* fix: add tests
* fix: add tests
* feat: implement member requests
* fix: merge master
* fix: read existing in project repo
* fix: fix tests
* feat: add internal cache
* feat: add cache mock
* fix: return values of cache mock
* fix: add cache config
* fix: use eventstore sdk
* Update internal/project/model/project_member.go
Co-Authored-By: Silvan <silvan.reusser@gmail.com>
* fix: use get project func
* fix: return err not nil
* fix: change err types
* Update internal/cache/bigcache/cache.go
Co-Authored-By: livio-a <livio.a@gmail.com>
* Update internal/cache/config/config.go
Co-Authored-By: livio-a <livio.a@gmail.com>
* Update internal/cache/config/config.go
Co-Authored-By: livio-a <livio.a@gmail.com>
* fix: config
* fix: config
* resolve conversations
* fix: mr changes
* fix: fix decode of bigcache
* feat: test caches
* fix: remove unnecessary code
Co-authored-by: adlerhurst <silvan.reusser@gmail.com>
Co-authored-by: livio-a <livio.a@gmail.com>
2020-04-20 15:16:33 +02:00
Silvan
fbeab4c582
Eventstore ( #22 )
...
* feat: eventstore repository
* fix: remove gorm
* version
* feat: pkg
* feat: eventstore without eventstore-lib
* rename files
* gnueg
* fix: add object
* fix: global model
* feat(eventstore): sdk
* fix(eventstore): search query
* fix(eventstore): rename app to eventstore
* delete empty test
* remove unused func
* merge master
* fix(eventstore): tests
* fix(models): delete unused struct
* feat(eventstore): implemented push events
* feat(eventstore): overwrite context data
* feat(types): SQL-config
* feat(eventstore): options to overwrite editor
* Update internal/eventstore/models/field.go
Co-Authored-By: livio-a <livio.a@gmail.com>
* fix(eventstore): code quality
* fix(eventstore): rename modifier* to editor*
* fix(eventstore): delete editor_org
Co-authored-by: Fabiennne <fabienne.gerschwiler@gmail.com>
Co-authored-by: livio-a <livio.a@gmail.com>
2020-04-06 06:42:21 +02:00
