wlinna•10mo ago

Can't remove an organization as an IAM owner (internal error V3-C8l3V)

I'm trying to delete an organization with all its users but all I'm getting is an An internal error occurred (V3-C8l3V). My user is an IAM Owner, but not the creator of the organization. The organization has 219 users. Many of them are broken because I removed the IDP they used to login. (It's okay — not in production yet) Here's the relevant part of the log. It seems to suggest that it has got to do with lack of memory, but there's plenty of RAM available. However, for the query the budget is set to 0 for some reason.

07:27:37 03be66e673a8[783]: time="7:27:37Z" level=info msg="query failed" caller="/eventstore/repository/sql/query.go:129" error="timeout: context deadline exceeded"
07:27:37 03be66e673a8[783]: time="7:27:37Z" level=info msg="process events failed" caller="/eventstore/handler/v2/handler.go:413" error="ID=SQL-KyeAx Message=unable to filter events Parent=(timeout: context deadline exceeded)" projection=projections.idps3
07:27:37 03be66e673a8[783]: time="7:27:37Z" level=warning msg="delete unique constraint failed" caller="/eventstore/v3/unique_constraints.go:63" error="ERROR: sql: memory budget exceeded: 3348480 bytes requested, 997627327 currently allocated, 0 bytes in budget (SQLSTATE 53200)"

07:27:37 03be66e673a8[783]: time="7:27:37Z" level=info msg="query failed" caller="/eventstore/repository/sql/query.go:129" error="timeout: context deadline exceeded"
07:27:37 03be66e673a8[783]: time="7:27:37Z" level=info msg="process events failed" caller="/eventstore/handler/v2/handler.go:413" error="ID=SQL-KyeAx Message=unable to filter events Parent=(timeout: context deadline exceeded)" projection=projections.idps3
07:27:37 03be66e673a8[783]: time="7:27:37Z" level=warning msg="delete unique constraint failed" caller="/eventstore/v3/unique_constraints.go:63" error="ERROR: sql: memory budget exceeded: 3348480 bytes requested, 997627327 currently allocated, 0 bytes in budget (SQLSTATE 53200)"

The next message contains the query from CockroachDB. It is over 3000 lines long and is mostly just repetition (but probably with different parameters). Makes me wonder if a query that long could cause problems I'm using Zitadel 2.59.1 (but it also happened with 2.58.1) with CockroachDB v24.1.3

7 Replies

wlinnaOP•10mo ago

Here is the query from CockroachDB. It is over 3000 lines long, mostly just repeating itself

DELETE.txt

fabienne•10mo ago

@adlerhurst @muhlemmer can you help here?

adlerhurst•10mo ago

Hi wlinna It looks like the query is too long would you mind creating an issue on GitHub?

wlinnaOP•10mo ago

Hello adlerhurst. The GH issue is here: https://github.com/zitadel/zitadel/issues/8510

GitHub

[Bug]: Deleting an organization fails with internal error V3-C8l3V ...

Preflight Checklist I could not find a solution in the documentation, the existing issues or discussions I have joined the ZITADEL chat Environment Self-hosted Version 2.59.1, 2.58.1 Database Cockr...

wlinnaOP•10mo ago

I am curious how do you come up with these error codes. Why do they look like this? Is there a naming convention or some program that generates them?

adlerhurst•10mo ago

I wrote a vscode extension some years ago. https://marketplace.visualstudio.com/items?itemName=silreu.id-gen Currently not actively maintained because i lost my gitlab account

ID-Gen - Visual Studio Marketplace

Extension for Visual Studio Code - ID generator for vs code

Unknown User•10mo ago

Message Not Public

Can't remove an organization as an IAM owner (internal error V3-C8l3V)

Did you find this page helpful?