Error while logging in: cannot ensure that projection is up to date

Original message was deleted

FFO•3/20/23, 9:46 PM

FFO•3/20/23, 9:46 PM

can you give us the startup log from zitadel?

FFO•3/20/23, 9:46 PM

and how you start zitadel

FFO•3/20/23, 9:49 PM

Depends on your setup, how did you install zitadel?

FFO•3/20/23, 9:50 PM

so you use docker run?

FFO•3/20/23, 9:50 PM

or how do you start it?

FFO•3/20/23, 9:50 PM

FFO•3/20/23, 9:50 PM

can you share the compose file, or do you use our?

FFO•3/20/23, 9:52 PM

ok to see the logs you can simply check your docker daemon

FFO•3/20/23, 9:52 PM

or do a docker logs

FFO•3/20/23, 9:58 PM

FFO•3/21/23, 5:10 PM

hm i don't see an immediate reason why it fails

FFO•3/21/23, 5:11 PM

@adlerhurst @livio @stebenz @Elio maybe somebody of you knows why we see this error

Uncaught (in promise): Qe: {"headers":{"normalizedNames":{},"lazyUpdate":null},"status":400,"statusText":"OK","url":"https://domain.de/oauth/v2/token","ok":false,"name":"HttpErrorResponse","message":"Http failure response for https://domain.de/oauth/v2/token: 400 OK","error":{"error":"server_error","error_description":"ID=OIDC-ASfh3 Message=cannot ensure that projection is up to date"}}

Uncaught (in promise): Qe: {"headers":{"normalizedNames":{},"lazyUpdate":null},"status":400,"statusText":"OK","url":"https://domain.de/oauth/v2/token","ok":false,"name":"HttpErrorResponse","message":"Http failure response for https://domain.de/oauth/v2/token: 400 OK","error":{"error":"server_error","error_description":"ID=OIDC-ASfh3 Message=cannot ensure that projection is up to date"}}

FFO•3/23/23, 7:15 AM

I got time poking around

FFO•3/23/23, 7:15 AM

Can you give v2.22.2 a spin

FFO•3/23/23, 7:15 AM

We fixed and error on that corner

FFO•3/23/23, 8:08 AM

Yes it is an error I haven't seen many times

stebenz•3/23/23, 9:15 AM

This error occures when ZITADEL tries to read the current key from the DB, for that it read the latest sequence for the instance, if then nothing exists a key is created.

stebenz•3/23/23, 9:15 AM

@John_H_Smith Do you have acces to the DB?

stebenz•3/23/23, 9:21 AM

Ah just saw that you have docker compose, could you please look at the DB and tell me if there is a "projections.current_sequences" table and when what the result of this select command "select * from projections.current_sequences where projection_name = 'projections.keys4';" would be then?

stebenz•3/23/23, 9:43 AM

Hm I just see that you use cockroach v22.1.3, could you update that to at least v22.2.0? Current is I think v22.2.6. I seems to remember a similar error I encountered.

stebenz•3/23/23, 9:51 AM

Yeah had a hard time as well with this, but perfect if it works now, as I recall there should be some release which mentions that you have to update to v22.2.0 or something similar, but that was already some time ago.

stebenz•3/23/23, 9:52 AM

But I will mention it internally.

stebenz•3/23/23, 9:53 AM

No problem, happy to help.

stebenz•4/3/23, 3:57 PM

@barthy.koeln I'm very sorry for this, as I expect that this situation shouldn't occur again I put it off a little bit.
The best way would be to define some way of handling these situations, I'm with you on that.

@FFO @fabienne any input on how we should proceed with upgrade requirements?

FFO•4/3/23, 5:17 PM

Hm i recently talked internally about this. IMO we should start using feature gates and per default allow forward upgrades without any breaking behaviour.

On the changelog side, it’s true that we could create a changelog in a persistent form, not sure what the best actions is there. Let me think about this

FFO•4/3/23, 7:52 PM

Lets create an issue for this then or a docs page

FFO•4/3/23, 7:52 PM

We could amend this here https://zitadel.com/docs/support/troubleshooting and also create a GH issue that points to that end

ZITADEL Docs

You will find some possible error messages here, what the problem is and what some possible solutions can be.

Uncaught (in promise): Qe: {"headers":{"normalizedNames":{},"lazyUpdate":null},"status":400,"statusText":"OK","url":"https://domain.de/oauth/v2/token","ok":false,"name":"HttpErrorResponse","message":"Http failure response for https://domain.de/oauth/v2/token: 400 OK","error":{"error":"server_error","error_description":"ID=OIDC-ASfh3 Message=cannot ensure that projection is up to date"}}