Migration 8.5.9 to 9.2.5 fails with dashboard migration permission issue

Grafana Installation
3

Thanks for the information, before raising the issue, i saw this issue and tried this solution, but it doesn’t help. also as i see the that issue not resolved yet.
the above problem i stated is with a sqlite based grafana.
we today tried on a mysql based grafana too, and it also fails while migrating with following logs. this also is a 8.5.9 to 9.2.5 upgrade.

logger=migrator t=2022-12-20T08:28:06.64546023Z level=warn msg="alert linked to obsolete notification channel, ignoring" alert="tpc-co-elas03 - Disk Usage % alert" uid=5
logger=migrator t=2022-12-20T08:28:06.645480197Z level=warn msg="alert linked to obsolete notification channel, ignoring" alert="tpc-co-elas03 - Disk Usage % alert" uid=8
logger=migrator t=2022-12-20T08:28:06.645505942Z level=warn msg="alert linked to obsolete notification channel, ignoring" alert="TPC-MS-TAREDS03 - Memory Usage alert" uid=5
logger=migrator t=2022-12-20T08:28:06.645522684Z level=warn msg="alert linked to obsolete notification channel, ignoring" alert="TPC-MS-TAREDS03 - Memory Usage alert" uid=8
logger=migrator t=2022-12-20T08:28:06.64554253Z level=warn msg="alert linked to obsolete notification channel, ignoring" alert="tpc-appd-anco01 - Netstat alert" uid=5
logger=migrator t=2022-12-20T08:28:06.645556138Z level=warn msg="alert linked to obsolete notification channel, ignoring" alert="tpc-appd-anco01 - Netstat alert" uid=8
logger=migrator t=2022-12-20T08:28:15.496701782Z level=error msg="Executing migration failed" id="move dashboard alerts to unified alerting" error="Error 1062: Duplicate entry '1-ZpF-i_cVz' for key 'UQE_alert_rule_org_id_uid'"
logger=migrator t=2022-12-20T08:28:15.496811706Z level=error msg="Exec failed" error="Error 1062: Duplicate entry '1-ZpF-i_cVz' for key 'UQE_alert_rule_org_id_uid'" sql="code migration"
4

Hi, any updates on this issue. we tried to upgrade with legacy alerting and it got successfully upgraded.

[unified_alerting]
enabled = false

But we want the upgrade to work with v9 alerting, Please let us know if we can do something for this.

5

@niteshchauhan

I reviewed your case with my team and it seems you would need to address the error you first reported failed to create permissions for role: UNIQUE constraint failed: permission.role_id, permission.action, permission.scope"

Because the action names were renamed, this will cause errors due to custom roles that use previous action names. See this pull request to get more insight about RBAC action name changes.

With that in mind, you might need to update any scripts and provisioning files that are using the old action names.

If you get stuck, let us know and we will consider further steps.

6

Thanks for your reply.
i hope i understood what is required to try

  • we are not using any scripts or provisioning files.
  • 9.0.0-beta3 is suggested to use for migration, i used it, it failed with same error.
7

you are welcome @niteshchauhan

Do you know whether you’ve created any custom RBAC roles in the past?

I am going to throw some more ideas of what to look into buy they might not help, so take your time.

In your DB

  • If you check the roles table, do you have any roles that are not prefixed by fixed , managed or basic ?

  • Could you copy/paste in here your permission table please?

8

There were no custom roles created in the past, and i think with v8.5, RBAC was not there, and i dont see any options even now in grafana v8.5.9 with legacy alerting for creating roles.

  • there are only managed roles
sqlite> select * from role ;
1|managed:users:5:permissions||1|1|managed_1_users_5|2022-11-18 09:10:37.172367591+00:00|2022-11-18 09:10:37.172367591+00:00|||0
2|managed:users:34:permissions||1|1|managed_1_users_34|2022-11-18 09:10:37.172367591+00:00|2022-11-18 09:10:37.172367591+00:00|||0
3|managed:users:4:permissions||1|1|managed_1_users_4|2022-11-18 09:10:37.172367591+00:00|2022-11-18 09:10:37.172367591+00:00|||0
4|managed:users:42:permissions||1|1|managed_1_users_42|2022-11-18 09:10:37.172367591+00:00|2022-11-18 09:10:37.172367591+00:00|||0
5|managed:users:54:permissions||1|1|managed_1_users_54|2022-11-18 09:10:37.172367591+00:00|2022-11-18 09:10:37.172367591+00:00|||0
  • permissions table
sqlite> select * from permission ;
1|1|teams:read|teams:id:1|2022-11-18 09:10:37|2022-11-18 09:10:37
2|2|teams:read|teams:id:1|2022-11-18 09:10:37|2022-11-18 09:10:37
3|3|teams:read|teams:id:1|2022-11-18 09:10:37|2022-11-18 09:10:37
4|4|teams:read|teams:id:1|2022-11-18 09:10:37|2022-11-18 09:10:37
5|5|teams:read|teams:id:1|2022-11-18 09:10:37|2022-11-18 09:10:37
9

thank you for the info @niteshchauhan . We will take a look into it anyway, just in case.

Can I ask you to give us yet one more detail please? What steps have you taken to make the migration and in which order?

Also, is there any relationship between the containers you’ve mentioned?:

10

Happy 2023 Antonio,
for migration i did the following:

  • grafana container is running with image 8.5.9 and use a sqlite database file which is mounted to the container.
  • stop the container with 8.5.9 image.
  • run another container with 9.2.5 image mounting the same volumes where configuration and database files are present.
11

Hello @antonio
Any progress on this, let me know if there any other solutions i can try to resolve this.
Thanks

12

Hi @niteshchauhan,

Not sure if you have already looked at this post where many users actively posted the process to migrate/update Grafana:

I hope this helps.

13

Hi @usman.ahmad
My problem is about migrating from legacy alerting to unified alerting. Please check above comments for errors faced.
The link you have sent is for migrating with the same config and version. it doesn’t help.
Thanks

14

@niteshchauhan Please bear with us while I get feedback from some of our engineers.

15

@niteshchauhan

it seems that Grafana 9.3 should contain a fix for this issue. You might want to try to upgrade to that version instead of 9.2.5.

Good luck :slight_smile:

16

Hello @antonio
I’ve tried following which doesn’t helps.

  • migrating from legacy alerting to unified alerting in v8.5.9
  • migrating to v9.0.0, v9.2.5, v 9.3.0 with unified alerting.

Thanks

17

Copy your sqllite db elsewhere and query the alerts table wherein one of the columns has a value of 1-ZpF-i_cVz and see what is so odd/peculiar about that/those rows

18

Hello @yosiasz
This error was from our another env, which is running grafana 8.5.9 with mysql. in the comment i just gave an example that this is also failing to migrate.
for the sake solving this issue, i would still like to stick the error i have specified in problem statement, which is grafana 8.5.9 witih sqlite db.
i have pasted the content of tables here

20

There is this issue also with alerts

21

Please read the comment carefully, this issue is from some other env.
the problem in hand is having following logs

Failed to start grafana. error: migration failed (id = dashboard permissions): failed to migrate permissions: failed to create permissions for role: UNIQUE constraint failed: permission.role_id, permission.action, permission.scope
migration failed (id = dashboard permissions): failed to migrate permissions: failed to create permissions for role: UNIQUE constraint failed: permission.role_id, permission.action, permission.scope
1 Like
22

Thanks for stepping in @yosiasz

After reviewing this issue with the rest of the team and since we have gathered enough evidence to establish that this question is unlikely to be solved by just providing guidance, docs, or pointers, we need you,@niteshchauhan, to bring this up into our GitHub repo as a new issue. We will assign the new issue to one of our engineering teams, that will take a closer look into it.

In the new issue, please mention that you have been advised to open it , and provide a link back to this post.

23

a bug has been raised at github

1 Like