Internal Server Error when creating/updating Event Grid Scoped Event Subscription

Question

Internal Server Error when creating/updating Event Grid Scoped Event Subscription

Reidan Beachill 0

Details: I am encountering an internal server error when trying to create or update a scoped Event Grid event subscription via Terraform.

Scope: /subscriptions/<subscription-id>/resourceGroups/<resource-group-name>/providers/Microsoft.EventGrid/topics/<event-grid-topic-name>

Location: uksouth

API Response Snippet:

 {
  "status": "Failed",
  "error": {
    "code": "Internal error",
    "message": "The operation failed due to an internal server error. The initial state of the impacted resources (if any) are restored. Please try again in few minutes. If error still persists, report 70094c54-7495-4e3d-baf7-cdfd900aebf1:8/11/2025 10:37:45 AM (UTC) to our forums for assistance or raise a support ticket."
  }
}

The failure occurs consistently despite multiple retries. Can you confirm if there is a known service issue in UK South or advise how to resolve this?

Reidan Beachill 0 Reputation points

2025-08-12T15:19:02.7533333+00:00

@Harish Badijana

Thanks Harish. Helpful to know there’s a known issue in UK South. For context, we saw consistent failures creating scoped Event Grid subscriptions via Terraform between 10:37 and 10:39 UTC on 11 August 2025. Example correlation IDs: 70094c54-7495-4e3d-baf7-cdfd900aebf1, 1fffc7a8-3e07-437c-9df5-e4f608345729, 703145e8-892b-4102-b2d9-6bd55b526269. ActivityId was empty. The SPN has Contributor on the RG and EventGrid EventSubscription Contributor at the topic scope. I will retry with delay and attempt a create via Azure CLI/Portal (initially without DL to isolate). Could you share the incident ID tracking this UK South issue and whether CLI/Portal use a different path that should succeed, or if there’s a recommended API version while the backend fix rolls out? If needed I will raise a support ticket and include the above IDs and timestamps.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-19T00:22:49.0733333+00:00

@Reidan Beachill there is no API version recommended, you can try using a stable version and if supported set the API version into Terraform resource

Hope this helps in resolving the issue, do let me know if you have any further questions on this
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-20T01:03:50.3+00:00

@Reidan Beachill Just checking to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-21T16:49:53.6633333+00:00

@Reidan Beachill Sorry for the confusion here there is no active incident going in UK south at shared time stamp in the error message.

Based on the information in error message, I had looked into the backend logs and confirm that event subscription creation operation is failed with error "This request is not authorized to perform this operation"

Could you please check the built-in roles mentioned here in this documentation (Azure Event Grid security and authentication - Azure Event Grid | Microsoft Learn) and assign the respective permission to your SPN, retry the operation again.

if you are still facing the issue please do share the requested details over private to check further.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-22T16:36:53.57+00:00

@Reidan Beachill Just checking to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-25T17:05:54.21+00:00

@Reidan Beachill Following up to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this.

1 answer

Your answer

Reidan Beachill 0 Reputation points

2025-08-12T15:19:02.7533333+00:00

@Harish Badijana

Thanks Harish. Helpful to know there’s a known issue in UK South. For context, we saw consistent failures creating scoped Event Grid subscriptions via Terraform between 10:37 and 10:39 UTC on 11 August 2025. Example correlation IDs: 70094c54-7495-4e3d-baf7-cdfd900aebf1, 1fffc7a8-3e07-437c-9df5-e4f608345729, 703145e8-892b-4102-b2d9-6bd55b526269. ActivityId was empty. The SPN has Contributor on the RG and EventGrid EventSubscription Contributor at the topic scope. I will retry with delay and attempt a create via Azure CLI/Portal (initially without DL to isolate). Could you share the incident ID tracking this UK South issue and whether CLI/Portal use a different path that should succeed, or if there’s a recommended API version while the backend fix rolls out? If needed I will raise a support ticket and include the above IDs and timestamps.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-19T00:22:49.0733333+00:00

@Reidan Beachill there is no API version recommended, you can try using a stable version and if supported set the API version into Terraform resource

Hope this helps in resolving the issue, do let me know if you have any further questions on this
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-20T01:03:50.3+00:00

@Reidan Beachill Just checking to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-21T16:49:53.6633333+00:00

@Reidan Beachill Sorry for the confusion here there is no active incident going in UK south at shared time stamp in the error message.

Based on the information in error message, I had looked into the backend logs and confirm that event subscription creation operation is failed with error "This request is not authorized to perform this operation"

Could you please check the built-in roles mentioned here in this documentation (Azure Event Grid security and authentication - Azure Event Grid | Microsoft Learn) and assign the respective permission to your SPN, retry the operation again.

if you are still facing the issue please do share the requested details over private to check further.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-22T16:36:53.57+00:00

@Reidan Beachill Just checking to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this.
Harish Badijana 40 Reputation points Microsoft External Staff Moderator

2025-08-25T17:05:54.21+00:00

@Reidan Beachill Following up to see if you have a chance to check my previous response and helped, do let me know if you have any further questions on this.

Answer 1

@Reidan Beachill The error you mentioned is consistent with a known issue affecting Terraform deployments of Event Grid subscriptions in UK South. This error is not caused by misconfiguration but appears to be a backend service issue.

To avoid this failure to occur consistently despite multiple retries:

Retry with Delay: Although you've already tried this, Microsoft suggests retrying after a few minutes due to transient backend failures.

Use Azure CLI or Portal: If Terraform consistently fails, try creating the subscription manually via Azure CLI or the Portal to isolate whether the issue is Terraform-specific.

Check Role Assignments: Ensure the identity used by Terraform has the correct permissions on the Event Grid Topic. Misconfigured access can cause delivery failures.

Raise a Support Ticket: Include the correlation ID and timestamp in your support request. This will help Microsoft trace the backend logs.

I hope this helps in resolving the issue, do let me know if you have any further questions on this

Share via

Internal Server Error when creating/updating Event Grid Scoped Event Subscription

1 answer

Your answer