502 errors while viewing the Printer Dashboard

Incident Report for Carbon

Postmortem

What happened? On Monday, January 30th, at 12:36 PM PST, the Carbon Software team released a routine update to the Printer Dashboard. After this release, we discovered an unforeseen conflict that displayed a 502 gateway error and blocked access for all users. The Carbon API was also unable to receive requests.

Who was impacted? Users attempting to access the Carbon Printer Dashboard ([customer].print.carbon3d.com) and users sending requests through the Carbon API

When was it resolved? The issue was identified and resolved at 12:51 PM PST.

What are we doing to prevent this from happening in the future? Carbon has conducted an analysis of the root cause of this incident and is taking steps to prevent a recurrence.

Posted Jan 30, 2023 - 13:57 PST

Resolved

This incident has been resolved.
Posted Jan 30, 2023 - 13:14 PST

Monitoring

A fix has been implemented and we are monitoring the results.
Posted Jan 30, 2023 - 12:51 PST

Investigating

We are currently investigating this issue.
Posted Jan 30, 2023 - 12:36 PST
This incident affected: Carbon Dashboard.