Incident Overview

On October 3, 2023, Canva experienced a significant outage affecting its API gateway, resulting in service disruptions for users. The incident lasted approximately four hours, during which time users faced issues accessing the platform's features and services.

Cause of the Outage

The outage was traced back to a configuration error in the API gateway, which was inadvertently deployed during a routine update. This error caused a cascading failure in the system, leading to widespread service unavailability.

Resolution Steps

The engineering team quickly identified the root cause and began implementing a rollback of the faulty configuration. Additional measures included deploying a hotfix to prevent similar issues in the future and enhancing monitoring systems to detect such anomalies more swiftly.

Impact and Mitigation

The outage impacted a significant portion of Canva's user base, disrupting their workflow and access to essential design tools. In response, Canva has committed to improving its deployment processes and has outlined a series of steps to bolster system resilience and ensure service reliability.

Future Improvements

Canva plans to conduct thorough reviews of its deployment procedures and invest in more robust testing environments to catch potential issues before they reach production.