Notice history

No notices reported this month

From approximately 15:47-16:25 CEST our server partner in Sydney experienced outages that may have caused participants in that part of the world to experience delays in connecting to our platform.
June 23, 2023 at 6:45:03 PMUTC

UpdateJune 15, 2023 at 8:15:21 PMUTC
The team has compiled a complete post-mortem of the incident, which is available for viewing at the linked document.
ResolvedJune 14, 2023 at 2:01:23 PMUTC
After monitoring overnight, we are resolving this incident.

Cause

The run time for one of our scheduled job’s became longer than it was scheduled for, which caused a spike in one of our databases load. This led to slow performance of that specific database and caused the performance degradation.

Prevention Steps
- We have improved that scheduled job’s performance
- We have implemented new alarms to be early notified in case of future similar occurrences and be able to solve the issue without any customer impact.
MonitoringJune 13, 2023 at 6:10:29 PMUTC
We implemented a fix and are currently monitoring the result. Based on early results connection times and recording/streaming events should be working as expected.

UPDATE: We will continue monitoring until Wednesday 14 June 2023, but all systems should be operational and working as expected.
InvestigatingJune 13, 2023 at 4:18:17 PMUTC
We are currently investigating longer connection times and failed join events to rooms. Cloud recording and live-streaming may also fail to start or take longer to start.

ResolvedMay 23, 2023 at 2:36:14 PMUTC
This incident has been resolved and we've observed expected behavior in our insights updating accordingly!
IdentifiedMay 18, 2023 at 12:28:37 PMUTC
We're aware of an issue with delays in insights data updating via the dashboard and endpoint. The root cause has been identified and a temporary fix in place. There will be delays in data refreshing until a permanent fix is in place.

Whereby - Notice history