KWIZ Forms – Workflow Service Outage Report
|
|
|
|
|---|
|
|
|
|
|
|
|
No data loss expected, but events may have been delayed
|
|
|
|
|
On February 12th, 2025 workflows configured to run on an event trigger experienced a disruption of service.
Services have been restored around 2:00p EST.
There is no security concern, data leaks or data loss issues relating to this outage, however any event based workflows triggered during the outage have been delayed up to 12 hours.
You can find full details of the incident below, including steps we have taken to stop a similar issue in the future. Should you wish to discuss this incident further, please contact your account manager.
Incident Details
📅 Date & Time: 13th February 02:23a – 2:47p
📦 Product/Feature Affected: Forms Enterprise - Workflows with event trigger
⚠️ Description of Incident: As part of routine security maintenance to the KWIZ Foundation servers, automatic Workflows failed to trigger for customers using Forms Enterprise.
⚠️ Root Cause Analysis: We completed an upgrade of the TLS version for the KWIZ Foundation servers which was in line with Microsoft security guidance. However, despite this guidance, SharePoint does not currently support this version and workflow events failed to trigger after this update. Despite testing the fix after applying it on our fastring environment, our tests passed successfully and the outage only appeared hours after applying the fix, as a result of MSAL authentication tokens expiration.
✅ Resolution: We have adjusted the Foundation servers to align with current level of support for SharePoint and confirmed the services are restored.
☑️ Preventive Measures: Although detailed testing was completed before the release, we have identified a scenario where Microsoft token caching provided a positive test result which did not correctly reflect the change. We have updated our testing process to cater for this scenario for the future.