SchedulePro Operational

Incident Report for SchedulePro

Resolved

Between 15:45 UTC on 29 October and 00:05 UTC on 30 October 2025, customers and Microsoft services leveraging Azure Front Door (AFD) experienced latencies, timeouts, and errors.

The data plane was fully mitigated at 00:05 UTC on 30 October 2025.
Posted Oct 30, 2025 - 09:40 PDT

Update

SchedulePro is operational in the production environment and mobile app. Currently the API integrations are still recovering from the outage. The team continues to monitor systems and we will provide a full update on 10/30 once everything is fully resolved with the Azure outage.
Posted Oct 29, 2025 - 14:17 PDT

Monitoring

Through monitoring and restoration of services with Azure, SchedulePro is mostly operational via the website. Users should be able to access the system without much issue, but our team continues to monitor the systems. We will provide an update once things look consistently stable and fully resolve the issues upon Azure's resolution.
Posted Oct 29, 2025 - 13:43 PDT

Update

Azure has provided the following update:

At this stage, we anticipate full mitigation within the next four hours as we continue to recover nodes. This means we expect recovery to happen by 23:20 UTC on 29 October 2025.

The SchedulePro Development team is heavily monitoring the progress. We will continue providing updates as we learn more and have an idea of the ETA for full restoration of the SchedulePro platform.
Posted Oct 29, 2025 - 12:40 PDT

Update

Azure provided an update stating the deployment was initially expected to complete within 45 minutes; however, due to protective blocks put in place to safeguard the service, they are encountering some delays. While progress is ongoing, these safeguards are extending the overall deployment time. Once the rollout is complete, they will begin recovering nodes and re-routing traffic through healthy nodes to accelerate recovery.
Posted Oct 29, 2025 - 11:57 PDT

Update

Azure has initiated the deployment to the previous version. They expect to have this completed in the next 30 minutes, but it may take additional time to bring all customers back online including SchedulePro. We will continue monitoring progress and our access to the Azure portal.
Posted Oct 29, 2025 - 11:28 PDT

Update

Azure is continuing to work on the rollback of a recent update that caused access issues to the portal. They do not have an ETA for when the rollback will be completed, but they will provide an update soon.
Posted Oct 29, 2025 - 11:06 PDT

Identified

Azure is working on a rollback of a recent update that caused access issues to the portal. They do not have an ETA for when the rollback will be completed, but will provide an update soon.
Posted Oct 29, 2025 - 10:24 PDT

Update

Azure provided an update that they are actively assessing failover options of internal services. Their investigation into the contributing factors and additional recovery workstreams continues.
Posted Oct 29, 2025 - 10:01 PDT

Update

Azure Status Update:
We have taken action that is expected to address the portal access issues shortly. We are actively investigating the underlying issue and additional mitigation actions. More information will be provided soon.
Posted Oct 29, 2025 - 09:44 PDT

Update

Azure is investigating the issue and will provide updates. We will continue to monitor their status page and provide updates here as well.
Posted Oct 29, 2025 - 09:23 PDT

Investigating

SchedulePro is currently offline due to an outage with Azure. Our team is working with our provider and we will provide an update once we know more.
Posted Oct 29, 2025 - 08:57 PDT
This incident affected: Time & Attendance, API, System Access, User Communication, and Scheduling.