Performance Issue: Media3 Hosted Websites in Azure Having Intermitten Issues
Last Updated:
2024-07-31 10:07:46
Event:
2024-07-30 08:32:00
Status:
Closed
Brief Description:
Resolved: The vendor stabilized their services around 2:00pm ET Tuesday, July 30, 2024 and no further service interruptions have occurred. This incident is now resolved. Previously, websites hosted with Media3 in Azure periodically appeared unavailable.
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
Services appear to have stabilized
Services Affected:
Managed Web Hosting
Subsites Affected:
Media3 Managed Web Hosting
Full Description:
Resolved: The vendor stabilized their services on the afternoon of Tuesday, July 30, 2024 and no further service interruptions have occurred. This incident is now resolved. Previously, websites hosted with Media3 in Azure periodically appeared unavailable.
On Tuesday, Microsoft had multiple engineering teams engaged to diagnose and resolve the issue as soon as possible. They identified multiple workstreams and were working to mitigate impacted workstreams by performing failover operations. Details were provided as they became available.
Initial update from the vendor:
Network Infrastructure - Issues accessing a subset of Microsoft services
On Tuesday, Microsoft had multiple engineering teams engaged to diagnose and resolve the issue as soon as possible. They identified multiple workstreams and were working to mitigate impacted workstreams by performing failover operations. Details were provided as they became available.
Initial update from the vendor:
Network Infrastructure - Issues accessing a subset of Microsoft services
Microsoft is investigating reports of issues connecting to Microsoft services globally. Customers may experience timeouts connecting to Azure services. MS has multiple engineering teams engaged to diagnose and resolve the issue.
Cornell IT will continue working with the vendor to address the issue.
Cornell IT will continue working with the vendor to address the issue.
Previously, IT received reports that websites hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to:
www.cornell.edu
dailycheck.cornell.edu
leadership.cornell.edu
and president.cornell.edu
Cornell staff are investigating.
www.cornell.edu
dailycheck.cornell.edu
leadership.cornell.edu
and president.cornell.edu
Cornell staff are investigating.
CIT TDX ID:
1479138
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
Resolved: The vendor stabilized their services on the afternoon of Tuesday, July 30, 2024 and no further service interruptions have occurred. This incident is now resolved. Previously, websites hosted with Media3 in Azure periodically appeared unavailable. On Tuesday, Microsoft had multiple engineering teams engaged to diagnose and resolve the issue as soon as possible. They identified multiple workstreams and were working to mitigate impacted workstreams by performing failover operations. Details were provided as they became available. Initial update from the vendor: Network Infrastructure - Issues accessing a subset of Microsoft services Microsoft is investigating reports of issues connecting to Microsoft services globally. Customers may experience timeouts connecting to Azure services. MS has multiple engineering teams engaged to diagnose and resolve the issue. Cornell IT will continue working with the vendor to address the issue. Previously, IT received reports that websites hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to: www.cornell.edu dailycheck.cornell.edu leadership.cornell.edu and president.cornell.edu Cornell staff are investigating. |
Services appear to have stabilized |
2024-07-31 | 10:07:46 |
Update: The vendor stabilized their services in the afternoon of Tuesday, July 30, 2024 and no further service interruptions have occurred. This incident is now resolved. Previously, websites hosted with Media3 in Azure periodically appeared unavailable. On Tuesday, Microsoft had multiple engineering teams engaged to diagnose and resolve the issue as soon as possible. They identified multiple workstreams and were working to mitigate impacted workstreams by performing failover operations. Details were provided as they became available. Initial update from the vendor: Network Infrastructure - Issues accessing a subset of Microsoft services Microsoft is investigating reports of issues connecting to Microsoft services globally. Customers may experience timeouts connecting to Azure services. MS has multiple engineering teams engaged to diagnose and resolve the issue. Cornell IT will continue working with the vendor to address the issue. Previously, IT received reports that websites hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to: www.cornell.edu dailycheck.cornell.edu leadership.cornell.edu and president.cornell.edu Cornell staff are investigating. |
Services appear to have stabilized |
2024-07-31 | 10:06:15 |
Update: As of 2:06pm ET, Tuesday, July 30, 2024, services appear to have stabilized, and IT is continuing to monitor with Media3 and Microsoft. Previously, websites hosted with Media3 in Azure periodically appeared unavailable. Earlier today, Microsoft had multiple engineering teams engaged to diagnose and resolve the issue as soon as possible. They identified multiple workstreams and were working to mitigate impacted workstreams by performing failover operations. Details were provided as they became available. Initial update from the vendor: Network Infrastructure - Issues accessing a subset of Microsoft services Microsoft is investigating reports of issues connecting to Microsoft services globally. Customers may experience timeouts connecting to Azure services. MS has multiple engineering teams engaged to diagnose and resolve the issue. Cornell IT will continue working with the vendor to address the issue. Previously, IT received reports that websites hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to: www.cornell.edu dailycheck.cornell.edu leadership.cornell.edu and president.cornell.edu Cornell staff are investigating. |
Services appear to have stabilized; IT will continue monitoring with the vendors for Media3 and Azure. |
2024-07-30 | 14:11:18 |
Update: 10:30am ET, Tuesday, July 30, 2024 - Microsoft has multiple engineering teams engaged to diagnose and resolve the issue as soon as possible. They've identified multiple workstreams and are working to mitigate impacted workstreams by performing failover operations. More details will be provided as they become available. Initial update from the vendor: Network Infrastructure - Issues accessing a subset of Microsoft services Microsoft is investigating reports of issues connecting to Microsoft services globally. Customers may experience timeouts connecting to Azure services. MS has multiple engineering teams engaged to diagnose and resolve the issue. Cornell IT will continue working with the vendor to address the issue. Previously, IT received reports that websites hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to: www.cornell.edu dailycheck.cornell.edu leadership.cornell.edu and president.cornell.edu Cornell staff are investigating. |
Cornell staff are investigating. |
2024-07-30 | 10:44:15 |
Update: Microsoft Azure has just notified IT of a global issue related to this incident. Network Infrastructure - Issues accessing a subset of Microsoft services Microsoft is investigating reports of issues connecting to Microsoft services globally. Customers may experience timeouts connecting to Azure services. MS has multiple engineering teams engaged to diagnose and resolve the issue.IT will continue working with the vendor to address the issue. Previously, IT received reports that websites hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to: www.cornell.edu dailycheck.cornell.edu leadership.cornell.edu and president.cornell.edu Cornell staff are investigating. |
Cornell staff are investigating. |
2024-07-30 | 09:28:13 |
Websites that are hosted with Media3 in Azure may periodically appear unavailable. These include but not limited to: www.cornell.edu dailycheck.cornell.edu leadership.cornell.edu and president.cornell.edu Cornell staff are investigating. |
Cornell staff are investigating. |
2024-07-30 | 08:41:03 |