Unplanned Outage: Resolved: Amazon Web Services hosting outage affects Cornell Services
Last Updated:
2021-12-08 13:40:43
Event:
2021-12-07 16:38:00
Status:
Closed
Brief Description:
An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, Code42, and Video on Demand. This outage may also be affecting other Cornell services.
User Impact:
Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console are unavailable. This outage may also be affecting other Cornell services.
The Video on Demand vendor is reporting that intermittent errors may occur during content transcoding and/or on content playback.
Workaround:
There is no workaround for this issue
Current Status:
Amazon Web Services (AWS) is reporting this issue as resolved.
Services Affected:
Apps on Demand
Learning Technologies
Backup, Archive, and Recovery
Video Streaming & Hosting
Full Description:
An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console and Video on Demand (Kaltura). This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect.
CIT TDX ID:
557712
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
| An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console and Video on Demand (Kaltura). This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect. | Amazon Web Services (AWS) is reporting this issue as resolved. | 2021-12-08 | 13:40:43 |
| An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console and Video on Demand (Kaltura). This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect. | AWS's services have partially recovered but have not yet made a full recovery. Cornell services are operational with degraded performance. CIT is continuing to monitor the situation. Video on Demand update: No additional errors within have been identified since the earlier errors were resolved at 18:52 UTC. | 2021-12-08 | 00:05:08 |
| An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console and Video on Demand (Kaltura). This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect. | AWS's services have partially recovered but have not yet made a full recovery. Cornell services are operational with degraded performance. CIT is continuing to monitor the situation. | 2021-12-07 | 23:14:50 |
| An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console and Video on Demand (Kaltura). This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect. | The vendor has identified that an increase in traffic between specific internal services is causing congestion within several network devices in the US-EAST-1 Region. They continue to work across every service to investigate and mitigate the impact. They are focusing efforts on a specific mitigation for this traffic increase. They are taking action over the next 30-60 minutes that they expect will put them on the path to recovery, however, they do not have an ETA for full recovery yet. | 2021-12-07 | 21:30:41 |
| An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console and Video on Demand (Kaltura). This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect. | The vendor is investigating the issue. Updated to include Code 42 Admin Console and Video on Demand (Kaltura). VOD: The vendor is reporting that intermittent errors may occur during content transcoding and/or on content playback. These intermittent errors accessing some content are related to the AWS hosting issue. The vendor support team is working with AWS to mitigate the impact as AWS works to resolve the issue. | 2021-12-07 | 18:44:56 |
| An Amazon Web Services (AWS) US-East hosting outage is affecting Cornell services: Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, Digication, and Code42 Admin Console. This outage may also be affecting other Cornell services. Users will receive errors and will not be able to connect. | The vendor is investigating the issue. | 2021-12-07 | 18:14:15 |
| An Amazon Web Services (AWS) US-East hosting outage is affecting several Cornell services, including Apps on Demand, Canvas, Panopto, iClicker Cloud, iClicker Student apps, and Digication. This outage may also be affecting other Cornell services. Students using these services will receive errors and will not be able to connect. | The vendor is investigating the issue. | 2021-12-07 | 17:29:15 |
| Apps on Demand (AWS AppStream 2.0) is unavailable due to a larger Amazon Web Services (AWS) US-East outage. Students initiating connections from Canvas will receive errors and will not be able to connect. | The vendor is investigating the issue. | 2021-12-07 | 16:47:38 |