Performance: Messages for affiliates and exceptions with sponsors
Last Updated:
2011-04-01 04:00:00
Event:
2011-03-28 04:00:00
Status:
Closed
Brief Description:
Email Services
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
This issue is resolved. CIT is notifying affected individuals and re-delivering as much of their previously undelivered mail as possible. Click "read more" for details on the cause of the issue.
CIT TDX ID:
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
| Today, March 31, CIT is notifying the approximately 1,400 individuals who were affected by the 3/29 email problem and restoring as much of their previously undelivered mail as possible. \n\nFor some individuals, a portion of their undelivered mail was lost. These individuals are receiving a list that shows the date and time, sender, and subject line for each lost message. This is meant to aid them in deciding whether to contact certain senders.\n\nThe cause of the issue was a process that was initiated the morning of March 29 as part of a larger project to add needed functionality to the Cornell Exchange system. The process was a change to how email is routed internally within Cornell's email infrastructure. It was not expected to have any effect on the actual delivery of email.\n\nThe issue occurred because the process did not run gradually as expected, which resulted in incomplete routing data for the affected individuals. The outcome was that starting some time after 9:00 am (EST) through approximately 3:00 pm (EST) on March 29, the email system treated the affected individuals as if they had no email routing established for their accounts. Email delivered to them during this time would have been lost. \n\nEmail that was sent to the affected individuals between approximately 3:00 pm (EST) on March 29 and 6:30 am (EST) on March 30 -- when the issue was resolved for all affected individuals -- was stored and will be re-delivered.\n\nCIT extends our sincere apologies to the affected individuals. We have taken steps to ensure that such a problem does not happen again. | Today, March 31, CIT is notifying the approximately 1,400 individuals who were affected by the 3/29 email problem and restoring as much of their previously undelivered mail as possible. \n\nFor some individuals, a portion of their undelivered mail was lost. These individuals are receiving a list that shows the date and time, sender, and subject line for each lost message. This is meant to aid them in deciding whether to contact certain senders.\n\nThe cause of the issue was a process that was initiated the morning of March 29 as part of a larger project to add needed functionality to the Cornell Exchange system. The process was a change to how email is routed internally within Cornell's email infrastructure. It was not expected to have any effect on the actual delivery of email.\n\nThe issue occurred because the process did not run gradually as expected, which resulted in incomplete routing data for the affected individuals. The outcome was that starting some time after 9:00 am (EST) through approximately 3:00 pm (EST) on March 29, the email system treated the affected individuals as if they had no email routing established for their accounts. Email delivered to them during this time would have been lost. \n\nEmail that was sent to the affected individuals between approximately 3:00 pm (EST) on March 29 and 6:30 am (EST) on March 30 -- when the issue was resolved for all affected individuals -- was stored and will be re-delivered.\n\nCIT extends our sincere apologies to the affected individuals. We have taken steps to ensure that such a problem does not happen again. | 2011-03-31 | 04:00:00 |
| CIT is currently working to resolve the issue. | CIT is currently working to resolve the issue. | 2011-03-30 | 04:00:00 |
| CIT is currently working to resolve the issue. | CIT is currently working to resolve the issue. | 2011-03-30 | 04:00:00 |
| CIT is currently working to resolve the issue. \n | CIT is currently working to resolve the issue. \n | 2011-03-30 | 04:00:00 |
| CIT is investigating the status of messages that were not delivered to Cornell affiliates and Cornell exceptions with sponsors on Tuesday, March 29. An update will be provided as soon as possible.\n\n\n\nPrevious description of incident:\nCIT has received reports that email is not being delivered since Monday, March 28, for some Cornell affiliates and Cornell exceptions with sponsors. These individuals can send but not receive email. People sending email to affected addresses are not receiving notification of delivery failures. | CIT is investigating the status of messages that were not delivered to Cornell affiliates and Cornell exceptions with sponsors on Tuesday, March 29. An update will be provided as soon as possible.\n\n\n\nPrevious description of incident:\nCIT has received reports that email is not being delivered since Monday, March 28, for some Cornell affiliates and Cornell exceptions with sponsors. These individuals can send but not receive email. People sending email to affected addresses are not receiving notification of delivery failures. | 2011-03-30 | 04:00:00 |
| CIT is working to deliver as many of the previously undelivered messages as possible to the affected individuals, and to notify the affected individuals directly.\n\nNote that this issue began the morning of Tuesday, March 29. The previously reported information referencing March 28 was incorrect. | CIT is working to deliver as many of the previously undelivered messages as possible to the affected individuals, and to notify the affected individuals directly.\n\nNote that this issue began the morning of Tuesday, March 29. The previously reported information referencing March 28 was incorrect. | 2011-03-30 | 04:00:00 |
| CIT is currently working to resolve the issue. | CIT is currently working to resolve the issue. | 2011-03-29 | 04:00:00 |
| CIT is currently working to resolve the issue. | CIT is currently working to resolve the issue. | 2011-03-29 | 04:00:00 |
| CIT is currently working to resolve the issue.\n | CIT is currently working to resolve the issue.\n | 2011-03-29 | 04:00:00 |