Skip to main content

Performance: Some email delayed or not delivered during update

Last Updated:
2015-04-13 04:00:00
Event:
2015-04-08 04:00:00
Status:
Closed
Brief Description:
email
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
During a system update on 4/8/15, some messages were delayed and some were not delivered. Senders were notified of non-delivery, a share eventually went through, and more were retrieved from the system and sent.
CIT TDX ID:



Timeline of Changes

Description Current Status Date Time
All mail that could be retrieved from the system had been sent as of Friday, April 10. All mail that could be retrieved from the system had been sent as of Friday, April 10. 2015-04-13 04:00:00
Additional email that could be retrieved from the system has been sent. As a result, a larger share of messages that initially did not go through (and that had triggered messages to the sender that they were not delivered) has made it to the intended recipients.\n\nHowever, there is a possibility that any given email that triggered a non-delivery message to the sender did not get re-queued. We recommend that anyone who received a non-delivery message for an important email and who has not already re-sent it should do so. We apologize for the inconvenience and any duplication this may cause. Additional email that could be retrieved from the system has been sent. As a result, a larger share of messages that initially did not go through (and that had triggered messages to the sender that they were not delivered) has made it to the intended recipients.\n\nHowever, there is a possibility that any given email that triggered a non-delivery message to the sender did not get re-queued. We recommend that anyone who received a non-delivery message for an important email and who has not already re-sent it should do so. We apologize for the inconvenience and any duplication this may cause. 2015-04-10 04:00:00
Cornell engineers have found a way to deliver a share of email that did not make it through the system during yesterday’s issues. These will be sent over the next few hours and will result in recipients getting messages that have been delayed, and in some cases, they may receive a duplicate of mail that has already been delivered to them. We apologize for any confusion or inconvenience this may cause.\n\nBackground: \nThe issue appears to have been caused when custom settings that exist to provide added features to the Cornell email environment needed to be adjusted to work with the updated Microsoft system, resulting in some email being delayed and some not being delivered. As indicated in a previous update, senders whose email was not delivered were notified. \n\nThe issue appeared around 10:30am on Wednesday, April 8, 2015, and the process of adjusting settings was largely concluded by 12:30pm. By around 3:30pm, much of the email delivery that could be made possible by those fixes had been delivered. As noted above, a way has been found to release more undelivered email, and that is currently underway.\n \nEngineers are still evaluating the extent of the issue and identifying the messages that were affected. An update will be provided when next steps have been identified. Cornell engineers have found a way to deliver a share of email that did not make it through the system during yesterday’s issues. These will be sent over the next few hours and will result in recipients getting messages that have been delayed, and in some cases, they may receive a duplicate of mail that has already been delivered to them. We apologize for any confusion or inconvenience this may cause.\n\nBackground: \nThe issue appears to have been caused when custom settings that exist to provide added features to the Cornell email environment needed to be adjusted to work with the updated Microsoft system, resulting in some email being delayed and some not being delivered. As indicated in a previous update, senders whose email was not delivered were notified. \n\nThe issue appeared around 10:30am on Wednesday, April 8, 2015, and the process of adjusting settings was largely concluded by 12:30pm. By around 3:30pm, much of the email delivery that could be made possible by those fixes had been delivered. As noted above, a way has been found to release more undelivered email, and that is currently underway.\n \nEngineers are still evaluating the extent of the issue and identifying the messages that were affected. An update will be provided when next steps have been identified. 2015-04-09 04:00:00
We are currently investigating this problem and will notify you of any updates on this situation. We are currently investigating this problem and will notify you of any updates on this situation. 2015-04-08 04:00:00
The problem has been fixed and email is being delivered and estimated at being caught up within 15-30 minutes.\n The problem has been fixed and email is being delivered and estimated at being caught up within 15-30 minutes.\n 2015-04-08 04:00:00
There is a large amount of queued email and therefore it is taking longer than expected to clear the backlog. There is a large amount of queued email and therefore it is taking longer than expected to clear the backlog. 2015-04-08 04:00:00
Previous updates include:\n\n04/08/2015 02:19 PM: There is a large amount of queued email and therefore it is taking longer than expected to clear the backlog.\n\n04/08/2015 01:42 PM: The problem has been fixed and email is being delivered and estimated at being caught up within 15-30 minutes.\n\n04/08/2015 01:23 PM: We are currently investigating this problem and will notify you of any updates on this situation. Previous updates include:\n\n04/08/2015 02:19 PM: There is a large amount of queued email and therefore it is taking longer than expected to clear the backlog.\n\n04/08/2015 01:42 PM: The problem has been fixed and email is being delivered and estimated at being caught up within 15-30 minutes.\n\n04/08/2015 01:23 PM: We are currently investigating this problem and will notify you of any updates on this situation. 2015-04-08 04:00:00
In the course of a update on Wednesday, April 8, 2015, there was a delay in delivery of some messages going through the Cornell email system, and some messages were not delivered. \n\nSenders of mail that was not initially delivered received messages that their email did not go through. Some of these emails were eventually delivered, and the logs of the transmissions are being examined to identify ones that were not. An update will be provided when more information is available. In the course of a update on Wednesday, April 8, 2015, there was a delay in delivery of some messages going through the Cornell email system, and some messages were not delivered. \n\nSenders of mail that was not initially delivered received messages that their email did not go through. Some of these emails were eventually delivered, and the logs of the transmissions are being examined to identify ones that were not. An update will be provided when more information is available. 2015-04-08 04:00:00