Performance: Some users deleted from Cornell Active Directory
Last Updated:
2015-11-24 05:00:00
Event:
2015-11-19 05:00:00
Status:
Closed
Brief Description:
Identity Management
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
Between 2pm and 3pm on Nov. 19, 1,236 user accounts in Cornell Active Directory were deleted. All accounts have been restored in the Active Directory system, and all affected users should be able to access all services.
CIT TDX ID:
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
| 11/20/2015 14:43: CIT's work on the issue is continuing, with help from Microsoft. We are sending an email to the individuals whose accounts were affected. Access to Exchange Group Accounts is not yet available to affected users; this will be fixed over the weekend.\n \nThe number of accounts was originally reported as 1,700 but was actually 1,236. Of those, about half were inactive accounts. Anyone experiencing issues is urged to contact the IT Service Desk to aid in troubleshooting: http://it.cornell.edu/support | 11/20/2015 14:43: CIT's work on the issue is continuing, with help from Microsoft. We are sending an email to the individuals whose accounts were affected. Access to Exchange Group Accounts is not yet available to affected users; this will be fixed over the weekend.\n \nThe number of accounts was originally reported as 1,700 but was actually 1,236. Of those, about half were inactive accounts. Anyone experiencing issues is urged to contact the IT Service Desk to aid in troubleshooting: http://it.cornell.edu/support | 2015-11-24 | 05:00:00 |
| 11/20/2015 14:43: CIT's work on the issue is continuing, with help from Microsoft. We are sending an email to the individuals whose accounts were affected. Access to Exchange Group Accounts is not yet available to affected users; this will be fixed over the weekend.\n \nThe number of accounts was originally reported as 1,700 but was actually 1,236. Of those, about half were inactive accounts. Anyone experiencing issues is urged to contact the IT Service Desk to aid in troubleshooting: http://it.cornell.edu/support | 11/20/2015 14:43: CIT's work on the issue is continuing, with help from Microsoft. We are sending an email to the individuals whose accounts were affected. Access to Exchange Group Accounts is not yet available to affected users; this will be fixed over the weekend.\n \nThe number of accounts was originally reported as 1,700 but was actually 1,236. Of those, about half were inactive accounts. Anyone experiencing issues is urged to contact the IT Service Desk to aid in troubleshooting: http://it.cornell.edu/support | 2015-11-24 | 05:00:00 |
| 11/22/2015 20:06: Microsoft is still working on fixing the handful of accounts. We've verified that only 4 are current faculty and staff. The others are alumni and retirees. Monday morning, if the accounts aren't already fixed, we will contact the 4 faculty and staff directly via phone to inform them of next steps.\n\n11/22/2015 08:39: All Active Directory entries appear to be functioning correctly now. \n\nA handful of Office 365 accounts are still not working. They are fully intact, except for the emails that were returned to sender while the accounts were unavailable, but we've determined that Microsoft will need to make the changes required to get them working again. We're in the process of coordinating this effort.\n\nA message describing what happened was sent to all affected users on Friday. See a copy at the Verified Communications page (CUWebLogin required): https://www.it.cornell.edu/security/verified_detail.cfm?doc=187 \n\nThank you very much for your patience during this process. | 11/22/2015 20:06: Microsoft is still working on fixing the handful of accounts. We've verified that only 4 are current faculty and staff. The others are alumni and retirees. Monday morning, if the accounts aren't already fixed, we will contact the 4 faculty and staff directly via phone to inform them of next steps.\n\n11/22/2015 08:39: All Active Directory entries appear to be functioning correctly now. \n\nA handful of Office 365 accounts are still not working. They are fully intact, except for the emails that were returned to sender while the accounts were unavailable, but we've determined that Microsoft will need to make the changes required to get them working again. We're in the process of coordinating this effort.\n\nA message describing what happened was sent to all affected users on Friday. See a copy at the Verified Communications page (CUWebLogin required): https://www.it.cornell.edu/security/verified_detail.cfm?doc=187 \n\nThank you very much for your patience during this process. | 2015-11-24 | 05:00:00 |
| 11/23/2015 10:12: All services that were disrupted by this issue have been restored, as has all affected users' access to their email history. Cornell engineers are continuing to monitor systems closely, and anyone still experiencing issues should contact the IT Service Desk ( http://it.cornell.edu/support ). | 11/23/2015 10:12: All services that were disrupted by this issue have been restored, as has all affected users' access to their email history. Cornell engineers are continuing to monitor systems closely, and anyone still experiencing issues should contact the IT Service Desk ( http://it.cornell.edu/support ). | 2015-11-24 | 05:00:00 |
| 11/23/2015 10:12: All services that were disrupted by this issue have been restored, as has all affected users' access to their email history. Cornell engineers are continuing to monitor systems closely, and anyone still experiencing issues should contact the IT Service Desk ( http://it.cornell.edu/support ). | 11/23/2015 10:12: All services that were disrupted by this issue have been restored, as has all affected users' access to their email history. Cornell engineers are continuing to monitor systems closely, and anyone still experiencing issues should contact the IT Service Desk ( http://it.cornell.edu/support ). | 2015-11-24 | 05:00:00 |
| All systems are continuing to work normally. IT@Cornell staff are assisting people with cleaning up remaining questions resulting from the problem, and are also looking into the incident to gather information about what happened and identify any details that can be applied to prevent similar issues in the future. Again, our apologies for the inconvenience.\n\nPlease report any questions or requests for assistance to the IT Service Desk: http://www.it.cornell.edu/support .\n | All systems are continuing to work normally. IT@Cornell staff are assisting people with cleaning up remaining questions resulting from the problem, and are also looking into the incident to gather information about what happened and identify any details that can be applied to prevent similar issues in the future. Again, our apologies for the inconvenience.\n\nPlease report any questions or requests for assistance to the IT Service Desk: http://www.it.cornell.edu/support .\n | 2015-11-24 | 05:00:00 |
| CIT continues to work on the problem. Not all mailboxes or active directory accounts are restored, though the share of people being affected is declining. An update will be provided later this morning, as soon as more information is available.\n\nAnyone experiencing problems should contact the IT Service Desk: http://it.cornell.edu/support\n | CIT continues to work on the problem. Not all mailboxes or active directory accounts are restored, though the share of people being affected is declining. An update will be provided later this morning, as soon as more information is available.\n\nAnyone experiencing problems should contact the IT Service Desk: http://it.cornell.edu/support\n | 2015-11-20 | 05:00:00 |
| We are currently restoring the users to CornellAD from backup, which should be completed by approximately 4:45pm. | We are currently restoring the users to CornellAD from backup, which should be completed by approximately 4:45pm. | 2015-11-19 | 05:00:00 |
| We apologize for the delay. CIT is working with Microsoft to reconnect Office 365 email access for the Active Directory accounts that were accidentally deleted. \n\nAll affected email accounts are intact, but any incoming mail *received during this outage* will bounce until the accounts are reconnected. \n\n*After* this issue is resolved, all affected users are advised to contact anyone regarding email they were expecting which hasn't arrived. It's possible it may have been sent, but not received. \n\nWe will email all affected users with information about exactly what happened and so on, when the accounts are back online.\n\nThank you for your patience. | We apologize for the delay. CIT is working with Microsoft to reconnect Office 365 email access for the Active Directory accounts that were accidentally deleted. \n\nAll affected email accounts are intact, but any incoming mail *received during this outage* will bounce until the accounts are reconnected. \n\n*After* this issue is resolved, all affected users are advised to contact anyone regarding email they were expecting which hasn't arrived. It's possible it may have been sent, but not received. \n\nWe will email all affected users with information about exactly what happened and so on, when the accounts are back online.\n\nThank you for your patience. | 2015-11-19 | 05:00:00 |
| Users can log into email at this time. However, some or all email may *appear* to be missing. Please be reassured that there is no cause for alarm. All affected email accounts are completely intact. We are in the process of merging newly activated accounts with the accounts that existed prior to the deletion in Active Directory.\n \nCIT is working overnight to ensure everyone is back up and able to work without inconvenience as soon as possible. We will provide an estimate for when all accounts will be restored as soon as we have that information. Thank you for your patience.\n\nThe following services were impacted prior to the 1700 entries being restored in Active Directory: Directory Services, Accounts and Access, Email and Calendar, Collaboration Tools (SharePoint, Lync, Yammer, OneDrive), and possibly other AD related services such as local file sharing and printing.\n\nPlease report any further issues with services, other than email and calendar--which we're still working on, to the IT Service Desk: http://www.it.cornell.edu/support/\n | Users can log into email at this time. However, some or all email may *appear* to be missing. Please be reassured that there is no cause for alarm. All affected email accounts are completely intact. We are in the process of merging newly activated accounts with the accounts that existed prior to the deletion in Active Directory.\n \nCIT is working overnight to ensure everyone is back up and able to work without inconvenience as soon as possible. We will provide an estimate for when all accounts will be restored as soon as we have that information. Thank you for your patience.\n\nThe following services were impacted prior to the 1700 entries being restored in Active Directory: Directory Services, Accounts and Access, Email and Calendar, Collaboration Tools (SharePoint, Lync, Yammer, OneDrive), and possibly other AD related services such as local file sharing and printing.\n\nPlease report any further issues with services, other than email and calendar--which we're still working on, to the IT Service Desk: http://www.it.cornell.edu/support/\n | 2015-11-19 | 05:00:00 |