Performance: Vault Drive fail in CCC-EMC1
Last Updated:
2010-11-10 05:00:00
Event:
2010-11-09 05:00:00
Status:
Closed
Brief Description:
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
We had a vault drive fail in ccc-emc1 that has caused write cache to be disabled. This will have impact on write performance for the array and any servers using it. We are working to get this resolved as quickly as possible.
CIT TDX ID:
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
| We expect to have this resolved by 10:30 AM this morning. | We expect to have this resolved by 10:30 AM this morning. | 2010-11-10 | 05:00:00 |
| This drive has been replaced successfully and the array should be working normally once again. | This drive has been replaced successfully and the array should be working normally once again. | 2010-11-10 | 05:00:00 |
| The following servers/services are affected by this.\n\naudi1: GEO clustering RAC (testing) \naudi2: GEO clustering RAC (testing) \nburdock: PS/STARS test/production \nchokeberry: Fedora \ndill: PS/STARS test/production \nengland1: ESX Extra Tier Cluster in Rhodes Hall\nfennel: PS/STARS test/production \ngalena1: Cluster testing \ngalena2: Cluster testing \nginger: PS/STARS test/production \ngingko: UVIS Standby and Reporting Db \nhollyhock: Oracle Dataguard Production\nireland1: ESX Cluster in CCC \nireland2: ESX Cluster in CCC \niris: This machine is clustered with Opal1 and\n Opal2 in the CUWeblogin cluster CUWeblogin,\n NetID and ApplicantID self service utilities, \n ServiceIDManager, Shibboleth\njasmine: PS/STARS test/production \njujuba: CUInfo \nlibrary45: Library Voyager Database Server \nlibrary47: Cornell University Voyager test system\nlily: " S&O Internal Infrastructure DR Server at CCC. \n Provides backup for Cfengine, \n SFInfo,SysDocs "\nmarigold: oracle standby machine \nmarjoram: PS/STARS test/production \nopal1: This machine is paired with Opal2 in the \n CUWeblogin cluster. The following services\n run on Opal 1: CUWebLogin for web\n application authentication, the Permit \n Server for authorization, and NetID\n processes (creation, password resets, self-\n service activation)CUWebLogin \nopal2: This machine is paired with Opal2 in the \n CUWeblogin cluster CUWebLogin, NetID\n self service utilities \npeach: Oracle production database standby for \n Blackboard and Kronos \nperiwinkle: PS/STARS test/production \npineapple: CUInfo \nredwood: CUPeople \nrevelstoke2: EZ-Backup web server, client distribution,\n billing, TSM monitoring, backup notification \nrose: PS/STARS test/production \nverbena: PS/STARS test/production \nviola: PS/STARS test/production | The following servers/services are affected by this.\n\naudi1: GEO clustering RAC (testing) \naudi2: GEO clustering RAC (testing) \nburdock: PS/STARS test/production \nchokeberry: Fedora \ndill: PS/STARS test/production \nengland1: ESX Extra Tier Cluster in Rhodes Hall\nfennel: PS/STARS test/production \ngalena1: Cluster testing \ngalena2: Cluster testing \nginger: PS/STARS test/production \ngingko: UVIS Standby and Reporting Db \nhollyhock: Oracle Dataguard Production\nireland1: ESX Cluster in CCC \nireland2: ESX Cluster in CCC \niris: This machine is clustered with Opal1 and\n Opal2 in the CUWeblogin cluster CUWeblogin,\n NetID and ApplicantID self service utilities, \n ServiceIDManager, Shibboleth\njasmine: PS/STARS test/production \njujuba: CUInfo \nlibrary45: Library Voyager Database Server \nlibrary47: Cornell University Voyager test system\nlily: " S&O Internal Infrastructure DR Server at CCC. \n Provides backup for Cfengine, \n SFInfo,SysDocs "\nmarigold: oracle standby machine \nmarjoram: PS/STARS test/production \nopal1: This machine is paired with Opal2 in the \n CUWeblogin cluster. The following services\n run on Opal 1: CUWebLogin for web\n application authentication, the Permit \n Server for authorization, and NetID\n processes (creation, password resets, self-\n service activation)CUWebLogin \nopal2: This machine is paired with Opal2 in the \n CUWeblogin cluster CUWebLogin, NetID\n self service utilities \npeach: Oracle production database standby for \n Blackboard and Kronos \nperiwinkle: PS/STARS test/production \npineapple: CUInfo \nredwood: CUPeople \nrevelstoke2: EZ-Backup web server, client distribution,\n billing, TSM monitoring, backup notification \nrose: PS/STARS test/production \nverbena: PS/STARS test/production \nviola: PS/STARS test/production | 2010-11-09 | 05:00:00 |
| Here are the VM?s running on the Ireland/england ESX cluster\n\nashford02 - ISIS Hudson \navoca01-02 - AFS test\nbathurst03 - Msg Server\nbelfast02 - Webmail KDC \nbelfast04 - IdM test \ncf002, 004, 006, 008, 010 - Coldfusion Test \ncf056-cf065 - ColdFusion Prod \ncork02, cork04, cork06, cork08, cork10 - IdM server \ncree01 - SEP backup \ndalton02 - DBA Beacon\ndublin01-04 - DBA Win Servers \ndundee01 - squi server \ndysart01 DNSDB Test \nkuali01-kuali05 - Kuali Test\nleeds03, leeds05 - IDM servers \npar01, par03, par05, par07 - IdM Server \npembroke01 - Kronos Prod\nquilty01 - QualityCenter Test VM\nrenmore01 - IS FileServer\nsf-ferns02 - FileServer \nsf-kells02 - KMS server \nsf-rush02 - S&O Mgmt \nsf-wick02 - hopperrdp \nsg5 - CITWIN DC \nsutton01- Coldfusion test\ntchost002, 004, 006, 008, 010, 012, 014, 016, 018, 20 - TomCat Hosting \nthompson03 - Tidal \ntisdale01 - Test Kronos\n | Here are the VM?s running on the Ireland/england ESX cluster\n\nashford02 - ISIS Hudson \navoca01-02 - AFS test\nbathurst03 - Msg Server\nbelfast02 - Webmail KDC \nbelfast04 - IdM test \ncf002, 004, 006, 008, 010 - Coldfusion Test \ncf056-cf065 - ColdFusion Prod \ncork02, cork04, cork06, cork08, cork10 - IdM server \ncree01 - SEP backup \ndalton02 - DBA Beacon\ndublin01-04 - DBA Win Servers \ndundee01 - squi server \ndysart01 DNSDB Test \nkuali01-kuali05 - Kuali Test\nleeds03, leeds05 - IDM servers \npar01, par03, par05, par07 - IdM Server \npembroke01 - Kronos Prod\nquilty01 - QualityCenter Test VM\nrenmore01 - IS FileServer\nsf-ferns02 - FileServer \nsf-kells02 - KMS server \nsf-rush02 - S&O Mgmt \nsf-wick02 - hopperrdp \nsg5 - CITWIN DC \nsutton01- Coldfusion test\ntchost002, 004, 006, 008, 010, 012, 014, 016, 018, 20 - TomCat Hosting \nthompson03 - Tidal \ntisdale01 - Test Kronos\n | 2010-11-09 | 05:00:00 |
| The part is estimated to arrive by 10am tomorrow morning. | The part is estimated to arrive by 10am tomorrow morning. | 2010-11-09 | 05:00:00 |