Unplanned Outage: CIT WEB Hosting
Last Updated:
2009-09-01 04:00:00
Event:
2009-09-01 04:00:00
Status:
Closed
Brief Description:
ColdFusion Hosting
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
CIT Hosting is currently working on service-affecting issues with the Coldfusion Multiserver environment, which is affecting Colts and other applications, and the www.alumni.cornell.edu website, among others.
CIT TDX ID:
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
| Coldfusion technical staff are investigating. | Coldfusion technical staff are investigating. | 2009-09-01 | 04:00:00 |
| Coldfusion technical staff are still investigating.\n | Coldfusion technical staff are still investigating.\n | 2009-09-01 | 04:00:00 |
| CIT Hosting is now available. | CIT Hosting is now available. | 2009-09-01 | 04:00:00 |
| MSCF experienced a significant outage today from approximately 1:43pm - 4:07pm. \n\nThis is a rough description of what it appears happened.\n\nInitial cause appears to have been related to cornell.edu being crawled by 2 bots (Yahoo and Cornell GSA) at the same time. This loaded the database server (Flint) which is also shared by uportal. Uportal requests backed up. Uportal channels are fed by MSCF (cfp-isinf). \nBackedup CF requests ate up swap space on Orpheus6 slowing the server to a crawl. It became necessary to restart all of MSCF at the cluster-level. Due to some work-in-progress, some cluster resources did not come up cleanly, causing the MSCF Apache to fail to restart properly. The problem resources were identified, properly restarted allowing MSCF Apache to be restarted successfully. \n\n(Bot crawl was remediated early on in the outage.)\n | MSCF experienced a significant outage today from approximately 1:43pm - 4:07pm. \n\nThis is a rough description of what it appears happened.\n\nInitial cause appears to have been related to cornell.edu being crawled by 2 bots (Yahoo and Cornell GSA) at the same time. This loaded the database server (Flint) which is also shared by uportal. Uportal requests backed up. Uportal channels are fed by MSCF (cfp-isinf). \nBackedup CF requests ate up swap space on Orpheus6 slowing the server to a crawl. It became necessary to restart all of MSCF at the cluster-level. Due to some work-in-progress, some cluster resources did not come up cleanly, causing the MSCF Apache to fail to restart properly. The problem resources were identified, properly restarted allowing MSCF Apache to be restarted successfully. \n\n(Bot crawl was remediated early on in the outage.)\n | 2009-09-01 | 04:00:00 |
| If your still experiencing problems please contact the NOC at 5-9900. | If your still experiencing problems please contact the NOC at 5-9900. | 2009-09-01 | 04:00:00 |