Performance: CommonSpot Read/Only issues
Last Updated:
2010-02-15 05:00:00
Event:
2010-01-29 05:00:00
Status:
Closed
Brief Description:
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
We are continuing to encounter server instability on CommonSpot that is affecting some university web sites. \n\nWe have assembled a team to actively look into the root cause of these issues and implement any necessary changes. \n\nIf you experience a server outage, please call the NOC (255-9900) and email webservices-l@cornell.edu.\n\nThanks for your patience as we work out these issues.\n
CIT TDX ID:
Timeline of Changes
| Description | Current Status | Date | Time |
|---|---|---|---|
| We are continuing to investigate the causes of the late January/early February performance problems, and have taken some additional measures to address the problems. \n\nLogs indicated that a page on one site has been contributing to the problems, but it is not clear that it is the only source. As an interim step, we moved that page to a separate environment. \n\nWe are continuing to review logs and look for patterns to discover or rule out other contributing factors. We are also continuing to monitor the load and server performance, and troubleshooting other possible causes on a site-by-site basis. | We are continuing to investigate the causes of the late January/early February performance problems, and have taken some additional measures to address the problems. \n\nLogs indicated that a page on one site has been contributing to the problems, but it is not clear that it is the only source. As an interim step, we moved that page to a separate environment. \n\nWe are continuing to review logs and look for patterns to discover or rule out other contributing factors. We are also continuing to monitor the load and server performance, and troubleshooting other possible causes on a site-by-site basis. | 2010-02-15 | 05:00:00 |
| Commonspot sites are down again. CIT technical staff are working to resolve the issue. | Commonspot sites are down again. CIT technical staff are working to resolve the issue. | 2010-02-03 | 05:00:00 |
| Commonspot site are now responding normally. | Commonspot site are now responding normally. | 2010-02-03 | 05:00:00 |
| We are still experiencing intermittent outages on our Read/Only server. \nWe actively monitor our hosted services and we are being pro-active to \nrestart the service when performance degrades beyond usability.\n\nCIT has assembled a task force to find and fix the root cause of these \noutages. We have already identified some potential causes and have some \ngood ideas on changes that we can implement without negatively impacting \nyour sites. The first one we've already implemented is an upgrade to the \nJVM. We have seen improved stability in our ColdFusion hosting on this \nnew version and are hoping to see the same in CommonSpot hosting.\n\nAnother idea is to review the Google Search Appliance rules to exclude \ncertain load heavy pages, such as events, and also prevent crawling \nduring the day.\n\nWe are meeting on a daily basis and are treating this issue as a high \npriority. More information on this effort and the performance issues \nwill be shared as it becomes available.\n | We are still experiencing intermittent outages on our Read/Only server. \nWe actively monitor our hosted services and we are being pro-active to \nrestart the service when performance degrades beyond usability.\n\nCIT has assembled a task force to find and fix the root cause of these \noutages. We have already identified some potential causes and have some \ngood ideas on changes that we can implement without negatively impacting \nyour sites. The first one we've already implemented is an upgrade to the \nJVM. We have seen improved stability in our ColdFusion hosting on this \nnew version and are hoping to see the same in CommonSpot hosting.\n\nAnother idea is to review the Google Search Appliance rules to exclude \ncertain load heavy pages, such as events, and also prevent crawling \nduring the day.\n\nWe are meeting on a daily basis and are treating this issue as a high \npriority. More information on this effort and the performance issues \nwill be shared as it becomes available.\n | 2010-02-02 | 05:00:00 |
| We will let you know what we find \nand what steps will are going to take to address this issue.\n | We will let you know what we find \nand what steps will are going to take to address this issue.\n | 2010-01-29 | 05:00:00 |
| What we find and what steps will be taken will be posted as soon as this information is known. | What we find and what steps will be taken will be posted as soon as this information is known. | 2010-01-29 | 05:00:00 |