Skip to main content

Unplanned Outage: Off Campus Fiber outage (Syracuse Fiber Cut)

Last Updated:
2012-03-27 04:00:00
Event:
2012-03-25 04:00:00
Status:
Closed
Brief Description:
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
Cornell has an outage starting at Sunday, March 25, 13:57 EDT on a dark fiber circuit between Ithaca and Syracuse impacting campus wide area connectivitiy. An alternate ISP is providing connectivity and no major outages to or from campus are reported.
CIT TDX ID:



Timeline of Changes

Description Current Status Date Time
At 7:18pm on Monday the fiber for Cornell's main wide-area connections was repaired. Network testing / monitoring systems in Ithaca and Syracuse indicate the fiber is functioning as expected. The “all clear” was received from the vendor late Monday night and emergency maintenance was performed at 5:00am Tuesday morning to restore services to this link. All services have been moved back to the original fiber path and are functioning as expected.\n\nServices affected by restoring service:\nCogent ISP service\nORIE in NYC\nWeill Medical\nNLR\nAzzurro Video\nEZ-Backup Remote\n\nThe fiber damage was in a rural area 38km from campus which required the replacement of a whole segment of aerial fiber suspended between high-voltage towers. The cause of the failure is still under investigation by the vendor.\n At 7:18pm on Monday the fiber for Cornell's main wide-area connections was repaired. Network testing / monitoring systems in Ithaca and Syracuse indicate the fiber is functioning as expected. The “all clear” was received from the vendor late Monday night and emergency maintenance was performed at 5:00am Tuesday morning to restore services to this link. All services have been moved back to the original fiber path and are functioning as expected.\n\nServices affected by restoring service:\nCogent ISP service\nORIE in NYC\nWeill Medical\nNLR\nAzzurro Video\nEZ-Backup Remote\n\nThe fiber damage was in a rural area 38km from campus which required the replacement of a whole segment of aerial fiber suspended between high-voltage towers. The cause of the failure is still under investigation by the vendor.\n 2012-03-27 04:00:00
The fiber provider is continuing to work on this problem. The outage is the result of a fiber break / cut approximately 38km from the Ithaca campus. Estimated time to Repair is currently unknown.\n\nThe following connections have been manually reconfigured to use a 1G backup path:\n* Cogent ISP : Commodity Internet Service (Internet peering now at reduced capacity)\n* ORIE remote office, NYC : ORIE remote site at 55 Broad Street, NY, NY\n\nThe follow connections are still down, but sites are reachable via alternate service providers and paths:\n* NLR Peering : NLR PacketNet and NLR FrameNet.\n* Weill Medical School private peering : Weill Medical College private Internet peering (New York and Qatar).\n\nThe following resources are unavailable while this fiber circuit is down:\n* CIT off-site tape backup : Remote Tape collection at Weill Medical, 575 Lexington Avenue,NY, NY\n* AzzurroHD video feed : Video feeds from Cornell to production studios via AzzurroHD.”\n\n The fiber provider is continuing to work on this problem. The outage is the result of a fiber break / cut approximately 38km from the Ithaca campus. Estimated time to Repair is currently unknown.\n\nThe following connections have been manually reconfigured to use a 1G backup path:\n* Cogent ISP : Commodity Internet Service (Internet peering now at reduced capacity)\n* ORIE remote office, NYC : ORIE remote site at 55 Broad Street, NY, NY\n\nThe follow connections are still down, but sites are reachable via alternate service providers and paths:\n* NLR Peering : NLR PacketNet and NLR FrameNet.\n* Weill Medical School private peering : Weill Medical College private Internet peering (New York and Qatar).\n\nThe following resources are unavailable while this fiber circuit is down:\n* CIT off-site tape backup : Remote Tape collection at Weill Medical, 575 Lexington Avenue,NY, NY\n* AzzurroHD video feed : Video feeds from Cornell to production studios via AzzurroHD.”\n\n 2012-03-26 04:00:00
The fiber provider is splicing a new span of fiber. They have isolated the break to that span. They are actively working to resolve this issue as soon as possible. The fiber provider is splicing a new span of fiber. They have isolated the break to that span. They are actively working to resolve this issue as soon as possible. 2012-03-26 04:00:00
The reason for the outage is unknown. The fiber provider has been notified and repairs are underway.\nEstimated time to Repair is currently unknown.\n\nThe follow connections are down, but are reachable via alternate paths:\n\n * Cogent ISP : Cogent ISP (Internet peering at 10GE)\n * NLR Peering : NLR PacketNet and NLR FrameNet.\n * Weill Medical School private peering : Weill Medical College private Internet peering (New York and Qatar).\n\nThe following resources are unavaible while this fiber circuit is down:\n\n * CIT off-site tape backup : Remote Tape collection at Weill Medical, 575 Lexington Avenue,NY, NY\n * AzzurroHD video feed : Video feeds from Cornell to production studios via AzzurroHD.\n * ORIE remote office, NY, NY : ORIE remote site at 55 Broad Street, NY, NY The reason for the outage is unknown. The fiber provider has been notified and repairs are underway.\nEstimated time to Repair is currently unknown.\n\nThe follow connections are down, but are reachable via alternate paths:\n\n * Cogent ISP : Cogent ISP (Internet peering at 10GE)\n * NLR Peering : NLR PacketNet and NLR FrameNet.\n * Weill Medical School private peering : Weill Medical College private Internet peering (New York and Qatar).\n\nThe following resources are unavaible while this fiber circuit is down:\n\n * CIT off-site tape backup : Remote Tape collection at Weill Medical, 575 Lexington Avenue,NY, NY\n * AzzurroHD video feed : Video feeds from Cornell to production studios via AzzurroHD.\n * ORIE remote office, NY, NY : ORIE remote site at 55 Broad Street, NY, NY 2012-03-25 04:00:00