Skip to main content

Unplanned Outage: NYSERNet R&E Network Issue

Last Updated:
2010-09-07 04:00:00
Event:
2010-09-07 04:00:00
Status:
Closed
Brief Description:
User Impact:
N/A
Workaround:
There is no workaround for this issue
Current Status:
N/A
Services Affected:
Full Description:
The NYSERNet NOC is currently trouble shooting a problem with its R&E network. The problem seems to be centered in the NYC region. Those having NYSERNet R&E connections in the upstate area should still be able to pass R&E traffic out through our connection to Internet2 through our Buffalo to Chicago connection.
CIT TDX ID:



Timeline of Changes

Description Current Status Date Time
You can expect further updates as more information becomes available. You can expect further updates as more information becomes available. 2010-09-07 04:00:00
An outage is effecting both NYSERNet and NLR circuits to NYC. Though Cornell has independent circuits to NYC, the fiber shares a common path. NYSERNet and NLR have confirmed a possible fiber break.\n\nThis has interrupted the following services\n? Cogent ISP - commodity services are routed via FLTG ISP\n? NLR .edu peering (routed to NYSERNet Syracuse/Rochester)\n? Weill Medical direct peering (re-routed)\n? azzurro streaming video (no back-up connection)\n? ORIE office in NYC (no back-up connection)\n? Weill remote tape backup (no back-up connection)\n An outage is effecting both NYSERNet and NLR circuits to NYC. Though Cornell has independent circuits to NYC, the fiber shares a common path. NYSERNet and NLR have confirmed a possible fiber break.\n\nThis has interrupted the following services\n? Cogent ISP - commodity services are routed via FLTG ISP\n? NLR .edu peering (routed to NYSERNet Syracuse/Rochester)\n? Weill Medical direct peering (re-routed)\n? azzurro streaming video (no back-up connection)\n? ORIE office in NYC (no back-up connection)\n? Weill remote tape backup (no back-up connection)\n 2010-09-07 04:00:00
The NYSERNet circuits to NYC have been [provisionally] restored. All services to NYC and Wide-Area Networking are restored (see below). \nNYSERNet has isolated the network trouble to a Level 3 fiber issue \nbetween Albany and NYC. This is not a fiber cut. However, the fiber \nwas impacted to the extent that it caused circuit outages along the \nNYSERNet backbone. Resetting the affected pre-amp card in our Albany \nPoP cleared all alarms and has returned the circuits into \nservice. Level 3 is still on site where the problem is presumed to \nhave occurred. For this reason, it is possible for additional fiber \nissues to impact services while Level 3 technicians continue to work \nthe issue.. NYSERNet is closely monitoring the issue as the problem \nis still being investigated.\nThere is an on-going outage with our circuit provided by NLR (TICKET NO.: 6157:55). NLR continues to investigate. Services on the NLR circuit have been routed to the operational, NYSERNet circuit.\n\nShould these circuits experience further instability, routing will move our WAN traffic to the FLTG ISP (Ithaca) and Internet2 (NYSERNet, Syracuse-Rochester). However, the "no back-up connection" services may be impacted. \n The NYSERNet circuits to NYC have been [provisionally] restored. All services to NYC and Wide-Area Networking are restored (see below). \nNYSERNet has isolated the network trouble to a Level 3 fiber issue \nbetween Albany and NYC. This is not a fiber cut. However, the fiber \nwas impacted to the extent that it caused circuit outages along the \nNYSERNet backbone. Resetting the affected pre-amp card in our Albany \nPoP cleared all alarms and has returned the circuits into \nservice. Level 3 is still on site where the problem is presumed to \nhave occurred. For this reason, it is possible for additional fiber \nissues to impact services while Level 3 technicians continue to work \nthe issue.. NYSERNet is closely monitoring the issue as the problem \nis still being investigated.\nThere is an on-going outage with our circuit provided by NLR (TICKET NO.: 6157:55). NLR continues to investigate. Services on the NLR circuit have been routed to the operational, NYSERNet circuit.\n\nShould these circuits experience further instability, routing will move our WAN traffic to the FLTG ISP (Ithaca) and Internet2 (NYSERNet, Syracuse-Rochester). However, the "no back-up connection" services may be impacted. \n 2010-09-07 04:00:00