OVHcloud Network Status

Current status
Legend
  • Operational
  • Degraded performance
  • Partial Outage
  • Major Outage
  • Under maintenance
FS#8246 — RBX <> AMS
Incident Report for Network & Infrastructure
Resolved
We had a downtime of 1 second on the Roubaix and Amsterdam link.

We are investigating.

Update(s):

Date: 2013-03-22 23:49:27 UTC
We will begin switching 10G links Roubaix<>Amsterdam by the shortest optical path via Brussels.

Date: 2013-03-21 17:39:26 UTC
After few working days, we have fixed the different issues on this link and we are now able to switch circuits on it. We switch the 10G circuits one by one.

Date: 2013-03-15 06:28:31 UTC
The card is replaced but we have detected an abnormally high mitigation issue between Anvers and Rotterdam.

Meanwhile, the link London<>Amsterdam was able to recover by ingestions with Infinera and circuits are UP. We'll also move to fix new raman amplifiers and therefore circuits which wil be cut then reactivated.

If the link is confirmed as stable, we are going to work via London and the time to organise a troubleshoot between Anvers and Rotterdam tomorrow or Monday.



Date: 2013-03-15 06:16:24 UTC
One of the ORM cards (RAMAN) in Rotterdam has a damaged internal connector (burned, which could get to this type of card if it's not absolutely clean as we are on high levels power).
However, we are now having a spare. We are replacing it.


Date: 2013-03-15 06:12:20 UTC
The span Rotterdam <> Amsterdam is finally mounted and we are working on mounting the link bit by bit until Roubaix. The way Amsterdam > Roubaix is OK for now. We are working on the way back (connector issues which need to be cleaned) in order to enable the connection.


Date: 2013-03-15 02:21:32 UTC
We have replaced the RAMAN card which has been suspected in London, but this did not permit the link to be mounted. The issue was escalated to a higher level with infinera, directly with the ingestion of laboratory.

On the \"front\" Roubaix<>Amsterdam, we are now having control in Rotterdam but we are still facing difficulties on the last span to Amsterdam. Our teams on the field are still working hard to remount the link as soon as possible.

Date: 2013-03-14 23:40:19 UTC
A spare card will be delivered shortly to London and will allow us to remount the 10G circuits.

On the part Roubaix<>Amsterdam we are unable to take control on Rotterdam's site at the moment, which is holding us to remount the link for now.


Date: 2013-03-14 21:22:15 UTC
We have a hardware failure on a card in London or Wickford.
The investiguations are in progress.
We will keep making effort to mount the direct link Roubaix <> Brussels <> Amsterdam in order to resume traffic to Amsterdam as soon as possible.

Date: 2013-03-14 21:20:11 UTC
We suspect a hardware problem on some equipment on the link Wickford <> London.

Date: 2013-03-14 21:19:10 UTC
We have a cut-off on this links again.

We will investigate.
Posted Mar 14, 2013 - 12:52 UTC