All Systems Operational
Uptime over the past 90 days. View historical uptime.
Simple Docker ? Operational
Windows Docker Host ? Operational
Linux Docker Host ? Operational
Central Proxy ? Operational
Kubernetes ? Operational
Central Kubernetes ? Operational
Legacy Kubernetes Operational
Devspaces Kubernetes Operational
Containeryard Kubernetes Operational
Central Registry ? Operational
Central Storage ? Operational
Databases ? Operational
SqlServerDB ? Operational
OracleDB ? Operational
AuroraDB ? Operational
PostgresDB ? Operational
DynamoDB ? Operational
Central VmWare Operational
Network ? Operational
Hypervisor ? Operational
Management Operational
AWS Interconnection ? Operational
CICD Operational
90 days ago
100.0 % uptime
Today
Jenkins ? Operational
Jervis ? Operational
Jive Operational
90 days ago
100.0 % uptime
Today
Electric Flow ? Operational
TeamCity ? Operational
SonarQube ? Operational
Nexus ? Operational
AWS eu-west-1 Operational
AWS EC2 eu-west-1 Operational
AWS RDS eu-west-1 Operational
AWS S3 eu-west-1 Operational
AWS us-east-1 Operational
AWS EC2 us-east-1 Operational
AWS RDS us-east-1 Operational
AWS S3 us-east-1 Operational
Central Generic ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage

No incidents or maintenance related to this downtime.

Scheduled Maintenance
Windows Docker Host Maintenance Window - CENTRAL-100393 Jul 23, 02:00-04:00 UTC
On date July 23, 2019 02:00 GMT, Windows Docker Host will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: July 23, 2019 02:00 GMT
Scheduled End Date: July 23, 2019 04:00 GMT

What is being addressed: The maintenance window planned for Monday, July 22, 2019, is going to cover these changes:

- Reboot the DWEU1 (10.69.11.122) host
*Planned downtime*: 2h
Posted on Jul 17, 11:26 UTC
Linux Docker Host Maintenance Window - CENTRAL-100453 Jul 27, 02:00-04:00 UTC
On date July 27, 2019 02:00 GMT, Linux Docker Host will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: July 27, 2019 02:00 GMT
Scheduled End Date: July 27, 2019 04:00 GMT

What is being addressed: Is required to move all the devfactory containers that are running on dlb1.aureacentral.com to dl1.aureacentral.com.

For this are required the next steps:
* Move the data from dlb1 to dl1
* Stop the containers on dlb1
* Do a final data sync between dlb1 and dl1
* Deploy the containers on dl1
* Change DNS names to point to new ips on dl1
* Start containers docker containers
Posted on Jul 23, 00:24 UTC
Past Incidents
Jul 23, 2019

No incidents reported today.

Jul 22, 2019
Linux Docker Host is unavailable - One of the hosts is not responding - CENTRAL-96678
Resolved - A false alert was triggered for a past issue
Jul 22, 15:03 UTC
Identified - Starting April 03, 2019 09:52 GMT we are experiencing an incident: Linux Docker Host is unavailable. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:20 UTC
AWS EC2 us-east-1 Linux Docker Host is experiencing intermittent failures - Network connectivity issue in Central because of underlying AWS networking hardware issues - CENTRAL-98192
Resolved - A false alert was triggered for a past issue
Jul 22, 15:03 UTC
Identified - Starting May 13, 2019 11:26 GMT we are experiencing an incident: Linux Docker Host is experiencing intermittent failures. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:21 UTC
Linux Docker Host is experiencing intermittent failures - Docker host is not responding - CENTRAL-99306
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting June 18, 2019 17:07 GMT we are experiencing an incident: Linux Docker Host is experiencing intermittent failures. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 30 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:21 UTC
Windows Docker Host is unavailable - Containers are not responding on DW2, need reboot - CENTRAL-97995
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting May 07, 2019 16:35 GMT we are experiencing an incident: Windows Docker Host is unavailable. This is affecting all customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:22 UTC
Linux Docker Host is unavailable - could not stop containers on DL2 - CENTRAL-94813
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting February 11, 2019 13:06 GMT we are experiencing an incident: Linux Docker Host is unavailable. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 11 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:22 UTC
AWS Interconnection AWS Interconnection,Network performance degraded - VMWC-10670
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting June 17, 2019 23:20 GMT we are experiencing an incident: AWS Interconnection,Network performance degraded. This is affecting restricted set of customers.
We are working on identifying the root cause and fixing it.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:22 UTC
Jenkins Nexus is unavailable - Nexus got in error loop due to GC overhead limit exceeded - CICDOPS-3612
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting February 23, 2019 16:04 GMT we are experiencing an incident: Nexus is unavailable. This is affecting all customers.
We are working on the resolution and expect to have it resolved within the next 25 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:23 UTC
Jenkins performance degraded - Jenkins is too slow - CICDOPS-3683
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting March 06, 2019 17:54 GMT we are experiencing an incident: Jenkins performance degraded. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:23 UTC
AuroraDB is unavailable - DB has rebooted - CENTRAL-98030
Resolved - A false alert was triggered for a past issue
Jul 22, 15:02 UTC
Identified - Starting May 08, 2019 22:57 GMT we are experiencing an incident: AuroraDB is unavailable. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 5 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:26 UTC
Linux Docker Host performance degraded - CENTRAL-97997
Resolved - A false alert was triggered for a past issue
Jul 22, 15:01 UTC
Identified - Starting May 07, 2019 20:32 GMT we are experiencing an incident: Linux Docker Host performance degraded. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 15 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:27 UTC
Jenkins is unavailable - Nexus is not allowing clients to download artifacts. UI not responsive - CICDOPS-3703
Resolved - A false alert was triggered for a past issue
Jul 22, 15:01 UTC
Identified - Starting March 09, 2019 05:22 GMT we are experiencing an incident: Jenkins is unavailable. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 30 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:29 UTC
AuroraDB is unavailable - Problems with DB server - CENTRAL-97477
Resolved - A false alert was triggered for a past issue
Jul 22, 15:01 UTC
Identified - Starting April 26, 2019 08:03 GMT we are experiencing an incident: AuroraDB is unavailable. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:29 UTC
AuroraDB is experiencing intermittent failures - CENTRAL-97178
Resolved - A false alert was triggered for a past issue
Jul 22, 15:00 UTC
Identified - Starting April 18, 2019 09:01 GMT we are experiencing an incident: AuroraDB is experiencing intermittent failures. This is affecting all customers.
We are working on the resolution and expect to have it resolved within the next 30 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:29 UTC
Network is experiencing intermittent failures - VMWC-10515
Resolved - A false alert was triggered for a past issue
Jul 22, 15:00 UTC
Update - We are continuing to work on a fix for this issue.
Jul 22, 14:51 UTC
Identified - Starting May 24, 2019 19:55 GMT we are experiencing an incident: Network is experiencing intermittent failures. This is affecting restricted set of customers.
We are working on identifying the root cause and fixing it.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:30 UTC
AWS EC2 us-east-1 AWS Account performance degraded - CENTRAL-97357
Resolved - A false alert was triggered for a past issue
Jul 22, 15:00 UTC
Identified - Starting April 21, 2019 21:38 GMT we are experiencing an incident: AWS Account performance degraded. This is affecting restricted set of customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:30 UTC
Jenkins performance degraded - Nexus outage due to components not being able to be read - CICDOPS-3678
Resolved - A false alert was triggered for a past issue
Jul 22, 14:59 UTC
Identified - Starting March 05, 2019 20:50 GMT we are experiencing an incident: Jenkins performance degraded. This is affecting all customers.
We are working on the resolution and expect to have it resolved within the next 60 minutes.

We will provide an update every 30m or as soon as incident is resolved.
Jul 22, 14:31 UTC
Jul 21, 2019

No incidents reported.

Jul 20, 2019

No incidents reported.

Jul 19, 2019

No incidents reported.

Jul 18, 2019

No incidents reported.

Jul 17, 2019

No incidents reported.

Jul 16, 2019

No incidents reported.

Jul 15, 2019

No incidents reported.

Jul 14, 2019
Jenkins Maintenance Window - CICDOPS-4254
Completed - The scheduled maintenance has been completed.
Jul 14, 17:50 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 14, 17:30 UTC
Scheduled - On date July 14, 2019 17:30 GMT, Jenkins will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: July 14, 2019 17:30 GMT
Scheduled End Date: July 14, 2019 17:50 GMT

What is being addressed: we are going to upgrade jenkins plugins
Jul 14, 17:03 UTC
Jul 13, 2019
Linux Docker Host Maintenance Window - CENTRAL-100173
Completed - The scheduled maintenance has been completed.
Jul 13, 04:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 13, 02:00 UTC
Scheduled - On date July 13, 2019 02:00 GMT, Linux Docker Host will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: July 13, 2019 02:00 GMT
Scheduled End Date: July 13, 2019 04:00 GMT

What is being addressed: Is required to increase the disk size from 3TB to 6TB because the disk current utilization is 92% and more space is going to be needed according to the planned growth of Jira.

The EBS volume to increase size is: vol-0a7c84c97c414941f
EC2 instance id: i-098e365f34bbb4c69
Docker host: dl8.aureacentral.com
New Size: 6 TB (6144 GB)
Device: /dev/xvdg
Mountpoint: /srv/docker_volumes/gp2

The plan is increasing the size and then resize online the disk because is an LVM volume to not stop or restart the docker host.
Jul 11, 14:08 UTC
Jul 12, 2019

No incidents reported.

Jul 11, 2019

No incidents reported.

Jul 10, 2019
Linux Docker Host Maintenance Window - CENTRAL-100195
Completed - The scheduled maintenance has been completed.
Jul 10, 04:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 10, 02:01 UTC
Scheduled - On date July 10, 2019 02:00 GMT, Linux Docker Host will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: July 10, 2019 02:00 GMT
Scheduled End Date: July 10, 2019 04:00 GMT

What is being addressed: Emergency Maintenance Window on docker-linux-4 (dl4.aureacentral.com).

Docker daemon is stuck and host reboot is needed to fix.

Currently docker stop and exec are not working for any container running on dl4.
Jul 9, 19:12 UTC
Jul 9, 2019
Windows Docker Host Maintenance Window - CENTRAL-100169
Completed - The scheduled maintenance has been completed.
Jul 9, 05:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 9, 03:02 UTC
Scheduled - On date July 09, 2019 03:00 GMT, Windows Docker Host will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: July 09, 2019 03:00 GMT
Scheduled End Date: July 09, 2019 05:00 GMT

What is being addressed: The maintenance window planned for Monday, July 8, 2019, is going to cover these changes:

- Reboot the DWEU1 (10.89.1.158) host
*Planned downtime*: 1h
Jul 8, 17:25 UTC
Linux Docker Host Maintenance Window - CENTRAL-99320
Completed - The scheduled maintenance has been completed.
Jul 9, 04:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 9, 02:00 UTC
Update - On date 2019-07-09T02:00:00.000+0000, the product will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: 2019-07-09T02:00:00.000+0000
Scheduled End Date: 2019-07-09T04:00:00.000+0000

What is being addressed:
The maintenance window planned for Monday, June 24, 2019, is going to cover these changes:

- Deploy Docker Enforcer on DL1-DL6 hosts as Authz plugin in Warn mode
*Planned downtime*: 0 minutes
Jul 1, 20:06 UTC
Update - On date 2019-07-02T02:00:00.000+0000, the product will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: 2019-07-02T02:00:00.000+0000
Scheduled End Date: 2019-07-02T04:00:00.000+0000

What is being addressed:
The maintenance window planned for Monday, June 24, 2019, is going to cover these changes:

- Deploy Docker Enforcer on DL1-DL6 hosts as Authz plugin in Warn mode
*Planned downtime*: 0 minutes
Jun 24, 16:25 UTC
Scheduled - On date June 25, 2019 02:00 GMT, Linux Docker Host will undergo scheduled maintenance. The maintenance window is as follows:
Scheduled Start Date: June 25, 2019 02:00 GMT
Scheduled End Date: June 25, 2019 04:00 GMT

What is being addressed: The maintenance window planned for Monday, June 24, 2019, is going to cover these changes:

- Deploy Docker Enforcer on DL1-DL6 hosts as Authz plugin in Warn mode
*Planned downtime*: 0 minutes
Jun 18, 19:18 UTC
← Incident History Powered by Statuspage