Storage system issues in Johannesburg
Monitoring - The client VMs were brought back up, in case you have issues - please submit a ticket and we will deal with the issues case by case.

Our team has found a service that possibly caused lockup issues. Possible service is isolated in the hypervisor with a reduced number of other services. We will monitor that hypervisor for further inspection.
May 30, 02:18 UTC
Identified - One of the servers have faced lock up again.
The administrators are working on a fix and service restoration.
May 30, 01:17 UTC
Monitoring - Our administrators have reported that there is an unidentified process that causes crashes at some hypervisors, causing the lockup of some of the VMs. We are monitoring the situation so that we would be able to isolate the process and will be continuing the monitoring throughout the weekend.

The client VMs were brought back up, in case you have issues - please submit a ticket and we will deal with the issues case by case.
May 29, 15:28 UTC
Identified - We have issues with storage system in Johannesburg, which impacts Kronos cloud servers. The issue is known and the administrators are working on a fix.
In case you notice any issues with your servers - please submit a ticket and we will solve them case by case.
May 29, 14:55 UTC
Redundancy loss in JHB
Update - We are waiting for the replacement equipment to arrive at the DC.
May 25, 10:00 UTC
Identified - One leaf switch experienced internal disk corruption. Currently several servers have N network redundancy, and we are working on restoring N+1 redundancy.
Apr 21, 10:40 UTC
Investigating - Network redundancy in Johannesburg is degraded - the administrators are already solving the issue and we will update you once we have any news.
Apr 21, 10:39 UTC

About This Site

Monitoring of Heficed services and issue notifications. Subscribe to Heficed status page to get the latest updates on the service health.

Uptime over the past 90 days. View historical uptime.
Global Operational
Website ? Operational
Terminal ? Operational
IP Address Market ? Operational
Support Center ? Operational
API ? Operational
Frankfurt, Germany Operational
90 days ago
99.99 % uptime
Today
Kronos Cloud Operational
90 days ago
100.0 % uptime
Today
Virtuozzo Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
99.99 % uptime
Today
London, United Kingdom Operational
90 days ago
100.0 % uptime
Today
Kronos Cloud Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
100.0 % uptime
Today
Milan, Italy Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
100.0 % uptime
Today
Chicago, United States Operational
90 days ago
99.99 % uptime
Today
Kronos Cloud Operational
90 days ago
100.0 % uptime
Today
Virtuozzo Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
99.99 % uptime
Today
Los Angeles, United States Operational
90 days ago
99.99 % uptime
Today
Kronos Cloud Operational
90 days ago
100.0 % uptime
Today
Virtuozzo Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
99.99 % uptime
Today
Reston, United States Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
100.0 % uptime
Today
São Paulo, Brazil Operational
90 days ago
99.42 % uptime
Today
Kronos Cloud Operational
90 days ago
99.18 % uptime
Today
Virtuozzo Operational
90 days ago
99.24 % uptime
Today
Network Operational
90 days ago
99.83 % uptime
Today
Lagos, Nigeria Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
100.0 % uptime
Today
Johannesburg, South Africa Operational
90 days ago
99.93 % uptime
Today
Kronos Cloud Operational
90 days ago
99.9 % uptime
Today
Virtuozzo Operational
90 days ago
100.0 % uptime
Today
Network Operational
90 days ago
99.9 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
had a major outage
had a partial outage

No incidents or maintenance related to this downtime.

Past Incidents
Jun 2, 2020

No incidents reported today.

Jun 1, 2020

No incidents reported.

May 31, 2020

No incidents reported.

May 30, 2020

Unresolved incident: Storage system issues in Johannesburg.

May 29, 2020
Storage issues with hypervisors in Johannesburg
Resolved - Non-operational servers have been restored to the normal state. The server start was delayed due to issues with bringing hypervisors back online.
System administrators have fixed issues that caused delayed boot of the hypervisors in order to avoid such incidents in the future.
May 29, 00:47 UTC
Investigating - Cloud hypervisors have crashed due to kernel lock up.
Currently system administrators are recovering the systems in order for the Cloud servers to be operational again.
Please stand by for further updates.
May 28, 23:38 UTC
May 28, 2020
Cloud hypervisors has faced kernel lock up in Sao Paulo
Resolved - It came to our attention Cloud hypervisors has become nonoperational. After detailed investigation it was found the problem has been caused due to kernel lock up.
To restore Cloud hypervisors system administrators were forced to restart them. As a result Cloud servers were unreachable for 15 minutes.
Currently system administrators are performing required checks in order to avoid such incidents in future.
May 28, 23:00 UTC
May 27, 2020
Network issues in JHB
Resolved - After closely monitoring our network in Johannesburg for more than 20 hours, we did not detect any further problems.
ISP has been reconnected to our infrastructure and shows no faulty behavior.

Network issues have been solved.
May 27, 13:02 UTC
Monitoring - No further connectivity issues have been detected in Johannesburg after disconnecting a problematic ISP.
We will continue to monitor our network until all issues are solved.
May 26, 15:20 UTC
Update - Network connectivity has been restored. Problematic ISP was turned off and we are communicating with them to resolve the issue.
May 26, 09:49 UTC
Identified - The issue has been identified and we are working on a solution.
May 26, 09:41 UTC
Investigating - Network connectivity issues have been detected in Johannesburg.
Our team is currently investigating this situation.
May 26, 09:24 UTC
May 26, 2020
May 25, 2020
May 24, 2020

No incidents reported.

May 23, 2020
Network system upgrade in Milan
Completed - The scheduled maintenance has been completed.
May 23, 08:30 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 23, 08:00 UTC
Scheduled - During this maintenance network devices will be upgraded - configurations will be updated to allow better future service automation. The clients are expected to experience network disruptions of up to 5 minutes.
In case you notice any issues after the maintenance, please contact our support team via Ticket System or support@heficed.com.
May 21, 12:32 UTC
May 22, 2020
Redundancy loss in Reston
Resolved - This incident has been resolved.
May 22, 15:15 UTC
Monitoring - Network team restored network redundancy in Reston location. For some time we will monitor the situation and if no more issues occur we will mark the issue as resolved.
May 19, 20:09 UTC
Investigating - Network redundancy in Reston is degraded - the administrators are already solving the issue and we will update you once we have any news.
May 19, 16:49 UTC
Loss of connectivity in Los Angeles
Resolved - This incident has been resolved.
May 22, 15:15 UTC
Monitoring - The root cause - improperly disconnected link by ISP. We are monitoring the situation and will do that for some time.
May 21, 12:26 UTC
Investigating - Loss of connectivity to one of the ISPs caused a routing transition which took longer than expected, therefore, some of the routes were unavailable for up to one minute.

Network is fully operational while we investigate slow routing transition issues.
May 19, 09:27 UTC
May 21, 2020
Loss of connectivity in Sao Paulo
Resolved - Network devices in Sao Paulo data center has stopped to advertise part of the prefixes. This has resulted in temporary network connectivity loss for the servers that uses these prefixes.

After detailed investigation it was found that responsible service for providing BGP routes was temporarily unavailable. System administrators has taken required measures to bring the required services up and investigate the cause of the unavailability.

Currently all routes are announced to all upstreams and network team on duty is monitoring the activity.
May 21, 18:00 UTC
May 20, 2020

No incidents reported.

May 19, 2020
← Incident History Powered by Statuspage