Vexxhost's public cloud experienced internal network issues which affected storage and internal networks for all systems. An internal spine was failing in a way that sometimes packets were passed and sometimes packets were dropped, which put the internal network in a failed state. Vexxhost replaced each part of the network spine until the problem switch was identified and the network was restored. This required some additional poweron/reboot actions from LF to bring compute instances back online.

This incident has been resolved.

We are continuing to monitor for any further issues.

A fix has been implemented and we are monitoring the results.

Critical internal network infrastructure has failed and a replacement is being done right now

Upstream provider reported that they're having issues with their local router and they're trying to reload it. ETA will either be under 30 minutes if things go smoothly or it might extend into several hours