Network Issues
DDoS Attack (Resolved)
Affecting System - All Services | Priority - Critical | Date - 20/01/2019 16:47 - 21/01/2019 09:05 | Last Updated - 20/01/2019 17:29
Description: DDoS Attack
Time Frame: 20/01/2019 16:47 - 20/01/2019 17:10 NZDT
Impact: We are currently experiencing a large DDoS attack affecting multiple services on our network. We are in the process of blocking the attack at our upstream providers. All services should return shortly.
Other: We appreciate your patience, and we apologise for the inconvenience caused.
Update: We have managed to block the DDoS attack with our upstream providers and all service have been restored.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Shared Hosting Cluster Maintenance (Resolved)
Affecting System - Web Hosting Cluster | Priority - High | Date - 14/01/2019 21:00 - 21/01/2019 18:43 | Last Updated - 18/01/2019 13:59
Description: We will be migrating all shared hosting clients to new servers as the old servers are in need of operating system updates.
Time Frame: 14/01/2019 21:00 - ongoing
Impact: All web sites hosted on our shared web hosting servers will experience some minimal downtime during the scheduled timeframe. Downtime will be kept to a minimum whilst we migrate the sites across to the new server, however, we request that all clients check their sites after the migration to confirm full functionality. The purpose of this exercise is to update the server operating system which in turn will increase performance and security of the server.
Check: Clients are requested to check functionality of their sites after the upgrade to confirm all is working as expected. We don't envisage any problems however.
Update: We have successfully migrated our WH1 web server to the new operation system. The migration attempt on WH2 failed therefore we will be attempting again on Wednesday 16th during the same timeframe.
Update3: We are getting reports of intermittent freezing issues with transferring data on the new cluster. We are actively working on resolving these problems and ask that you bare with us at this time. We will post all updates here as we work through the teething issues and sort them out.
Update2: We have migrated WH2 web server to the new operation system. Some of our clients are experiencing issues with sending / receiving emails on the server. Our Engineers are actively working on it to rectify the issue
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
DDoS Attack (Resolved)
Affecting Other - All Network Services | Priority - Critical | Date - 22/11/2018 00:10 - 22/11/2018 15:28 | Last Updated - 22/11/2018 17:00
Description: DDoS Attack
Time Frame: 22/11/2018 00:10 - 22/11/2018 15:28
Impact: We are currently experiencing a large DDoS attack affecting multiple services on our network. We are in the process of blocking the attack at our upstream providers. All services should return shortly.
Other: We appreciate your patience, and we apologise for the inconvenience caused.
Update: We have found the source of the DDoS attack and have managed to block them. All services have been restored.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Emergency Maintenance at Grafton DC (Resolved)
Affecting System - Cloudhost Nodes Grafton | Priority - Critical | Date - 06/10/2018 00:00 - 08/10/2018 14:20 | Last Updated - 06/10/2018 02:20
Description: We have encountered a problem on our cloud server nodes in our Grafton data centre. We will need to reboot the nodes in order to fix the issue.
Time Frame: 06/10/2018 12:00 AM - 06/10/2018 01:00 AMImpact: Only clients with cloud servers on these nodes will experience downtime while the nodes reboot.
Other: We apologise for the inconvenience caused.
Update: The impacted nodes nodes in our Grafton data centre were successfully rebooted with in the maintenance windows and all services have been fully restored.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Issue with sites on wh2.vpscity.co.nz (Resolved)
Affecting Server - wh2.vpscity.co.nz | Priority - Critical | Date - 17/09/2018 10:30 - 17/09/2018 22:43 | Last Updated - 17/09/2018 11:58
Description: We are experiencing an issue on our wh2 shared hosting server.
Time Frame: 17/09/2018 12:35 - Ongoing
Impact: All customers with shared hosting packages on wh2.vpscity.co.nz are experiencing a problem connecting to the websites.
Other: We apologise for inconvenience caused.
Update: Our engineers are actively working on it.
Update 2: We have had a hardware failure on wh2 server and have recovered all sites to a new server. Please let us know if you are missing any data or have any issues and our engineers will sort it out for you.
Update 3: All sites are up now and the server is operating normally. We will continue to monitor for the next 24hours.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Voice Services (Resolved)
Affecting Other - Issues with Inbound calls from 2Degrees Network | Priority - Critical | Date - 14/09/2018 08:00 - 14/09/2018 10:10 | Last Updated - 17/09/2018 10:26
Description: One of our upstream carrier provider are currently experiencing problems with Inbound calls from 2Degrees network.
Time Frame: 14/09/2018 08:00 - 14/09/2018 10:10
Impact: Some of our customers may experience intermittent problems with inbound calls from 2Degrees Network. Outbound calls are not affected.
Other: We apologise for inconvenience caused.
Update: The problem is resolved with our upstream. We will continue to monitor throughout the day.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Network Issue with Upstream Provider (Resolved)
Affecting Server - cp.vpscity.co.nz | Priority - Critical | Date - 29/08/2018 10:05 - 03/09/2018 12:33 | Last Updated - 29/08/2018 10:43
Description: One of our upstream providers are currently experiencing a network issue.
Time Frame: 29/08/2018 10:05 - CurrentImpact: One of our upstream providers have had a network failure and we are currently routing traffic via other links. Our engineers are actively working on this to regain full connectivity to affected clients. Please check back here for updates.
Other: We apologise for the inconvenience caused.Update: We are not affected by the network outage as our traffic is routing via other routes. We did however have a few minutes intermittent connectivity as routes rerouted.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Emergency Maintenance Core/Edge Routers (Resolved)
Affecting System - Core/Edge Routers | Priority - Critical | Date - 04/08/2018 00:00 - 04/08/2018 00:20 | Last Updated - 09/08/2018 08:25
Description: We are required to perform a security update on our core and edge routes to address a vulnerability that has recently been discovered.
Time Frame: 04/08/2018 00:00 - 04/08/2018 00:20 NZST
Impact: There may intermittent connectivity while our secondary routers take over primary operation. We do not expect any downtime.
Other: We appreciate your patience, and we apologise for the inconvenience caused.
Update: All updates were applied successfully.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Voice Services (Resolved)
Affecting Other - Issues with Inbound calls | Priority - Critical | Date - 11/06/2018 11:46 | Last Updated - 13/06/2018 08:59
Description: One of our upstream carrier provider are currently experiencing outage with voice services. Which is causing issues with inbound calls.
Time Frame: 11/06/2018 11:46 - Ongoing
Impact: Some of our customers are experiencing problems with inbound calls due to one of our upstream carrier provider having voice services outage. We are working with our upstream carrier to resolve the issue.
Other: We apologise for inconvenience caused.
Update 1: The problem with outbound calls is fixed now but there is still a problem with all incoming calls. We will keep you posted.
Update 2: The issue is resolved and all inbound and outbound calls are working fine. We are still monitoring.
Update 3: All the calls remained stable for the past hour. We will continue to monitor it.
Update 4: The issue has reoccurred with our upstream carrier and all inbound calls are failing now. Outbound calls will continue to work.
Update 5: All outbound and inbound calls are back to normal and working now. We will continue to monitor.
Update 6: The problem is resolved with our upstream. We will continue to monitor throughout the day.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)
Meltdown & Spectre Patch (Resolved)
Affecting Server - cp.vpscity.co.nz | Priority - Critical | Date - 15/01/2018 22:00 | Last Updated - 23/01/2018 10:46
Description: We will be rebooting all virtual servers on our network as part of the patch process for spectre and meltdown vulnerabilities discovered recently. Maintenance will be starting tonight at around 10PM NZDT and continuing each night from 10PM NZDT until all servers and hypervisors have been patched.
What is Meltdown and Spectre?
Meltdown is a security flaw that could allow hackers to bypass the hardware barrier between applications run by users and the computer’s core memory, which is normally highly protected.
Spectre is slightly different. It potentially allows hackers to trick otherwise error-free applications into giving up secret information.Is it Serious?
Yes, the problem with Meltdown is that anything that runs as an application could in theory steal your data, including simple things such as javascript from a web page viewed in a browser.
Spectre, on the other hand, is harder for hackers to take advantage of but is also more difficult to fix and is expected to be a bigger problem in the long term.What can I do about it?
Users can do little to avoid the security flaws apart from update their computers with the latest security fixes as soon as possible. Fixes for Linux, Windows and MacOS are already available.Do you have a VpsCity Support Plan?
If you have a managemet plan with us, you do not need to worry about anything as VpsCity will automatically run the latest security updates on your server. If you do not have a support plan, you will need to run these updates manually.
Time Frame: 15/01/2018 22:00 - 16/01/2018 00:00
Other: This is an URGENT update so no exceptions will be allowed. Please follow our network status page for further updates and scheduled nodes that will be updated each night.
Update: Phase1 has completed, we will continue to phase2 on 16/01/2018 22H00 NZDT
Update: Phase2 has completed, we will continue to phase3 on 17/01/2018 22H00 NZDT
Update: Phase3 has completed, we will continue to phase4 on 18/01/2018 22H00 NZDT
Update: After updating the kernel to patch the vulnerabilities, it has been causing some servers to freeze unexpectedly. We are busy investigating the reason for this. We are sorry for any inconvienence caused and appreciate your cooperation.
Contact: If you have any issues or concerns about this, or have any queries about the network downtime, please contact us as per our Contact Us page (https://vpscity.co.nz/contact-us)