Announcement

Collapse
No announcement yet.

VPS Node Restoration

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • VPS Node Restoration

    Respected Customers,

    One of our Linux VPS Nodes in the subnet 87.117.246.* went through a FSCK. This was unavoidable as the sudden loss of power due to the outage corrupted the file structure of the hardware node. The node was found to have several bad sectors and quite a few BIG ones at those. We actually cannot guarantee that data would be 100% safe on the node. The FSCK has just stopped. We are in the process of restoring the data. However, we do suspect loss of data and backup copies. Further updates would be posted in this thread.
    Sincerely,
    Nicolaus Grant
    QA & Customer Service
    http://webhosting.uk.com

  • #2
    Respected Customers,

    We have now successfully restored data from the available backup. A few more VE's are remaining. Once all the VM's have their data restored, they will all be turned on one at a time. I estimate another 4 to 5 hours for this.

    Your patience is truly appreciated.
    Sincerely,
    Nicolaus Grant
    QA & Customer Service
    http://webhosting.uk.com

    Comment


    • #3
      Loss Of Data - Two Months Compensation Given

      Dear Customers,

      This hardware node went into FSCK and kernel panic as s result of the sudden power loss owing to the outage. The only way to repair this is to run a fsck (filesystem check) to rectify the filesytem errors and problems. This process takes anything between a few hours to a few days to complete depending upon the percentage of bad sectors and the amount of data stored within those sectors which have gone bad. In this particular case, there were quite a few of them which is why the FSCK took all this long.

      While fixing the bad sectors on the hard drives, big parts of precious data has been lost completely. Unfortunately, there was nothing which we could have done to prevent the data loss as this happened during the FSCK itself and without it being allowed to complete, the node would not have come online. The fact that backups were being performed at the very instance when the problems started surfacing did not help at all. The FSCk also wiped out the most recent copies of backups we had including those dated to 28th July as also some of the earlier versions.

      The hardware node is now online and all the vps' on it are also back to normal functionality. However, the data on each of those VPS' date back to 30/05/2008 - one month old. Unfortunately, this is the only working copy which we had with us available for use. We can very well imagine the trouble, inconvenience and anguish this would cause to you - our customer. Owning upto our moral responsibility, every customer having their VPS on this hardware node has been given two months hosting free of cost. This is just a token of appreciation which Webhosting.uk.com owes you.

      A full scale investigation is still on as to why the UPS of the particular section failed. Our vendor had given assurances that there is no possibility of a UPS failure in that particular section of the datacenter as it was only replaced sometime back. We have now moved almost all our VPS & Semi-dedicated servers nodes along with the shared servers to a new facility which has a "2N+1 UPS system" cover to guard against such possible mishaps. The remaining nodes will soon be moved too. A "2n+1" setup means that there are two backup setups available instead of just one and so if a UPS or a power unit does go down, the backup will take over and in case the first backup UPS also fails, a second backup exists in place. Not only this, we have also performed a thorough check on all our other equipments and hardware to ensure their usability.

      It was promised on the previous occasion as well, however this incident only dented the confidence of our customers a little. So the Webhosting.uk.com management takes this opportunity to reassure its entire clientele that no stone would be unturned in our efforts to ensure that your websites are online at all times. We will definitely undertake all possible measures to ensure that such unforeseen problems are avoided altogether. We also wish to take our current association with each of customers for our mutual benefits. In my individual capacitu, I would like to express our sincere gratitude to all customers who have stood by us during this incident. Its a privelege to have customers who understand the web hosting business and its nature. Webhosting.uk.com is extremely grateful for the immense patience, invaluable understanding and patience displayed by each one of you.
      Sincerely,
      Nicolaus Grant
      QA & Customer Service
      http://webhosting.uk.com

      Comment

      Working...
      X