Results 1 to 5 of 5

Thread: Outage Earlier

  1. #1

    Red face Outage Earlier

    Some of you might have noticed the site slowed to an absolute crawl earlier today. I have just received an apology from our hosts.

    Dear Alex,

    Earlier today we suffered a network failure which affecting a number of customer servers, including your server.

    The problem began at 10:32 and normal service was restored at 12:02
    (1.5 hours).

    This is obviously a very serious outage, and we are sincerely sorry for any inconvenience it has caused you.

    We have traced the fault to quality of service management systems in our core network. An error in a routine rules configuration update caused a pattern of activity which overloaded some of our core routers. Unfortunately the fault took some time to isolate due to the unusual nature of the failure.

    The actual cause was that a code update which was not yet certified for production use had been accidently put live. This has highlighted a failure of our infrastructure management software change rollout procedures, for which I take personal responsibility.

    We have, this afternoon, adjusted our rollout procedures to ensure that no non-production code can ever again be accidentally deployed into our live environment.

    I do not anticipate a recurrence of this issue.

    Please accept our profuse apologies.

    Kate.

    --
    Kate Craig-Wood
    Managing Director
    Memset Ltd.
    http://www.memset.com/
    Don't be too hard on her.

    http://www.memset.com/press/images.php


    Alex

  2. #2
    That was an honest and sensere apology.
    As my old boss said "The person who don`t make mistakes ain`t born yet"
    basil.
    https://www.justgiving.com/John-Slee/
    "He who kills sow with piglets empties the forest of boar" My neighbours dad on new years eve 2011.

  3. #3
    Quote Originally Posted by csl View Post
    Some of you might have noticed the site slowed to an absolute crawl earlier today. I have just received an apology from our hosts.

    Don't be too hard on her. Alex
    Well as she looks like this Alex how could we!

    Chris

    Life should be a journey to the grave with the intention of arriving skidding in sideways, Merlot in one hand, Cigar in the other, body thoroughly used up, totally worn out and screaming WOO HOO what a ride!

  4. #4
    Alex,

    Why haven't you introduced me??

    Patrick

  5. #5
    Hi Patrick,

    Sorry about that. I was unaware because I selected the company based purely on performance, not looks... and I defy anyone to prove otherwise!

    all the best,

    Alex

Similar Threads

  1. Minor Outage
    By csl in forum Deer Stalking General
    Replies: 6
    Last Post: 04-12-2009, 16:22

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •