|
|
|
| Non-WTF Job: C++ Developer at Good Grievance (Ronkonkoma, NY) |
| « Prev | Page 1 | Page 2 | Page 3 | Next » |
|
And I know of a few IT Professionals who would STILL just say "Ah, let's just reboot the affected servers then" when told of this problem.
|
|
I'd like to hear the support calls...
"Hi, I can't login" "Yeah, the server room blew up" "What?" "It blew up. Someone tried to log in during maintenance even though we told everyone not to do it. Say... was that you trying to log in a few minutes ago?" *click* |
|
So the server room burns down, and there's no offsite backup?
This is what counts as a "curious perversion in information technology" nowadays? |
|
"At least we have backups securely stored."
"You mean.. this?" * Holds up a sign: "Backup shelf, do not touch." |
If you can't turn it off and on again, they won't even talk to you. |
|
How come the box of copier paper survived unscathed?
|
|
*Core coment*
Do Not Touch |
Re: A Bit More Dire
2008-06-10 10:30
•
by
Resolute
(unregistered)
|
1. Read article 2. Parrot something said in article 3. ??????? 4. Featured comment! |
|
Also the smartest place to keep your second server if you planned its for cases like this. Why people always think of things like that when its to late.
|
|
Reminds me of a story from a friend,
He was brought in towards the end of the procurement procedure for a disaster recovery contract his company was purchasing; it was pretty big they would install a complete duplicate of their live + staging systems in a DR centre. The very senior managers had done all their stuff, selected the vendor that gave them the most freebies along with the cheapest price and it was up to him to get on with the actual ‘doing’ part of the deal. After preliminary contract acceptance and various statements of intent, he was down at his company’s data centre, on the phone to his counterpart underlings from the DR company, when out of the corner of his eye, out through the window, across the way and noticed a large, squat building in the same business park with the DR companies logo on the front. He politely asked where their data centre was... The real WTF was, management ignored his 'concerns' the contract went ahead as the DR vendor was the cheapest.. shame the DR centre was pretty much next door. |
|
TRWTF: No computer-safe fire suppression appears to have been in place (or at least not mentioned). Halon, anyone?
And yeah, what about those off-site backups? |
Congratulations on making a "fist" comment 25 minutes after the first comment? |
|
Well, on the bright side they get the chance to test out the procedures for worst case scenario.. assuming the procedure manual survived.
|
umm, unless my sarcasm detector has failed, I don't see how Halon would have helped against an explosion which embedded bits of concrete into the servers... |
|
That's nothing,
I worked at a place where the server room was under the bathroom from the floor above... until the neighbours shower sprung a leak... |
No worries, it was kept in PDF format on the server hard drive. And in case something happened to it, you'll find another copy in the /backups/ directory of the same drive... |
|
Reminds me of an incident a few years ago when I was tech support for a "large international merchant bank" in the City of London, when the Bishopsgate bomb went off (see http://en.wikipedia.org/wiki/1993_Bishopsgate_bombing )
Fortunately our building only suffered a few cracked and broken windows - but was just inside the police cordon so all of the several thousand staff were evicted the whole site was off-limits for about a day (a LONG time if you're a market trader). The nasty realization for the disaster recovery team was that the Disaster Recovery (DR) site, one of the bank's older unused offices, was right in the middle of the cordon. Worse still, the main fibre optics linking the two sites ran right down the Bishopsgate. Which now sported a "bomb crater about 4.3 m deep and 4.5 m in diameter" Needless to say our DR site moved elsewhere later that year. |
|
Well, at least nobody can blame the tech support team for that one, though I'm sure some network guru is having an apoplectic stroke over the primary and backup servers in physical proximity by now.
|
|
Perhaps it was the nature and content of the article, but I swear when I read the last part about the secondary server, I thought it read "Secondary Server - Do Not ToRch".
|
|
TRWTF is that shovel in the server room..
|
|
You can solve any computer problem by adding more memory.
|
Keep off-Earth backups, of course. You can't be too careful. |
|
You know, I just went through this with about 7500 hundred other customers at the planet, when there was an electrical explosion that knocked the entire center off line for 2 days. 9000 servers went dark instantly.
|
|
What would Chunk Norris do?
|
|
I was waiting for the molten slag of a shelf with a tag reading "Backup Tapes - Do not Touch".
|
|
Why were there a dozen acetylene tanks in a server room? Do they keep some dynamite in the phone closet?
|
You mean this? (Holding up charred remains of a cover sheet, on which you can still make out fragments of words "...nual - Do No T...") |
Re: A Bit More Dire
2008-06-10 11:13
•
by
Ghost
(unregistered)
|
In case of the Vogons arriving? |
So that's why it's a bomb. Given the description of these canisters, looks like the Atari ST Row of Bombs might be more appropriate...
|
|
This isn't a WTF?. It's an [b]Oh, sh*t[/i].
On the bright side, it means no more struggling with that crappy old server. . . |
Re: A Bit More Dire
2008-06-10 11:18
•
by
f0dder
(unregistered)
|
Jesus... wept. |
acetylene tanks... what, you don't zap old hard drives before disposal?
2008-06-10 11:19
•
by
Hoser, Eh
(unregistered)
|
|
certainly not best practices, then.
|
Re: A Bit More Dire
2008-06-10 11:21
•
by
drex_ej
(unregistered)
|
|
Seriously, I'd be happy about getting a couple racks full of new toys. Then again, we have off site storage.
|
Re: A Bit More Dire
2008-06-10 11:23
•
by
CoderHero
(unregistered)
|
Perhaps not THAT crappy old server, but I can see this scenario: Manager 1: That fire cost us $120,000 in computer equipment and we don't have the budget to replace it Manager 2: Well, I did hear that the Salvation Army is selling used 486's on the cheap! |
Re: A Bit More Dire
2008-06-10 11:31
•
by
Mutant
(unregistered)
|
They may have had offsite backups... but without a server to restore them to, it's still going to be a lot of work... It's also really hard for people to see ahead to what effects a *real* disaster will bring before it happens. Especially those signing the bills. Who's really going to predict a server room blowing up? My company has suddenly bumped DR right to the top of the priority list after 3 incredible near misses (all unrelated) in 2 weeks. Before then enhancing our current (fairly reasonable) strategy wasn't deemed cost effective. Probably fair enough... I mean, how far do you take it? Nuclear War? Asteriod Strike? The Second Coming? |
|
If (User.Name == "Lyle")
{ Server.log = "Will I dream while I am sleep Dave?"; Server.SelfDestruct = true; } |
That would be quite easy to do, all you have to do is transmit your data out into space. Recovery would be more difficult as it would involve an FTL drive. |
Congratulations on making those "near misses" appear to be "unrelated." How did you do it? |
Oh, come now. The Second Coming isn't about DR -- it's a huge business opportunity. Just imagine all those Scientologists and al Qaeda folk lined up to log in to www.dont-be-a-goat.com. The bad news is, most of the money will go to a bunch of raving nutters deep in the Appalachians. |
There weren't They were four concrete rooms away. |
Someone suggested this in another (unrelated) article, but it's apropos... 1. Buy enough deck planking to make a sufficiently large wooden table, and assemble 2. Buy enough arts-n-crafts paper in a variety of colors to cover said wooden table 3. Arrange colored paper on wooden table such that each sheet represents one pixel of the appropriate rgb value of the image you wish to back up 4. Await Google imaging satellite to fly over 5. Reuse paper and deck for subsequent imaging needs 6. Voila: cost effective offsite backup of even the biggest images! |
|
Are there any more pictures? I can barely make out anything other than the studs in that one.
|
|
Haha, similar incident happened 2 times within a 2 year timespan in the beginning of this decade, in Kista, a suburb to Stockholm, Sweden. The "silicon valley" of Sweden.
Major power outage. Both citizens and big companies like Ericsson, Tele2, IBM where hit. It took them several days (yes days!) to fix it... Power to the whole area was supplied from a huge tunnel with both primary and secondary mains close together. |
Chuck Norris would use a dozen acetylene tanks to create an explosion which would rip through four concrete walls and reduce an entire data center to slag and ash. HTH |
Re: A Bit More Dire
2008-06-10 12:00
•
by
Man 987876980
(unregistered)
|
No, not Chuck Norris, he said ChuNk Norris... who I presume is Chuck's obese brother. |
|
Q: How much more dire?
A: None. None more dire. |
|
Reminds me of my coworker's wife. He gave her a spare car key in case she locked herself out. She put it in the trunk.
|
|
And of course, Chuck Norris wouldn't need tanks of explosive. He'd just do a roundhouse kick to get the same effect.
|
| « Prev | Page 1 | Page 2 | Page 3 | Next » |