Well, that was unpleasant

[WeldonHunter]

We never blamed you. I thought the NSA shut us down. oops did I go there.

I thought the same thing, lol!!! I've had problems with Google and Hotmail too today as well as the place I needed to order stuff for my antenna and I was starting to wonder if they broke the internet with all the spying.

I even called Brad to see if he knew what was up. Glad you got it all sorted out Darryl and thanks, I know it's frustrating as hell.

[Greasemonkey]

I got $20 from each of your wife's for shutting the forums down for 24 hours!

Now I can afford that new rifle!

Darryl

Well don't please, please don't take her payment next weekend I got all the railings done today. I only have stairs to do and I hate building stairs.

[rlchemist]

Thanks....my first thought was the NSA was responsible, guess I need a refill of my anti-paranoia meds.

[Rongo]

Good to be back. Thanks Boss for getting us up & running again.

[wolfstein]

I got $20 from each of your wife's for shutting the forums down for 24 hours!

Now I can afford that new rifle!

Darryl

What? Not a new car and a new rifle?

Thanks for the hard work. I can exhale now. You really rock.

[martin08]

Phew!

That's all.

[Titanium Hammer]

Thanks Dolk, for all your hard work.

+2

[Junk Yard Dog]

You know something Darryl? I think we should shut down the board at least one day a month so some of these guys will actually get up from the chair and leave the house. Expose their deathly pale skin to some sunlight, become reacquainted with walking, maybe start working on the jungle that used to be their back yards, wash the car, go to a gunshop and buy a gun, go shooting. Maybe we can do it on a weekly basis every Sunday Think of the money we could make from the $20 thank you's the wives will send us

[Mike]

You know something Darryl? I think we should shut down the board at least one day a month so some of these guys will actually get up from the chair and leave the house. Expose their deathly pale skin to some sunlight, become reacquainted with walking, maybe start working on the jungle that used to be their back yards, wash the car, go to a gunshop and buy a gun, go shooting. Maybe we can do it on a weekly basis every Sunday Think of the money we could make from the $20 thank you's the wives will send us

Actually, most of the wives are probably happy to have their husbands on the computer and out of the way.

[Darryl]

Could be Jim that after a few weeks of shutting down like that, the wife's would start paying us to keep the forums open!

[Junk Yard Dog]

That we charge them a C note to do !

[zeebill]

Actually with Blue Grass Friday night, a blue grass festival all day Saturday, saying good bye to our minister and church services, and Country Rock group Black Lillies last night at the Purple Fiddle, I didn't even notice that you were gone! I am the Wild Child in the Summer Music season and rarely look at the forums for very long if at all. Gotta have some life out of here and I do enjoy Summer! Man even with sun-block I got quite a red tinge in the mirror this AM. Life is good! Bill

[Junk Yard Dog]

Have fun

[Darryl]

Official "story" from the hosts. (for those who care).


Atlanta, GA – Power Outage

Thank you for your patience over the last several hours. Unfortunately, our Atlanta, GA facility lost power twice last night which lead to extended downtimes.

Incident #1

At approximately 7 pm CST the primary feed to the building at which the data center is located in lost power. The UPS picked up the load while the generator started without a hitch and then transferred the facility over to the generator. Shortly after this occurred the generator became overheated and had to be brought offline.

Early this morning the power was restored back to the primary feed of the building. Our team worked through the wee hours of the morning to bring all servers back online. Unfortunately, we did have some servers with issues which were continued to be worked on.

Incident #2

At approximately 9 am CST this morning, the main power feed was lost again due to a faulty circuit in the basement of the building. At this time, the data center brought in a generator due to the fact the primary generator still was unable to be fixed.

Currently

At this point, the facility has regained power. Both the data center and our technicians are working to bring each server online. In addition, our team of System Admin are standing by via live chat to assist with any services that may be down or any problems you may encounter due to the outage.

There are a handful of servers that are still offline at this point which our team is working to bring back online or are currently fixing services on.



After everything was restored, our server (and forums) came on line. At that point we realized the forums data base had been goofed up (there was a SQL database error message). So it took another 30 min to an hour to repair that. And we went back "online"

Darryl

[TrainWreck]

Thanks Dolk, for all your hard work.

Yes; A very big thanks for your time and effort.

[Junk Yard Dog]

The more complex the mechanism the easier they break down.

[Celt]

I am showered, shaved and fed. Laying on the couch under the ceiling fan, the forum is up and running.
Life is good!!!

[Junk Yard Dog]

I am showered, shaved and fed. Laying on the couch under the ceiling fan, the forum is up and running.
Life is good!!!

.....and then the sun exploded....

[Darryl]

Here is what their generator looked like after just an hour or less of running.

That is oil and water on the ground and slung on the conduit on the walls (to the right).

gen1.png

Their take:


This past weekend one of our datacenters in Atlanta had a full power failure. We await details from them on the event and will quickly pass them to you as soon as we fully know what happened. Here is what we know so far. This facility lost all power, city, backup, ups, and implemented emergency measures to get power restored. Since then we have worked vigilantly to make sure each and every server was working. We achieved that goal last night within hours of the event.

The cloud dropped a san after suffering this power event which was power cycled multiple times from the A & B feeds going on and off, causing many disks to fail. We restored the disks, rebuilt the cloud, and began its restoration. This new backup systems, software, and policy changes have us restoring data in a record time. 12 tb will be have been restored in approx ~24hrs.

This is why our own helpdesk was down. It was on the cloud and we brought it back first to restore our clients ability to contact us. And then other clients and cloud servers have been, and are still being restored. To those still waiting for their server to come up, please watch our forums for the progress of your server.

[Greasemonkey]

Poor 'ol 3208 Cat engine blowed it's guts out


Thanks for your hard work