8/30/2010 @ 12:27PM – We’re testing a new SQL configuration. It may or may not impact overall site speed. We apologize for any issues. We’re trying to squash a few bugs.
8/30/2010 @ 7:54AM – Several thousands of people are trying to connect to the site. We were down for a few hours as a result. Expect periodic downtime. Work continues, though! (We also fixed a time stamp issue related to server timezone.)
8/30/2010 @ 12:05AM – You may notice lag spikes here and there. Our SQL database is playing catch-up because of all of the fresh queries.
8/29/2010 @ 10:43PM – The VIP area is back online!
8/29/2010 @ 9:44PM – We lost the entire contents of our webmail folders during the rebuild. Please feel free to re-submit things, re-send messages, etc.
8/29/2010 @ 9:38PM – We ought to have the VIP area back up within the hour.
8/29/2010 @ 7:38PM – Database connections have been re-established. We have regained control of the bridge, folks. Welcome back.
8/29/2010 @ 7:28PM – Hello, world. It would appear that we’re back online. Expect frequent updates as we continue to bring systems up. The VIP area is still down for the moment but we’re working hard to restore it from backup with an ETA of sometime later this evening.
Well that sucked a big one. Glad we’re back.
You have no idea. We’re scrambling to get new content queued up, I’m working on a full write-up explaining what the fuck happened, and we’re hammering away at the VIP area. (Blue almost has all of the SQL reloaded.)
The good news is that we executed a complete, 100% recovery. Not a single fucking post or comment was lost. Everything is exactly as it was at the start of the week. I’m amazed that we were able to accomplish that given the circumstances.
Glad to see everything is working out.
Damn right!
Who shot the server? Pay up.
We just went through a server swap at work, never fun. Thanks for doing a great job Mr Pink…… Glad we’re back!
We’re unfortunately going to have to swap again sometime soon. We’re basically running on an interim solution at the moment. More on that later, though.
::standing ovation::
Glad you guys made it through unscathed. Hope everything continues to go as planned form here on out.
Is the Facebook Connect really necessary?
Zakath – It’s just something we’re testing right now. So far, it’s driving a fair number of new visitors toward the site… which is something we need in order to survive.
How does Facebook Connect increase traffic?
Hey if you’re planning a write up I would love to read about all the blood & guts of what happened. From the comments I’ve seen, some other regular readers are also tech folk who would love to geek out over the details.
Good to see the site back, I missed it.
Deno – It’s not actually Facebook Connect that we’re utilizing. It’s the “Like” function. When somebody likes a post, a link propagates on their wall. That person’s friends then see the link and, if they choose, can click through to WTC. We’ve pulled in several hundred new unique visitors over the past few weeks because of it.
Heavy – I’m going to include the blood and guts that don’t reveal anything sensitive about our internal system structure. There are sure to be some interesting tidbits in the mix, though. WTC is actually a rather complex site on the back end of things.
Oh my WTC, how I missed you. Such a boring life I lead without this site.
Glad we’re back online, I was confined to playing BFBC2 while this place was down.
Also, about that Facebook Like thingbe, is there any way you can move it to the bottom of the posts, to me it just looks awkward at the top of the posts.
I haven’t seen or at least maybe I missed something but the VIP area is still not up? I can’t seem to get into it.