Scheduled Downtime
Jan. 10th, 2018 | 03:52 pm
posted by: 
eriktheplaid in 
slackers_net
At 3pm PST (6pm EST / 23:00 UTC) Thursday, January 11, 2018 we will take kadath offline for an operating system upgrade. During that time, all services will be offline.
Mail will be queued for future delivery, and DNS should failover to our remote secondary. We hope to have all services restored within an hour, and will post regular updates to Slack.
Link | Leave a comment | Share | Flag
Join Our Slack!
Jan. 10th, 2018 | 03:46 pm
posted by: eriktheplaid in slackers_net
If you are following this community, and you use Slack, why not add the Slackers.net Workspace to your client! We’ll post updates there on a more regular basis.
Contact gripe@ to get an invitation, or reply to this post.
Link | Leave a comment | Share | Flag
Emergency Downtime
Sep. 8th, 2015 | 01:47 pm
posted by: eriktheplaid in slackers_net
We’ll be shutting down leng (which hosts EVERYTHING) for ~1h to replace a faulty memory module.
Aprox. 2-3pm PDT.
Mail will queue and be delivered when the machine comes back.
Apologies for the short notice.
Link | Leave a comment {1} | Share | Flag
Emergency Maintenance 6/28
Jun. 28th, 2014 | 12:48 am
mood: 
thankful
posted by: eriktheplaid in slackers_net
Leng (the hardware on which everything runs virtually) has suffered a drive failure. It is still running (yay, RAID), but we will be replacing the drive tomorrow afternoon (PDT).
We’ll also take this opportunity to do some maintenance. The window should not be large, and DNS should be unaffected by the downtime. Mail will be queued and delivered upon restart.
Sorry for the inconvenience & the short notice, but we hope doing it this way will minimize impact.
Link | Leave a comment | Share | Flag
Planned Downtime 6/21
Jun. 14th, 2012 | 07:10 pm
location: United States, California,San Mateo County, Lomita Park
posted by: eriktheplaid in slackers_net
On Thursday, June 21st our colocation provider (DHP) will be physically moving between upstream providers. This will result in some significant downtime for us as we move our server.
The current schedule is for everything to go dark after 11am PDT and to be back before 7pm PDT.
We apologize for the inconvenience. During the downtime mail will be queued for later delivery, and web requests will all redirect to a “we are moving” page.
Thanks!
Posted via LiveJournal app for iPhone.
Link | Leave a comment | Share | Flag
Minor service disruption: 7pm PST
Feb. 10th, 2011 | 05:50 pm
posted by: eriktheplaid in slackers_net
We’ve identified the problem, and have a solution in place, but it requires changing kernel parameters (which is to say, a reboot). We’re planning on taking things down quickly around 7pm PST. We’ll do it in a cascade so that there is no interruption for mail delivery, and minimal disruption for other services.
Thanks for your patience.
Link | Leave a comment | Share | Flag
Unscheduled Downtime
Apr. 9th, 2009 | 09:30 am
mood: 
dark
posted by: eriktheplaid in slackers_net
Link | Leave a comment {1} | Share | Flag
Unplanned Outage
May. 16th, 2008 | 01:04 pm
location: San Francisco, CA
posted by: eriktheplaid in slackers_net
Our colocation facility overheated in the sweltering temperatures. Fortunately, our server was nearer the bottom of the rack and (it is believed at this time) suffered no damage, but was merely knocked off the network[**]. In fact, we believe our server was only knocked offline later by the brouhaha of attempting to restore/keep other hardware running.
We’ll be using this opportunity to do a hardware upgrade (more memory) to help us move forward on a few projects that have been stalled. (Us?)
We thank you for your patience.
[*] All times Pacific “Morally-Correct” Time
[**] DHP wasn’t so lucky. They lost 2 drives and an entire external (RAID) disk enclosure.
Link | Leave a comment | Share | Flag
Final Migration Update
Jul. 4th, 2007 | 11:01 am
location: On the new server!
mood: melancholy
posted by: eriktheplaid in slackers_net
Everything is live and working.
Unfortunately, an office nyetwerk hiccup just as I was testing the mail queue drain caused me to be unable to prevent the entire queue from draining before the configuration was correct. (It didn't take long, the new machine is fast!)
I hadn't yet made a backup and forgot to set the configuration to soft-bounce, so I once again managed to lose everything in the queue. I feel wretched about this, but there's nothing I can do about it.
Worse, all of the senders received a bounce message with an obnoxious(ly cryptic) error message: "You are not me. Nice Try. FOAD." (This is because the configuration the messages tripped is normally reserved for spammers who claim to be on the internal network when they're clearly not)
I'm terribly sorry about the whole thing, this is hardly the auspicious beginning I'd hoped for. On the plus side, from here on out things should be MUCH more reliable (and fast!) from here on out.
Link | Leave a comment | Share | Flag
Transition Update
Jul. 3rd, 2007 | 08:51 am
location: At the new facility!
mood: ARE WE LIVE?
posted by: eriktheplaid in slackers_net
A quick update on the transition to the colo facility
( A long play-by-play that nobody cares aboutCollapse )That was an unnecessary play-by-play. The crux of it:
- IMAP server is running so mail can be read.
- Kerberos server is running, so you can log in to read said mail.
- AFS is not yet running. This affects:
- Mail delivery. Mail is being queued. This isn't an absolute requirement. We can deliver mail without AFS, but all mail will be delivered to the INBOX. If AFS isn't running this afternoon, I will remove it as a requirement.
- Web services. There's no way around this. The vast majority of our web docs are stored in AFS.
- Home directories in general.