Thu Mar 15 09:38:22 PDT 2012
All systems are up and running.
Wed Mar 14 15:04:28 PDT 2012
We will be rebooting well.com and user.well.com Wednesday evening (Mar 14) at about 11pm US Pacific Time to make a minor configuration change. The reboot and maintenance will take about 20 minutes, and will effect access to the conferences via both Picospan and the Web, as well as all shell services (including alpine mail). We apologize for the inconvenience.
Thu Mar 1 22:26:11 PST 2012
(ETA changed to midnight - we're running a bit behind schedule)
On Thursday evening between about 9pm and midnight US Pacific Time, WELL conferencing via UNIX shell and the web will be down, with all access to well.com and user.well.com disabled for the duration. During this maintenance, we will be switching over to a new system kernel - we expect that this will put an end to the kernel panics we have seen over the last two months.
Access to your email via https://iris.well.com/, POP, and IMAP will not be affected by this maintenance. However, please note that access to email via the "alpine" mail program will not be available since well.com itself will be unavailable.
We apologize for the inconvenience of this maintenance, but random system crashes are even more inconvenient.
Thu Feb 23 21:15:19 PST 2012
ENGAGED IS DOWN - the database was accidentally trashed. We hope to have it back up by 10:30pm US Pacific Time.
Wed Jan 11 17:00:35 PST 2012
We did not reboot Tuesday, so we will be rebooting well.com tonight, Jan 11, at about 10pm US Pacific Time. The reboot will take 5 to 10 minutes, and will effect all uses of the conferences.
Wed Jan 11 09:37:59 PST 2012
All systems are up and running.
Tue Jan 10 12:19:25 PST 2012
We will be rebooting well.com tonight at about 10pm US Pacific Time in an effort to address the repeated system panics. The reboot will take 5 to 10 minutes, and will effect all uses of the conferences.
Fri Dec 16 15:43:25 PST 2011
After a reboot, people are back posting. All systems are up and running.
Fri Dec 16 14:55:25 PST 2011
We are having a problem with the well.com and user.well.com machines. While we resolve this problem, the conferences -- our forums -- are unreachable. Email at iris.well.com and the www.well.com web page remain up. We are sorry for the inconvenience.
Fri Dec 9 10:53:25 PST 2011
All systems are up and running.
Thu Dec 8 2011 16:57:24 PST 2011
Our service provider, Amazon, needs to reboot our systems to perform some sort of system update (presumably patches). Fortunately, we can prevent the automatic reboot by rebooting manually. The best time for us to do this is tonight, even though that means a short notice outage.
So, tonight at about 10pm US Pacific Time, each of the various well.com systems will be brought down then rebooted. Each reboot should take less than 5 minutes, though the reboot of the Zimbra machine may take a few minutes longer (it takes several minutes just for Zimbra to shut down, and another few minutes to start up).
We apologize for the short notice for this announcement.
Thu Oct 27 14:10:50 PDT 2011
Most remaining bugs appear to have been eradicated. If you encounter any, please report them in the cloud discussion in the welltech conference. Log in, shortcut is "g welltech" to get there.
If you use the PicoSpan interface and you're getting error messages on login, the problem may be configuration in your personal log in files. If you send a message to helpdesk, we can back up and replace your current log in files with basic files so that you can test each line to find the culprit.
Wed Oct 26 07:45:03 PDT 2011
The WELL is now back up and running in the Amazon Elastic Computing Cloud (EC2). Please report any bugs by going to the cloud discussion in the welltech conference. Log in, shortcut is "g welltech" to get there. If there is a malformed conference mentioned in an error message on your your Conference List page when you first connect to open a page at "https://user.well.com/engaged.cgi?" you may want to remove the bad conference temporarily by editing your Settings. Reporting a bug could win you one of a bunch of interesting books, so don't hesitate.
Mon Oct 24 16:42:39 PDT 2011
Migration down-time planned
On Tuesday night, Oct 25, we finish up our migration into the Amazon Elastic Computing Cloud (EC2). The last machines to be moved will be the main machine (well.com), the conferencing web server (user.well.com), and the web page server (www.well.com).
As part of this migration, conferencing (via both the command line and web browser), as well as all access to The WELL's web pages, will be disabled. Email will remain available, except for the "alpine" mailer. We're anticipating that the migration should be complete in about 6 hours: from 9pm PDT Tuesday evening to 3am PDT Wednesday morning.
Following the migration, you should be able to use conferencing and all web services as before, with only minor changes that most people will not see. If by some chance you do experience problems after the system is restored to service, don't try to change your settings please. If we are still sorting out the move that could make things harder to diagnose. Please just contact helpdesk with any bug reports or post in the System Status topic in the WELL tech or News conference, so a proper diagnosis can be made.
We apologize for any inconvenience this downtime may cause.
Tue Aug 30 15:48:19 PDT 2011
All systems are up and running normally.
Tues Aug 30 13:07:22 PDT 2011
Performance of the email system remains sluggish - we are working to restore good service.We apologize for any inconvenience this slowness may cause.
Fri Aug 26 13:43:56 PDT 2011
On Monday night, Aug 29, we begin our migration into the Amazon Elastic Computing Cloud (EC2). The first machines to be moved will be the Zimbra mail server (iris.well.com) and a companion server.
As part of this migration, email will be disabled while the migration is under way. We're anticipating that the migration should be complete in about 6 hours: from 9pm PDT Monday evening to 3am PDT Tuesday morning.
During the migration, incoming email from other sites should be queued at those sites, and re-sent later after we begin accepting incoming email again. WELL customers will not be able to look at previously received email during the outage unless you have already moved that email onto your computer's storage device.
Following the migration, you should be able to continue using email using the settings that have worked for the last few weeks - nothing should change. If you encounter problems after the migration, please avoid changing your mail settings and report the problems to Helpdesk or post in System Status Reports.We apologize for any inconvenience this downtime may cause.
Thu Aug 18 21:37:03 PDT 2011
The WELL is now back up and running. Engaged is still presenting some problems, but for now, you can make your own repairs using the instructions on your Conference List page.
Thu Aug 18 14:54:03 PDT 2011
RAID failure knocked out some services, currently being restored
Around 1:00 am on the morning of Thursday, August 18th, home directories became unreachable at The WELL, causing all services except email to fail.
At 9:30 the following morning we we were able to place the following unadorned message on the well.com site:
Most functions of The WELL are currently not available due to a hardware failure of the RAID where most of our data is kept. We are working on restoring full service, but do not yet have an estimated completion time. We apologize for this inconvenience.
Please note that email via IMAP, POP, and the Web should be available at this time.
During that time we went through some replacement hardware options, settled on one, and got it installed at our co-location facility. At about 14:45 PDT logins became possible again.
RAIDs are designed to pr