All services should be back online now
vmware host down
Services are down right now after failure of the virtual machine host disk drives. Things should be back up by 3:30pm…
Update: vmware is fighting me, maybe 4:30…
Not moving after all
The copy failed, but I realized the problem with the primary server was it was getting full, which kills performance. I freed up some space and agora is back up and running ok now, and I’m in the process of moving some backups to the other file server to keep the problem from recurring.
Agora moving to new fileserver
Agora has been very flaky lately, so I’m moving it to a different fileserver to see if it likes that better; it will probably be down for a few hours while the copy takes place.
Back online
It seems the problem was the zfs fileserver got a little too full and performance went to hell. Freed up some space and things are running normally again…
Virtual infrastructure out to lunch
vmware is having serious problems, still working on it…
Agora is growing increasingly unstable
The filesystem on the agora server is degrading and the system is becoming unstable. It is recommended that you make sure anything you want is copied elsewhere. I’m not sure when I’m going to get the chance to get things moved to a new server.
Services restored
All services should be operational now.
UPS Failure
Data center UPS failure – services will resume later this morning
Reboot taking a long time
A reboot of agora is taking a long time while it cleans the filesystem…