Confluence will be unusable 23-July-2024 at 06:00 due to a Crowd upgrade.
...
Nodes | Services | Start Time | Expected End Time | Actual End Time | Reason | Comments | ||
---|---|---|---|---|---|---|---|---|
| ana01/ana02 file systems | Wed Mar 28th, 2012 9am | Wed Mar 28th, 2012 1pm |
| Upgrade to IB | |||
psananeh | NEH storage and processing |
| Tue | Mon |
| Completed. Chilled water was restored on Friday. | ||
psana batch nodes | All Science data is currently unavailable. Psananeh psanafeh is up for Matlab use, but no access to data on Lustre file system. | Saturday |
|
| Lustre file system remains down after the unplanned power outage on Saturday. | The system administrators are working to bring them back. |
|
|
| All LCLS computing services | Monday |
|
| Electrical work at NEH server room and FEH. | pslogin is up. NFS server, LDAP, DNS, pswww are up. |
|
|
psana, | All Science data, All user home directories, all DAQ cache nodes. All online services. | Wed | Wed | Wed | Upgrade of Lustre hardware. |
|
|
|
psana | Science data access | Tue |
| Tue | NEH power outage | B950 and several other buildings experienced short power glitch but the lustre file servers did not survive the interruption and is still being brought up. |
|
|
psana | Science data access | Thu | Thu |
| Lustre failover testing. |
| ||
NEH online nodes | NEH DAQ, outside ssh access | Thu | Thu |
| Server room upgrade, ana02 memory upgrade | Completed | ||
psana | Science data access | Thu | Thu | Thu | Lustre maintenance | Completed. Upgraded memory on psanaoss101-104, and replaced 10Gbit cards with 1 port SMCs. 717W power supplies are in place on psanaoss103-104 now. | ||
psana | Science data access | Thu | Thu | Thu | Lustre maintenance | Completed | ||
All | All | Fri | Sun | Sun | NEH power outage | Completed | ||
psana | Science data access | Thu | Thu | Thu | Lustre maintenance | Completed | ||
psana | Science data access | Fri | Mon |
| NEH cooling outage | Completed | ||
psana | Science data access | Thu | Thu |
| Enabling HA for Lustre system | Completed | ||
All | All | Sat | Sat | Mon | NEH power cut | Completed | ||
psana | Science data access | Thu | Thu |
| Lustre testing | Completed | ||
All | All | Wed | Wed |
| NEH power cut | This power cut was NOT planned | ||
All | All | Sat | Sat | Mon | NEH power cut | Completed |