Blog from July, 2014

Scientific Computing Services replaced older hardware and installed two new, more powerful systems for scheduling batch jobs. The new production and backup masters improve overall performance in the batch environment for scientific computing.

Scientific Computing Services deployed a newly available software feature in LSF 9.1, called cpu affinity, on the batch production master. SCS staff also determined the cause of a problem that was resulting in lengthy wait times for pending jobs.   The impact is increased responsiveness to queries and shortened dispatch times.

Scientific Computing Services improved the logging and monitoring of cyber security events on centrally managed systems.   This increases our security and our ability to meet DOE audit requirements.

Scientific Computing Services recently deployed a 150TB disk storage server for KIPAC.  This server will be providing Dark Sky Simulation data via the web.

Scientific Computing Services staff reconfigured the setup for running full incremental backups on larger file systems and for some Oracle RMAN backups.  This has improved the overall performance for TSM backups in the computing environment.

Scientific Computing Services staff is evaluating dispatch issues in the shared "bullet" cluster and is working to educate users to submit batch jobs with appropriate options.  SCS has documented a set of hints for batch job submission on the SCS web site and has disseminated them through a number of distribution lists.  Helping users understand how to submit jobs more efficiently will mitigate delays and long pending times.

Scientific Computing Services purchased two new machines to handle the growth of the LSF batch computing environment.   These systems are being testing using the new CPU affinity capability featured in LSF version 9.   When deployed in the production environment, this upgrade will provide faster and more efficient batch service for scientific computing.