Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Introduction

Package management of the analysis software that LCLS maintains for users is being transitions transitioned to conda, from RPM's. This software includes psana (the software LCLS develops for working with experiment data), hdf5, openmpi, and many python packages such as numpy, scipy, ipython and scikit-beam. Advantages of this transition include

  • easier for LCLS to integrate and update new software for users
  • easier for users to customize their own environments with psana
  • easier for offsite users to install psana

Users

This page:

User Documentation

Users need to do the following

  • use bash as your shell, not tcsh or csh (conda doesn't support csh)
  • run the command: source /reg/g/psdm/etc/ana_env.sh as usual (explained in the psana python setup example)
  • run the command: source conda_setup

 Sourcing the conda_setup script does a few things

  • modifies certain linux environment variables that can affect conda
  • identifies the most recent conda environment built for the LCLS Data analysis group
  • activates that conda environment

At this point your linux prompt should change to something that starts with the name of the conda environment. For example,

(ana-1.0.7)

Python 3

The LCLS Data Analysis group will maintain conda environments with python 3. To activate the latest python 3 environment, pass the --py3 flag to conda_setup. That is run

source conda_setup --py3

Note - psana has not been ported to python 3.

 

Notes

  • source conda_setup -h for full help on the script
  • after sourcing conda_setup, you can execute the undo_conda command to restore your environment
  • you can Psana Developers

Test Release

Adding a Package

Relinfo

 

Administration

 

 Conda based Psana in LCLS central install

Not recommended, and out of date, but here are notes on maintaining your own miniconda install that psana:

Adding Conda Packages to Self Managed Installation - for use outside LCLS or managing your own conda stack at LCLS
 

Internal Notes

There are a lot of JIRA issues that come off of this main ticket:

Jira
serverSLAC National Accelerator Laboratory
serverId1b8dc293-975d-3f2d-b988-18fd9aec1546
keyPSRT-78

There are two related github repositories:

test an installed conda environment: https://github.com/davidslac/test-lcls-conda-build-system

manage the conda installations and environments: https://github.com/davidslac/manage-lcls-conda-build-system

covers how to get in and out of the conda environments. Everyone will find this page useful.

Psana Developers/C++ Users

psana developers will also need this page

Psana Developer Documentation

to learn how to create and manage test releases. LCLS users that write C++ psana modules will also need this information.

Administrators

Information on managing the environments is here

Admin Documentation 

Release Notes

Similar to the Pre-Conda Release Notes, we maintain release notes on the conda environment here:

Conda Release Notes

Try to keep content in this master page small and create new child pages for topics.