Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

BELOW DOESN'T WORK WELL - site-packages takes precedence on sys.path, need to use PYTHONPATH or uninstall orig - hassle

 

Developing an external python package typically means you will be doing something like

...

  • This must be done from a rhel7 machine like pslogin that has outside internet access
  • It takes a while
  • It creates the hideen hidden directory ~/.conda where your environments and package repository will be
  • You will get 3GB + of packages
  • There will be noisy warnings about conda.lock commands failing
  • You can't use your environment on rhel5 or rhel6

Testing Your Environment

if you want to run the full test suite on your environment, enter the command

...

In this step, we will make a soft link to the bin subdir of the central install. If you look at the PATH environment variable with ana-1.0.7, this should be clear. You will do something likeAssuming you cloned a environment from the production rhel7 installation, you will do

cd ~/.conda
ln -s /reg/g/psdm/sw/conda/inst/miniconda2-prod-rhel7/bin bin

...

In addition to creating test releases against conda environments managed by the LCLS Data Analaysis group, you can create a test release against your own environment (after doing hack step above). This will allow you to both install standard python packages in develop mode, and develop packages that are part of psana.

...

python setup.py configure --mpi --hdf5=$CONDA_PREFIX
python setup.py develop

Inspect site-packages

One way to see if things worked, If you look in your myenv site-packages after installing in develop mode, you should see files like

ls -lrth $CONDA_PREFIX/lib/python2.7/site-packages

-rw-r--r--  1 davidsch sc   46 Dec 13 22:00 h5py.egg-link
-rw-r--r--  1 davidsch sc   53 Dec 13 22:02 scikit-beam.egg-link
-rw-r--r--  1 davidsch sc   97 Dec 13 22:02 easy-install.pth

Conda_setup for Test Release and Develop

...

from test release directory (mycondarel). If you did not do the HACK step correctly, this will fail.