Logging on
There are 4 VMs.
dhcp-nebula-129-209.slac.stanford.edu
dhcp-nebula-129-210.slac.stanford.edu #application (e.g. Apache) runs on this one
dhcp-nebula-129-213.slac.stanford.edu
dhcp-nebula-129-214.slac.stanford.edu
Note these machines are not visible (e.g. for the web) from outside SLAC. They are accessible via ssh from outside SLAC. Les can ssh with the usual priv/public ssh key.
Command mode
| Code Block |
|---|
177cottrell@pinger:~$ssh dhcp-nebula-129-210.slac.stanford.edu
Warning: Permanently added 'dhcp-nebula-129-210.slac.stanford.edu' (RSA) to the list of known hosts.
Last login: Thu Aug 6 17:24:51 2015 from pinger.slac.stanford.edu
===============================================================================
NOTICE TO USERS
This is a Federal computer system and is the property of the United States
...
conditions of use. LOG OFF IMMEDIATELY if you do not agree to the conditions
stated in this warning.
===============================================================================
RHEL Server 6.7 (Santiago) 2.6.32-573.3.1.el6.x86_64 (4x2099MHz OpenStack Nova)
===============================================================================
WINSTART: Undefined variable.
169cottrell@dhcp-nebula-129-210:~$
|
Accessing Web Application
This is at
http://dhcp-nebula-129-210/cgi-bin/querybuilder.pl. We hope to move this to http://www-iepm.slac.stanford.edu/cgi-wrap/querybuilder.pl
...
/afs/slac.stanford.edu/g/www/cgi-wrap-bin/net/offsite_mon/newtraceping.pl. It places the images, Javascript, css in /afs/slac/g/www/www-iepm/pinger/querybuilder. However, we were unable to execute the impala-shell command remote on the cluster from www-wanmon. This included trying with ssh but ran into known-hot problems,
Accessing Hue application
http://dhcp-nebula-129-210:8888/
...
May be useful to use web application to create the SQL then copy to Hue to get chart.
Accessing Cloudera Manager
http://dhcp-nebula-129-210:7180/cmf/home
...
sudo /sbin/service httpd [stop | start | restart]
Problems
The java installed with Cloudera at /usr/java/jdk1.7.0_67-cloudera/bin/java appears to have a vulnerability, see INC0055183. The version at /usr/local/bin/java installed as part of Taylor appears to be OK. I therefore made a copy of the the cloudera java, removed it and planned to make a logical link from /usr/java/jdk1.7.0_67-cloudera/bin/java to /usr/local/bin/java
...
See ServiceNow INC0055183 for m ore details.
Database
The database only contains by-node and 100Bytes. The by-site is done by Impala. It is missing most of the data for 2002.
Creation
The data was transformed from PingER hourly flat files to the database format using a scicumulus workflow (a parallelization tool) to Extract the flat files from the FTP space, Transform them following a schema (see the paper) and Loaded into the HDFS file space. Renan has the scripts. We need a cronjob to update.
Backup
This is at
193cottrell@pinger:~tbarbosa$ls -l /afs/slac/public/users/cottrell/pinger-datawhs/
total 5373504
-rw-r--r-- 1 cottrell sf 896878 Aug 29 14:43 dimensions.rar
-rw-r--r-- 1 cottrell sf 5501570738 Aug 29 15:00 years.rar
...