Logging on:

There are 4 VM's in the Cluster:

  1. 134.79.129.191

  2. 134.79.129.192

  3. 134.79.129.193

  4. 134.79.129.194

The VM's are accessible via SSH typing the following command from inside SLAC:
$ ssh [username]@134.79.129.19[1-4], the password is your SLAC Unix password, below is an example:

 

270cottrell@pinger:~$ssh 134.79.129.194
Failed to add the host to the list of known hosts (/u/sf/cottrell/.ssh/known_hosts).
cottrell@134.79.129.194's password:
===============================================================================
                                NOTICE TO USERS
This is a Federal computer system and is the property of the United States
...
===============================================================================
RHEL Server 6.8 (Santiago) 2.6.32-642.3.1.el6.x86_64 (8x2099MHz OpenStack Nova)
===============================================================================
264cottrell@dhcp-os-129-194:~$ls

 

The VM's were created using openstack. The openstack dashboard is accessibleform the web by going to https://openstack.slac.stanford.edu/ and logging in (Domain=SLAC, User name=yourSLAC windows username, password=your Windows password).
  • openstack.slac.stanford.edu

Once logged in you should see the following page:

The complete documentation about openstack dashboard can be found here: http://docs.openstack.org/user-guide/dashboard.html

Cloudera Manager

You can log into Cloudera Manager accessing http://134.79.129.191:7180/ from your web browser:

Username: admin

Password: admin

Cluster configuration can be controlled by cloudera manager dashboard. The documentation can be found here: http://www.cloudera.com/documentation/manager/5-1-x/Cloudera-Manager-Managing-Clusters/Managing-Clusters-with-Cloudera-Manager.html

Impala

Impala is accessible by any of the nodes in the cluster typing the following command:

$ impala-shell

Data should be transferred to the HDFS and then loaded into Impala.

The Impala documentation can be found here: https://www.cloudera.com/documentation/enterprise/5-5-x/topics/impala.html

HDFS

The HDFS documentation can be found here: https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/FileSystemShell.html

You can access the files on HDFS space by running the command from your terminal: hdfs dfs -[unix command] [command arguments] .

Example: hdfs dfs -ls /pinger

  • No labels