Files
The SQL MA snapshot perfSONAR-SQL_MA-src-snapshot-20060811 was used. Untar'd and linked from /opt/
:
No Format |
---|
[ytl@net-desk1:/opt/perfSONAR]$ ls -lah total 40K drwxr-xr-x 3 ytl ytl 4.0K Aug 24 10:26 . drwxr-xr-x 8 ytl ytl 4.0K Aug 24 10:39 .. lrwxrwxrwx 1 ytl ytl 14 Aug 9 16:30 current -> perfSONAR-1.0/ lrwxrwxrwx 1 ytl ytl 38 Aug 24 10:26 current-SQL_MA -> \ perfSONAR-SQL_MA-src-snapshot-20060811 drwxrwxr-x 10 ytl ytl 4.0K Aug 9 16:51 perfSONAR-1.0 lrwxrwxrwx 1 ytl ytl 94 Aug 24 09:58 perfSONAR-SQL_MA-src-snapshot-20060811 -> \ /u/sf/ytl/Work/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811 |
Library Installation
Ran ant -f build-sqlma.xml libs-sqlma
inside the ant
directory, which got a lot of jars etc from the wiki site and dumped then into /opt/perfSONAR/perfSONARcurrent-SQL_MA-src-snapshot-20060811/perfsonar/lib
eXist User Account Creation
eXist is already installed, so just creating a sql user and password (sqlmaservice:sqlmaservice
with group dba
) on the Jetty server (port 8680).
...
Code Block |
---|
\[ytl@net-desk1:/opt/exist/current/bin\]$ ./startup.sh Configuring eXist from /opt/exist/eXist-20060316/conf.xml Found 1 catalog entries. Loading catalog: /opt/exist/eXist-20060316/webapp/WEB-INF/catalog.xml IN CONFIGURE cluster.journal.maxStore 65000 cluster.journal.shift 100 29 Aug 2006 10:24:43,793 [main] INFO \ (FileResource.java [<clinit>]:60) - Checking Resource aliases 29 Aug 2006 10:24:43,996 [main] INFO \ (HttpServer.java [setStatsOn]:1068) - Statistics on = false for org.mortbay.jetty.Server@ee6681 29 Aug 2006 10:24:44,006 [main] INFO \ (HttpServer.java [start]:654) - Starting Jetty/5.0.0 29 Aug 2006 10:24:44,094 [main] INFO \ (HttpServer.java [start]:669) - Started org.mortbay.http.NCSARequestLog@ae3364 29 Aug 2006 10:24:44,576 [main] INFO \ (HttpContext.java [start]:1604) - Started WebApplicationContext[eXist Server,eXist Server] Logging already initialized. Skipping... 29 Aug 2006 10:24:45,939 [main] WARN \ (JavaUtils.java [isAttachmentSupported]:1305) - Unable to find required classes \ (javax.activation.DataHandler and javax.mail.internet.MimeMultipart). Attachment support is disabled. 29 Aug 2006 10:24:46,376 [main] INFO \ (SocketListener.java [start]:204) - Started SocketListener on 0.0.0.0:8680 29 Aug 2006 10:24:46,376 [main] INFO \ (HttpServer.java [start]:690) - Started org.mortbay.jetty.Server@ee6681 |
IEPM-BW MA creation details
DataBase Initialisation and Configuration
Just noticed that I don't actually have a MySQL server running: so downloded mysql-standard-5.0.24-linux-i686-glibc23
and untar'd in /opt/mysql/current
(symlinked).
Started it up with:Ran ant -f build-sqlma.xml configure-sqlma
, which creates a file at
/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant/const.properties
(reran with /opt/ path rather than afs paths where possble)
Code Block |
---|
[ytl@net-desk1:/opt/mysql/current]$ ./configure
NOTE: This is a MySQL binary distribution. It's ready to run, you don't
need to configure it!
To help you a bit, I am now going to create the needed MySQL databases
and start the MySQL server for you. If you run into any trouble, please
consult the MySQL manual, that you can find in the Docs directory.
Installing all prepared tables
Fill help tables
To start mysqld at boot time you have to copy support-files/mysql.server
to the right place for your system
PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER !
To do so, start the server, then issue the following commands:
./bin/mysqladmin -u root password 'new-password'
./bin/mysqladmin -u root -h net-desk1.slac.stanford.edu password 'new-password'
See the manual for more instructions.
NOTE: If you are upgrading from a MySQL <= 3.22.10 you should run
the ./bin/mysql_fix_privilege_tables. Otherwise you will not be
able to use the new GRANT command!
You can start the MySQL daemon with:
cd . ; ./bin/mysqld_safe &
You can test the MySQL daemon with the benchmarks in the 'sql-bench' directory:
cd sql-bench ; perl run-all-tests
Please report any problems with the ./bin/mysqlbug script!
The latest information about MySQL is available on the web at
http://www.mysql.com
Support MySQL by buying support/licenses at http://shop.mysql.com
Starting the mysqld server. You can test that it is up and running
with the command:
./bin/mysqladmin version
|
Downloaded and installed the MySQL DataBase configuration/setup
MySQL Setup using:
Code Block |
---|
[ytl@net-desk1:/opt/mysql/current/bin]$ ./mysql -u root -p < /opt/perfSONAR/mysql-sqlma-dbsetup.sql
|
Which creates the following data in the MySQL DB:
Code Block |
---|
mysql> use perfsonar_ma Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed mysql> show tables; +perfSONAR/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant]$ ant -f build-sqlma.xml configure-sqlma Buildfile: build-sqlma.xml configure-sqlma: copy-initconfig-for-sqlma: [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf copy-properties: [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf get-message-1: [echo] Start creating ant/const.properties file [echo] ----------------------------------------------------------- _get-java-path: get-java-path: [input] Enter the path of Java [/usr/local/java/current]: [echo] Accepted Java path: /usr/local/java/current get-axis-path: [input] Enter the path of Axis location [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/../apache-tomcat-5.5.17/webapps/axis]: /opt/tomcat/current/webapps/axis [echo] Accepted Axis path: /opt/tomcat/current/webapps/axis get-server-address: [input] Enter the address of host (perfSONAR service location) [localhost]: net-desk1.slac.stanford.edu [echo] Accepted server address: net-desk1.slac.stanford.edu get-server-port: [input] Enter the port of server [8080]: 80 [echo] Accepted server port: 80 set-const-properties-for-sqlma: [propertyfile] Updating property file: /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant/const.properties [echo] const.properties file created [input] Press Return key ... get-message-2: [echo] Start creating conf/service.properties file [echo] --------------------------+ | Tables_in_perfsonar_ma | +--------------------------------- get-server-address: + | domain_link [input] Enter the address of host (perfSONAR service location) [localhost]: net-desk1.slac.stanford.edu | | interdomain_link [echo] Accepted server | | perfsonar_utilization | +------------------------+ 3 rows in set (0.00 sec) mysql> describe domain_link; +--------------+--------------+------+-----+-------------------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+-------------------+-------+ | id | varchar(255) | NO | | | | | time | timestamp | YES | | CURRENT_TIMESTAMP | | | status_oper | varchar(255) | YES | | UNKNOWN | | | status_admin | varchar(255) | YES | | UNKNOWN | | | alarm_id_set | varchar(255) | YES | | NULL | | | comments | varchar(255) | YES | | NULL | | +--------------+--------------+------+-----+-------------------+-------+ 6 rows in set (0.00 sec) mysql> describe interdomain_link; +--------------+--------------+------+-----+-------------------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+-------------------+-------+ | id | varchar(255) | NO | | | | | time | timestamp | YES | | CURRENT_TIMESTAMP | | | status_oper | varchar(255) | YES | | UNKNOWN | | | status_admin | varchar(255) | YES | | UNKNOWN | | | alarm_id_set | varchar(255) | YES | | NULL | | | comments | varchar(255) | YES | | NULL | | +--------------+--------------+------+-----+-------------------+-------+ 6 rows in set (0.00 sec) mysql> describe perfsonar_utilization; +------------+-------------+------+-----+-------------------+-------+ | Field | Type | Null | Key | Default | Extra | +------------+-------------+------+-----+-------------------+-------+ | metadataId | varchar(30) | NO | | | | | value | float(16,4) | NO | | | | | valueUnits | varchar(30) | YES | | NULL | | | timeValue | int(11) | NO | | | | | ts | timestamp | YES | | CURRENT_TIMESTAMP | | +------------+-------------+------+-----+-------------------+-------+ 5 rows in set (0.01 sec) |
Ran ant -f build-sqlma.xml configure-sqlma
, which creates a file at
/opt/perfsonar/current-SQL_MA/perfsonar/ant/const.properties
Code Block |
---|
[ytl@net-desk1:/opt/perfSONAR/current-SQL_MA/perfsonar/ant]$ ant -f build-sqlma.xml configure-sqlma Buildfile: build-sqlma.xml configure-sqlma: copy-initconfig-for-sqlma: [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf copy-properties: [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf [copy] Copying 1 file to /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf get-message-1: [echo] Start creating ant/const.properties file [echo] ----------------------------------------------------------- _get-java-path: get-java-path: [input] Enter the path of Java [/usr/local/java/current]: [echo] Accepted Java path: /usr/local/java/current get-axis-path: [input] Enter the path of Axis location [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/../apache-tomcat-5.5.17/webapps/axis]: /opt/axis/current [echo] Accepted Axis path: /opt/axis/current get-server-address: [input] Enter the address of host (perfSONAR service location) [localhost]: net-desk1.slac.stanford.edu [echo] Accepted server address: net-desk1.slac.stanford.edu get-server-port: [input] Enter the port of server [8080]: 80 [echo] Accepted server port: 80 set-const-properties-for-sqlma: [propertyfile] Updating property file: /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant/const.properties [echo] const.properties file created [input] Press Return key ... get-message-2: [echo] Start creating conf/service.properties file [echo] ----------------------------------------------------------- get-server-address: [input] Enter the address of host (perfSONAR service location) [localhost]: net-desk1.slac.stanford.edu [echo] Accepted server address: net-desk1.slac.stanford.edu get-xmldb-address: [input] Enter the address of xmldb eXist [localhost]: net-desk1.slac.stanford.edu [input] Enter the port of xmldb eXist [8090]: 8680 [input] Enter the type of access to xmldb eXist [http]: [echo] Accepted xmldb server is http://net-desk1.slac.stanford.edu:8680/exist/rest/db/sqlmaconfig __get-sql-config-file: [input] Enter the path of sql metadata config file [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/sql-database_TEST.xml]: /opt/perfSONAR/current-SQL_MA/perfsonar/conf/sql-database_TEST.xml _get-sql-config-file_1: [echo] Accepted sql metadata config file: /opt/perfSONAR/current-SQL_MA/perfsonar/conf/sql-database_TEST.xml _get-sql-config-file_2: get-sql-config-file: set-service-properties-for-sqlma: [propertyfile] Updating property file: /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/service.properties [echo] service.properties file created [input] Press Return key ... get-message-3: [echo] Start creating conf/log4j.properties file [echo] ----------------------------------------------------------- set-log4j-properties: [propertyfile] Updating property file: /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/log4j.properties [echo] log4j.properties file createdaddress: net-desk1.slac.stanford.edu get-xmldb-address: [input] Enter the address of xmldb eXist [localhost]: net-desk1.slac.stanford.edu [input] EnterPress theReturn port of xmldb eXist [8090]: 8680 key ... get-message-4: [inputecho] EnterStart theadding type ofproperties access to xmldbTomcat eXist [http]: catalina.properties file [echo] Accepted xmldb server is http://net-desk1.slac.stanford.edu:8680/exist/rest/db/sqlmaconfig __get-sql-config-file----------------------------------------------------------- set-tomcat-properties: [input] Enter the path of sqlTomcat metadatalocation config file [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/sql-database_TEST.xml]: /opt/perfSONAR/perfSONAR-SQ L/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/sql-database_TEST.xml _get-sql-config-file_1: _get-sql-config-file_2: [echo] !!!!!! ERROR: Provided sql metadata config file does not exist !!!!!! get-sql-config-file: set-service-properties-for-sqlma: [propertyfile] Updating property file: ../apache-tomcat-5.5.17]: /opt/tomcat/current/ [input] Enter the path of service.properties file [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/service.properties]: /opt/perfSONAR/current-SQL_MA/perfsonar/conf/service.properties [input] Enter the path of components.properties file [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/components.properties]: /opt/perfSONAR/current-SQL_MA/perfsonar/conf/servicecomponents.properties [echopropertyfile] Updating service.properties file created [input] Press Return key ... get-message-3: [echo] Start creating conf/log4j.properties file [echo] ----------------------------------------------------------- set-log4j-properties: [propertyfile] Updating property file: property file: /opt/tomcat/current/conf/catalina.properties BUILD SUCCESSFUL Total time: 2 minutes 10 seconds |
eXist Database Configuration
- runing the
xmldb-init-sqlma
ant target results in
Code Block |
---|
[ytl@net-desk1:/opt/perfSONAR/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant]$ ant -f build-sqlma.xml xmldb-init-sqlma xmldb-init-sqlma: getresource-rrdma: xmldb-exist-rrdma: [exist] Checking collection: xmldb:exist://net-desk1.slac.stanford.edu:8680/exist/xmlrpc/db/sqlmaconfig __xmldb-init-rrdma: xmldb-init-rrdma: getdbroot-rrdma: get-xmldb-collection: xmldb-collection-rrdma: [create] Database driver already registered. BUILD FAILED /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/ant/sqlma/sqlma-exist-xmldb-targets.xml:29: \ The following error occurred while executing this line: \ /afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/log4j.propertiesant/rrdma/rrdma-exist-xmldb-targets.xml:147: \ The following error [echo] log4j.properties file created [input] Press Return key ... get-message-4: [echo] Start adding properties to Tomcat catalina.properties file [echo] ----------------------------------------------------------- set-tomcat-properties: [input] Enter the path of Tomcat location [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/../apache-tomcat-5.5.17]: /opt/tomcat/current [input] Enter the path of service.properties file [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/service.properties]: /opt/perfSONAR/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/service.properties [input] Enter the path of components.properties file [/afs/slac.stanford.edu/g/scs/net/netmon/perfSONAR/SQLtypeMAService/java/20060811/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/components.properties]: /opt/perfSONAR/perfSONAR-SQL_MA-src-snapshot-20060811/perfsonar/conf/components.properties [propertyfile] Updating property file: /opt/tomcat/current/conf/catalina.properties BUILD SUCCESSFUL Total time: 6 minutes 26 seconds |
...
occurred while executing this line: \
java.lang.NoSuchMethodError: org.exist.xmldb.XmldbURI.xmldbUriFor(Ljava/lang/String;)Lorg/exist/xmldb/XmldbURI;
|
It looks like a CLASSPATH problem: however, the current class path is:
Code Block |
---|
CLASSPATH=::/opt/tomcat/current/webapps/axis/WEB-INF/lib/activation.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/axis-ant.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/axis.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/commons-discovery-0.2.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/commons-logging-1.0.4.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/commons-pool-1.1.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/exist.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/jaxrpc.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/jdom.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/log4j-1.2.8.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/mail.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/perfSONAR-generic.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/perfSONAR-rrdma.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/perfSONAR-xmlls.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/resolver.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/rrdjtool.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/saaj.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/wsdl4j-1.5.1.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xalan.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xercesImpl.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xercesSamples.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xml-apis.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xmldb.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xmlParserAPIs.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xmlrpc-1.2-patched.jar:\
/opt/tomcat/current/webapps/axis/WEB-INF/lib/xmlsec.jar:\
.
|
Which as the eXist jar; but it is actually one that i deployed as a war rather than the one with Jetty. Either way, exist.jar
does indeed contain the requested class files. Manually adding replacing the exist.jar path to that of /opt/exist/current/exist.jar
doesn't work either.
Running the xmldb-init-sqlma
ant call still doesn't work tho'.
Noticed that /opt/perfSONAR/current-SQL_MA/perfsonar/conf/service.properties
had the wrong port number for the service.r.access_points
, so changed it to 80.
Code Block |
---|
service.r.access_point=\
http\://net-desk1.slac.stanford.edu\:80/axis/services/MeasurementArchiveService
|
Filed as Bug 76 in bugzilla.