BBC Music, Programs, Nature, Food and DBpedia 3.6 Clustered Server Edition

Installation

  1. If not already running, instantiate a Virtuoso EC2 AMI instance
  2. From the AWS Management Console, select the "Volumes" link under the "Elastic Block Storage" section



  3. Click on the "Create Volume" button and set "Size" to 75GB, "Availability Zone" to match the zone of your running Virtuoso EC2 AMI instance and "Snaphot" to the required "BBC (Music, Programmes, Nature, Food) + DBpedia 3.6 -- Virtuoso Cluster DB" snapshot.



  4. Select the newly created volume and click on the "Attach Volume" button to attach the volume to the required Virtuoso EC2 AMI instance



  5. Select the "Instance" and "Device" the volume should be attached to and click "Attach"



  6. The volume will now be listed as "attached" to the specified Virtuoso EC2 AMI instance id.



  7. Note a list of available Virtuoso public snapshots can be obtain by select the "Snapshot" link in the AWS console, selecting "Public Snapshots" from the viewing drop down list box and search for "Virtuoso". A volume can be created for any of these snapshots and attached to a Virtuoso EC2 AMI instance



    Description: BBC (Music, Programmes, Nature, Food) + DBpedia 3.6 -- Virtuoso Cluster DB
    Virtuoso Server Type: Clustered Server Edition
    Snapshot ID (Linux/Unix): snap-ecc23880
    Size: 75GB
    Creation Date: 2011-02-17
    Last Updated: 2011-02-17
    License: Creative Commons: Attribution Share Alike
    Submitted By: OpenLink Software
    Source: http://www.openlinksw.com

  8. "ssh" into the Virtuoso EC2 AMI instance 

    $ ssh -i MyKeyPair.pem root@<ec2-ami-public-dns-cname>
Last login: Thu Feb 17 09:02:39 2011 from 217.43.105.235 
[root@domU-12-31-39-00-00-61 virtuoso]# mkdir /opt/virtuoso/bbc
[root@domU-12-31-39-00-00-61 virtuoso]# mount /dev/sdf /opt/virtuoso/bbc
[root@domU-12-31-39-00-00-61 virtuoso]# ls -l /opt/virtuoso/bbc/
[root@domU-12-31-39-00-00-61 bbc]# ls -ltr
total 31608
lrwxrwxrwx 1 root root       17 Feb 17 08:34 lib -> /opt/virtuoso/lib
lrwxrwxrwx 1 root root       21 Feb 17 08:34 install -> /opt/virtuoso/install
-rwxr-xr-x 1 root root       86 Feb 17 08:34 cstart.sh
lrwxrwxrwx 1 root root       17 Feb 17 08:34 bin -> /opt/virtuoso/bin
drwxr-xr-x 2 root root     4096 Feb 17 08:37 s01
drwxr-xr-x 2 root root     4096 Feb 17 08:40 s02
drwxr-xr-x 2 root root     4096 Feb 17 08:43 s03
lrwxrwxrwx 1 root root       17 Feb 17 08:47 vad -> /opt/virtuoso/vad
drwxr-xr-x 2 root root     4096 Feb 17 08:47 s04
[root@domU-12-31-39-00-00-61 bbc]#

  9. To run the newly attached data set, first setup your Virtuoso environment 

    [root@domU-12-31-39-00-00-61 ~]# cd /opt/virtuoso/
[root@domU-12-31-39-00-00-61 virtuoso]# . ./virtuoso-environment.sh
[root@domU-12-31-39-00-00-61 ~]# cd /opt/virtuoso/bbc
[root@domU-12-31-39-00-00-61 ~]# export VIRTUOSO_HOME=`pwd`

  10. To start the database with the latest Virtuoso AMI the following transaction log file must first be deleted 

    [root@domU-12-31-39-00-00-61 ~]# rm s01/dbpedia.trx
[root@domU-12-31-39-00-00-61 ~]# rm s02/dbpedia.trx
[root@domU-12-31-39-00-00-61 ~]# rm s03/dbpedia.trx
[root@domU-12-31-39-00-00-61 ~]# rm s04/dbpedia.trx

  11. The indexes also need to be rebuilt by setting AnalyzeFixQuadStore = 1 in the [Parameters] section of the s01/virtuoso.ini cluster master node configuration file, as detailed in the documentation

  12. Run the "virtuoso-start.sh" script to start the Virtuoso server containing the attached data set 

    [root@domU-12-31-39-00-00-61 ~]# virtuoso-start.sh
Starting Virtuoso instance in [s01]
Starting Virtuoso instance in [s02]
Starting Virtuoso instance in [s03]
Starting Virtuoso instance in [s04]
[root@domU-12-31-39-00-00-61 ~]#

  13. Note the Virtuoso Server "dba" user's password is set to the default of "dba" for the dataset, it is recommended this be changed to a suitably secure password using the "System Admin -> User Accounts" tab of the Virtuoso Conductor (http://ec2-ami-public-dns-cname/conductor).

Usage Examples

The Virtuoso hosted data sets can now be explored using the SPARQL or Facet Browser web service endpoints and new Pivotviewer visual interface .

Facet Browser

SPARQL endpoint

Pivotviewer

The Virtuoso hosted data set can now be explored using the Virtuoso PivotViewer? visual interface.

Food

  • A Food recipes collection snaphot



      • Click on the "Edit" button see the underlying SPARQL query generating the collection


Music

  • A Music collection snapshot sorted by artists


Nature

  • A Nature collection snapshot


Programmes

  • A programmes collection snapshot sorted by genre


Related Items