This HTML5 document contains 66 embedded RDF statements represented using HTML+Microdata notation.

The embedded RDF content will be recognized by any processor of HTML5 Microdata.

PrefixNamespace IRI
n15http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_10.
n36http://your-ec2-instance-cname/</
n7http://rdfs.org/sioc/services#
n11http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_2.
n41http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-15-attach-restored-snapshot-volume.
n44http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-8-volume-attached.
dchttp://purl.org/dc/elements/1.1/
n16http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_11.
n19http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_6.
n47http://vos.openlinksw.com/dataspace/owiki#
n46http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-6-my-volumes.
n10http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_1.
n2http://vos.openlinksw.com/dataspace/owiki/wiki/VOS/
n6http://vos.openlinksw.com/dataspace/services/wiki/
dctermshttp://purl.org/dc/terms/
n18http://vos.openlinksw.com/dataspace/owiki/wiki/VOS/VirtEC2AMIElasticBlockStorageConfig/sioc.
n45http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-5-my-instances.
rdfshttp://www.w3.org/2000/01/rdf-schema#
n24http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_5.
rdfhttp://www.w3.org/1999/02/22-rdf-syntax-ns#
atomhttp://atomowl.org/ontologies/atomrdf#
n31http://docs.openlinksw.com/virtuoso/ptune.html#
n27http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-10-confirm-create.
n30http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_9.
n5http://vos.openlinksw.com/dataspace/dav#
xsdhhttp://www.w3.org/2001/XMLSchema#
n48http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-9-volumes-create-snapshot.
n42http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-2-volumes.
n34https://console.aws.amazon.com/
siochttp://rdfs.org/sioc/ns#
n35http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-11-create-from-snapshots-tab.
n9http://vos.openlinksw.com/dataspace/person/owiki#
n32http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-13-create-volume-from-snapshot.
n43http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-7-attach-it-somewhere.
n38http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-12-got-snapshot.
n39http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-3-create-volume.
oplhttp://www.openlinksw.com/schema/attribution#
n14http://vos.openlinksw.com/dataspace/person/dav#
n22http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_4.
n25http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-1-dashboard.
n33http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-14-snapshot-as-volume.
n29http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_8.
n12http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_3.
foafhttp://xmlns.com/foaf/0.1/
n40http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/ebs-4-volume-created.
n20http://vos.openlinksw.com/wiki/main/VOS/VirtEC2AMIElasticBlockStorageConfig/EBS_Config_7.
n23http://docs.openlinksw.com/virtuoso/dbadm.html#
siocthttp://rdfs.org/sioc/types#
n4http://vos.openlinksw.com/dataspace/owiki/wiki/
Subject Item
n14:this
foaf:made
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n5:this
sioc:creator_of
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n6:item
n7:services_of
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n47:this
sioc:creator_of
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n4:VOS
sioc:container_of
n2:VirtEC2AMIElasticBlockStorageConfig
atom:entry
n2:VirtEC2AMIElasticBlockStorageConfig
atom:contains
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n2:VirtEBSBackedBYOLAMI
sioc:links_to
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n2:VirtuosoEC2AMI
sioc:links_to
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n2:VirtEC2AMIElasticBlockStorageConfig
rdf:type
atom:Entry sioct:Comment
dcterms:created
2017-06-13T05:37:58.730029
dcterms:modified
2017-06-29T07:37:01.499295
rdfs:label
VirtEC2AMIElasticBlockStorageConfig
foaf:maker
n9:this n14:this
dc:title
VirtEC2AMIElasticBlockStorageConfig
opl:isDescribedUsing
n18:rdf
sioc:has_creator
n5:this n47:this
sioc:attachment
n10:png n11:png n12:png n15:png n16:png n19:png n20:png n22:png n24:png n25:png n27:png n29:png n30:png n32:png n33:png n35:png n38:png n39:png n40:png n41:png n42:png n43:png n44:png n45:png n46:png n48:png
sioc:content
%VOSWARNING% ---+ Using AWS Elastic Block Storage %TOC% ---++ What is AWS Elastic Block Storage? Amazon Elastic Block Storage (Amazon EBS) is a new type of storage designed specifically for Amazon EC2 instances. Amazon EBS allows you to create volumes that can be mounted as devices by EC2 instances; your AMI sees an EBS volume as a raw unformatted hard drive device. These can then be managed through the AWS Management Console, with snapshots taken to preserve the state at a given point in time, etc. ---++ Typical Usage Scenarios ---+++ Preconfigured Databases With EBS it is possible to ship whole instances (dump/restore images of virtuoso.db database files) of databases. OpenLink currently provide a few such preconfigured databases. See specific installation instructions for: * [[VirtEC2AMIDBpediaInstall][DBpedia]] * [[VirtEC2AMINeuroCommonsInstall][NeuroCommons]] * [[VirtEC2AMIBio2rdfInstall][Bio2RDF]] * [[VirtEC2AMIMusicBrainzInstall][MusicBrainz]] ---+++ Managing Virtuoso Storage ---++++ Prerequisites * Ensure you have downloaded your ssh keypair, with which to access your AMI instance. * Some Unix/Linux knowledge is assumed. ---++++ Creating larger databases 1 Start by logging into your [[https://console.aws.amazon.com/][Amazon AWS Management Console]]. From here you should see the dashboard overview with an instance running: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-1-dashboard.png" />%BR%%BR% 1 From the left menu, select *Volumes* to view any existing EBS volumes you might have created. In this case, we have no pre-existing volumes: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-2-volumes.png" />%BR%%BR% 1 Click *create* and fill in a size (here 1Gb) and an availability zone. Note that this must match the availability zone of the instance to which you attach it: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-3-create-volume.png" />%BR%%BR% 1 After a short while, the new EBS volume will be created and appear in the management console accordingly: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-4-volume-created.png" />%BR%%BR% 1 If you click *attach,* a dialog will pop-up asking to which instance the new volume should be attached. Choose the relevant one and select a device-name for the volume to use within the AMI. Here we choose <code>/dev/sdf</code> (a pseudo-SCSI drive name): %BR%%BR%<img src="%ATTACHURLPATH%/ebs-7-attach-it-somewhere.png" />%BR%%BR% 1 If not already connected, ssh into the AMI as root using your key identity and check for the appearance of the new drive: <verbatim> zsh% ssh -i MyKeyPair.pem root@ec2-67-202-58-58.compute-1.amazonaws.com [root@domU-12-31-39-03-BE-04 ~]# ls -ltr /dev/[hs]d* brw-r----- 1 root disk 8, 3 2009-01-09 07:48 /dev/sda3 brw-r----- 1 root disk 8, 1 2009-01-09 07:48 /dev/sda1 brw-r----- 1 root disk 8, 2 2009-01-09 07:48 /dev/sda2 brw-r----- 1 root disk 8, 80 2009-01-16 11:50 /dev/sdf </verbatim> 1 Should you wish, you may partition the new block-storage device at this point using <code>fdisk</code> or <code>cfdisk</code> or similar. Here we create an ext3 filesystem using the whole device: <verbatim> [root@domU-12-31-39-03-BE-04 ~]# mkfs.ext3 -F /dev/sdf mke2fs 1.40.8 (13-Mar-2008) Warning: 256-byte inodes not usable on older systems Filesystem label= OS type: Linux Block size=4096 (log=2) Fragment size=4096 (log=2) 65536 inodes, 262144 blocks 13107 blocks (5.00%) reserved for the super user First data block=0 Maximum filesystem blocks=268435456 8 block groups 32768 blocks per group, 32768 fragments per group 8192 inodes per group Superblock backups stored on blocks: 32768, 98304, 163840, 229376 Writing inode tables: done Creating journal (8192 blocks): done Writing superblocks and filesystem accounting information: done This filesystem will be automatically checked every 20 mounts or 180 days, whichever comes first. Use tune2fs -c or -i to override. </verbatim> 1 For you to work with the new filesystem, the system has to "mount" it. * This can be done manually with the <code>mount</code> command, here becoming visible as the directory <code>/opt/virtuoso/data-store/</code>: <verbatim> [root@domU-12-31-39-03-BE-04 ~]# mount -t ext3 /dev/sdf /opt/virtuoso/data-store </verbatim> * You can also add a line in <code>/etc/fstab</code>, to make the filesystem come up and be automatically mounted when you reboot or restart the AMI. As above, we are using the directory <code>/opt/virtuoso/data-store/</code> as the mount point: <verbatim> [root@domU-12-31-39-03-BE-04 ~]# cat /etc/fstab /dev/sda1 / ext3 defaults 1 1 /dev/sda2 /mnt ext3 defaults 1 1 /dev/sda3 swap swap defaults 0 0 /dev/sdf /opt/virtuoso/data-store ext3 defaults,noatime 0 0 [root@domU-12-31-39-03-BE-04 ~]# mount </verbatim> 1 To migrate the Virtuoso database directory across to this new EBS volume, first, stop the running Virtuoso instance: <verbatim> [root@domU-12-31-39-03-BE-04 ~]# cd /opt/virtuoso/ [root@domU-12-31-39-03-BE-04 virtuoso]# . ./virtuoso-environment.sh [root@domU-12-31-39-03-BE-04 virtuoso]# virtuoso-stop.sh Shutting down Virtuoso instance in [database] </verbatim> 1 The Virtuoso installation is based on the Personal Edition layout so the <code>virtuoso-start.sh</code> and <code>virtuoso-stop.sh</code> commands work on all subdirectories containing an ini-file by default. 1 Now that the <code>data-store/</code> directory is mounted, copy the database files across: <verbatim> [root@domU-12-31-39-03-BE-04 virtuoso]# cp -v database/* data-store/ 'database/php.ini' -> 'data-store/php.ini' 'database/virtuoso' -> 'data-store/virtuoso' 'database/virtuoso.db' -> 'data-store/virtuoso.db' 'database/virtuoso.ini' -> 'data-store/virtuoso.ini' 'database/virtuoso.log' -> 'data-store/virtuoso.log' 'database/virtuoso.pxa' -> 'data-store/virtuoso.pxa' 'database/virtuoso-temp.db' -> 'data-store/virtuoso-temp.db' 'database/virtuoso.trx' -> 'data-store/virtuoso.trx' [root@domU-12-31-39-03-BE-04 virtuoso]# </verbatim> 1 Then restart Virtuoso using the <code>data-store</code> directory: <verbatim> [root@domU-12-31-39-03-BE-04 virtuoso]# virtuoso-start.sh data-store/ Starting Virtuoso instance in [data-store/] </verbatim> 1 You can tail the server log file to watch its progress: <verbatim> [root@domU-12-31-39-03-BE-04 virtuoso]# tail -f data-store/virtuoso.log 12:00:51 Issued by OpenLink Software 12:00:51 This license will expire on Fri Jan 1 00:00:00 2010 GMT 12:00:51 Database version 3016 12:00:51 SQL Optimizer enabled (max 1000 layouts) 12:00:53 Compiler unit is timed at 0.001264 msec 12:00:55 Roll forward started 12:00:55 Roll forward complete 12:00:56 Checkpoint made, log reused 12:00:56 HTTP/WebDAV server online at 80 12:00:56 Server online at 1111 (pid 14099) </verbatim> 1 The Virtuoso EC2 AMI instance is now ready for use, and accessible at <code>http://your-ec2-instance-cname/</code>. ---++++ Striping If your database instance is very large and/or you have a large number of concurrent users causing access to random parts of the database simultaneously, it makes sense to distribute the storage across files on two or more devices using [[http://docs.openlinksw.com/virtuoso/dbadm.html#ini_Striping][striping]]. 1 Follow through the above, to create as many EBS storage volumes as you need, and create a filesystem and mount each of them somewhere under <code>/opt/virtuoso/</code>. 1 From your <code>ssh</code> login session, modify the <code>database/virtuoso.ini</code> file. First, in the <code>[Database]</code> section, enable <code>Striping</code> overall: <verbatim> [Database] ... Striping = 1 MaxCheckpointRemap = 2000000 </verbatim> 1 Then, towards the bottom of the file, enter the files to use on EBS devices in the <code>[Striping]</code> section: <verbatim> [Striping] ... Segment1 = 60000, /opt/virtuoso/data-space1>/virt-seg1.db = q1, /opt/virtuoso/data-space2>/virt-seg1-str2.db = q2, /opt/virtuoso/data-space3>/virt-seg1-str3.db = q3 </verbatim> 1 Each database segment file is assigned a separate background IO thread (the <b><code>=q</code></b> clause). *Note:* All files on the same physical device should have the same <code>q</code> value; i.e., multiple stripes on a single EBS volume should have the same <code>q</code> value. Further information on [[http://docs.openlinksw.com/virtuoso/ptune.html#IOQS][tuning Virtuoso]] is available in our documentation. ---+++ Creating a Database Snapshot It is often helpful to be able to preserve the state of a filesystem at a point in time, either in order to restore to it later or to run a backup or similar. With the Amazon AWS Management Console, creating a new snapshot is a matter of two clicks. 1 Start at the console's *Volumes* view: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-9-volumes-create-snapshot.png" />%BR%%BR% 1 Click on *create snapshot* and select the volume of which you wish to make a copy: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-11-create-from-snapshots-tab.png" />%BR%%BR% 1 After a short delay, the Volumes view will show the snapshot completed: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-12-got-snapshot.png" />%BR%%BR% 1 If required, the snapshot permissions can be changed from the default of *private* to public by right clicking on the snapshot and selecting the *public* radio button option, enabling it to then be accessed by the public. 1 You restore a snapshot by using it as a source from which to create a new volume: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-13-create-volume-from-snapshot.png" />%BR%%BR% 1 Continue attaching it to an existing AMI instance as previously: %BR%%BR%<img src="%ATTACHURLPATH%/ebs-15-attach-restored-snapshot-volume.png" />%BR%%BR% ---++ Related * [[VirtEBSBackedBYOLAMI][EBS-backed BYOL ("Bring Your Own License") Virtuoso EC2 AMI]]
sioc:id
72be235b16906e1cc696247c2a0674e5
sioc:link
n2:VirtEC2AMIElasticBlockStorageConfig
sioc:has_container
n4:VOS
n7:has_services
n6:item
atom:title
VirtEC2AMIElasticBlockStorageConfig
sioc:links_to
n2:VirtEC2AMIBio2rdfInstall n23:ini_Striping n31:IOQS n34: n36:code n2:OpenLink
atom:source
n4:VOS
atom:author
n14:this
atom:published
2017-06-13T05:37:58Z
atom:updated
2017-06-29T07:37:01Z
sioc:topic
n4:VOS
Subject Item
n2:VirtInstallationEC2
sioc:links_to
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n2:VirtDBpediaSnapshotPagoAmi
sioc:links_to
n2:VirtEC2AMIElasticBlockStorageConfig
Subject Item
n2:VirtPayAsYouGoEBSBackedAMIDBpedia2015
sioc:links_to
n2:VirtEC2AMIElasticBlockStorageConfig