| content
| - %META:TOPICPARENT{name="VirtInstallationEC2"}%
---+ Virtuoso DBpedia 2016-04 Live Edition Pay As You Go (PAGO) EBS-backed EC2 AMI
%TOC%
---++Introduction
In addition to the [[VirtInstallationEC2][Instance-backed EC2 AMI]] that has been in existence since 2008, Virtuoso is now also available as an EBS-backed EC2 AMI based on either a BYOL (Bring You Own License) or a PAGO (Pay As You Go) License Model. With either License Model, you will end up with a preconfigured Virtuoso instance. The fundamental benefits provided by this type of AMI include:
* Virtuoso DBMS Server is preinstalled with basic tuning for the host operating system.
* DBpedia 2016-04 Database is preloaded and pre-configured.
* You can start and stop the DBpedia instance without having to terminate its host AMI.
* With the hourly model, you pay only for the time the AMI is used.
---++ Prerequisites
* An [[https://aws-portal.amazon.com/gp/aws/developer/registration/index.html/103-7399647-0537426?][Amazon Web Services]] (AWS) account.
* Recently created AWS accounts will have been automatically signed up for the [[http://www.amazon.com/b/ref=sc_fe_l_2?ie=UTF8&node=201590011&no=3435361&me=A36L942TSJ2AJA][Amazon S3 and EC2 Web Service]]. If you created your AWS account a long time ago, you may now need to manually sign up for these services.
* Ensure an AWS
security group allowing access to ports 22 (SSH) and 80 (HTTP) is used.
---++ Instantiating Virtuoso DBpedia 2016-04 Live Edition PAGO Enterprise Edition via Web Interface
1 Locate the [[https://aws.amazon.com/marketplace/pp/B012DSCFEK][Virtuoso DBpedia 2016-04 Live Edition]] PAGO image in AWS Marketplace and click the Continue button.
%BR%%BR% %BR%%BR%
1 Choose a suitable size EC2 Instance Type and Key Pair, then click on the button Launch with 1-click button.
%BR%%BR% %BR%%BR%
1 A confirmation dialog will be presented indicating the image has been deployed.
%BR%%BR% %BR%%BR%
1 Check the in the [[https://console.aws.amazon.com/][AWS Console]] EC2 images Web Interface that the image has been successfully instantiated.
%BR%%BR% %BR%%BR%
---++ First-time Setup & Usage Notes
These steps are only necessary when you start the DBpedia DB for the first time, immediately after instantiating the AMI.
This section may be ignored thereafter, as it is not necessary after AMI reboots.
1 ssh into your instantiated AMI using:
ssh -i {secure-pem-file} ec2-user@{ec2-dns-name-or-ip-address}
1 Start the Virtuoso DBMS Server against the DBpedia Database by issuing the command:
sudo /etc/rc.d/init.d/virtuoso restart
%BR%%BR%
Note: It takes the Virtuoso DBMS Server approximately 20 minutes to bring the DBpedia database online, due to its size.
%BR%%BR%
1 Once online, your DBpedia instance will be ready for use from
%BR%%BR%
* Basic Linked Data Exploration Page
http://{amazon-ec2-ami-dns-name-or-ip-address}/resource/DBpedia
* Advanced Faceted Browsing Page
http://{amazon-ec2-ami-dns-name-or-ip-address}/describe/?uri=http://dbpedia.org/resource/DBpedia
* Faceted Browsing Endpoint
http://{amazon-ec2-ami-dns-name-or-ip-address}/fct
* SPARQL Query Service Endpoint
http://{amazon-ec2-ami-dns-name-or-ip-address}/sparql
* Virtuoso Instance Admin Page (Conductor)
http://{amazon-ec2-ami-dns-name-or-ip-address}/conductor
%BR%%BR%
1 We strongly recommend you now use the Conductor to change the password for the 'dba' user from the the AMI instance-id.
%BR%%BR%
1 Retrieve the AMI instance-id from the AMI properties presented by the Amazon AWS console UI, or by executing the following in the Linux shell:
curl http://169.254.169.254/latest/meta-data/instance-id
1 Load the Conductor interface
http://{amazon-ec2-ami-dns-name-or-ip-address}/conductor
1 At the authentication challenge, log in as the dba user, with the AMI instance-id as the password.
1 Drill down to System Admin -> User Accounts.
1 Locate the dba user, and click the associated Edit link.
1 The form allows many things to be changed. For now, just input your desired password into both Password and Confirm Password boxes, and click the Save button.
1 You can now perform other administrative tasks through the Conductor interface, or return to basic DBpedia use.
Note: If unable to connect to the Virtuoso server using the instance-id as password, please contact technical.support@openlinksw.com for assistance.
---++ DBpedia 2016-04 Live Edition Database Interaction via Web Interface
* An obvious starting point for DBpedia database access is
http://{amazon-ec2-ami-dns-name-or-ip-address}/resource/DBpedia
* To administer the Virtuoso DBMS Server, go to
http://{amazon-ec2-ami-dns-name-or-ip-address}/conductor
---++ Administering Virtuoso Instance via SSH
All scripts for starting and stopping the Virtuoso instance are found in the following locations --
* /etc/rc.d/init.d -- scripts that enable automatic database server instantiation at operating system (AMI) boot or reboot time
%BR%%BR%
* /opt/virtuoso -- scripts for starting and stopping the database server within a running operating system (AMI)
---+++OpenLink License Manager
* Start the License Manager:
/etc/rc.d/init.d/oplmgr start
* Stop the License Manager
/etc/rc.d/init.d/oplmgr stop
* Restart the License Manager
/etc/rc.d/init.d/oplmgr restart
---+++Virtuoso Server
* Start the Virtuoso Server:
/etc/rc.d/init.d/virtuoso start
* Stop the Virtuoso Server:
/etc/rc.d/init.d/virtuoso stop
* Restart the Virtuoso Server:
/etc/rc.d/init.d/virtuoso restart
---++Virtuoso Database Instance Interaction
1 Set the Virtuoso environment variables by running the command
. /opt/virtuoso/virtuoso-enterprise.sh
1 Run the Virtuoso "isql" command line tool to connect to the database. Note: your EC2 AMI's instance-id will be the dba user's password, until you change it (as recommended above).
$ isql 1111 -U dba -P {Password}
Connected to OpenLink Virtuoso
Driver: 07.10.3214 OpenLink Virtuoso ODBC Driver
OpenLink Interactive SQL (Virtuoso), version 0.9849b.
Type HELP; for help and EXIT; to exit.
SQL>
1 Run the "tables" command to obtain a list of tables in the default schema
SQL> tables;
Showing SQLTables of tables like 'NULL.NULL.NULL', tabletype/colname like 'NULL'
TABLE_QUALIFIER TABLE_OWNER TABLE_NAME TABLE_TYPE REMARKS
VARCHAR VARCHAR VARCHAR VARCHAR VARCHAR
_______________________________________________________________________________
DB DBA ADMIN_SESSION SYSTEM TABLE NULL
DB DBA ADM_OPT_ARRAY_TO_RS_PVIEW SYSTEM TABLE NULL
DB DBA ADM_XML_VIEWS SYSTEM TABLE NULL
.
.
.
DB DBA SYS_SQL_INVERSE SYSTEM TABLE NULL
DB DBA SYS_TRIGGERS SYSTEM TABLE NULL
DB DBA SYS_VIEWS SYSTEM TABLE NULL
209 Rows. -- 1890 msec.
SQL>
1 You can stop the Virtuoso Database Server by running:
virtuoso-stop.sh dbpedia
1 You can restart the Virtuoso Database Server by running:
virtuoso-start.sh dbpedia
---++ Enable DBpedia Live Updates
The DBpedia Integrator utility program is provided, that downloads changesets from the DBpedia live website and processes them into the local virtuoso instance on this AMI to keep the DBpedia datasets updated with live Wikipedia updates.
To enable the DBpedia Live updates:
1 Goto the /dbpedia/dbpintegrator directory.
-bash-4.2$ cd /dbpedia/dbpintegrator
1 Run the command sudo sh update_ontology.sh once to check the setup and attempt to update the
database with the latests ontology fixes.
-bash-4.2$ sudo sh update_ontology.sh
-bash-4.2$
1 Run the command sudo sh update_changesets.sh to enable the DBpedia Live updates i.e. start loading the various change sets available.
-bash-4.2$ sudo sh update_changesets.sh
nohup: appending output to ?nohup.out?
-bash-4.2$
1 A web page for viewing the live updates to the AMI instance is available at http://{amazon-ec2-ami-dns-name-or-ip-address}/live where the updates can be viewed as they occur.
%BR%%BR% %BR%%BR%
*Note*: It may take a number of hours or days, depending on server resources and bandwidth, for all the change sets to be loaded and the DBpedia instance upto date and obtaining realtime updates from Wikipedia. Monitor the live update web page Latest changes and Top 20 Most Recently Updated Entities sections to see the current state of the live update process.
*Note*: When steps 2 & 3 are run the first time they will setup the password for connecting to Virtuoso that is derived from instance-id. Thus, if the password has been changed, this script needs to be updated with the same password.
If anything goes wrong it will logged in the associate log file dbpedia_ddbms_eerrors.log otherwise update progress is written to dbp.log .
---+++Setting up CRON job
The Linux CRON utility can be used to automatically (re)start the scripts by adding a few lines to the cron setup for the root user:
# crontab -e
Which starts the CRON editor, add the following lines to the bottom of the file:
@hourly /dbpedia/dbpintegrator/update_changesets.sh
@daily /dbpedia/dbpintegrator/update_ontology.sh
and save the resulting file.
---++ Performance Notes
In regards to performance, please be aware of the following:
* We currently bundle a 10 Database Sessions and 4 CPU Affinity license with this AMI -- Database & CPU Affinity upgrade licenses are available as upgrade options.
* There are a range of AMI choices, offering various combinations of system memory and CPU cores.
Collectively, the factors above affect the performance of your DBpedia instance. For best performance, use EC2 Instance Types with more memory and CPU cores.
Note: By default, this AMI is configured to run on an m3.large EC2 Instance Type. If a larger EC2 Instance Type is chosen, then the NumberOfBuffer and MaxDirtyBuffers parameters in the /opt/virtuoso/dbpedia/dbpedia.ini configuration file should be increased to correspond to the chosen Instance Type's available memory, as detailed in the [[http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFPerformanceTuning#General%20Memory%20Usage%20Settings][Virtuoso Performance Tuning Guide]]:
%BR%%BR%
| *EC2 Instance Type* | *System RAM* | *NumberOfBuffers* | *MaxDirtyBuffers* |
| m3.large | 7 GB | 680000 | 500000 |
| r3.large | 15 GB | 1360000 | 1000000 |
| r3.xlarge | 30.5 GB | 2720000 | 2000000 |
| r3.2xlarge | 61 GB | 5450000 | 4000000 |
After changing these settings, restart the Virtuoso server [[#Virtuoso%20Server][as described above]].
---++ Troubleshooting
If you encounter any problems resolving the sample DBpedia URIs listed in the steps above, please:
1. Determine whether Virtuoso is running, with this command
ps -ef | grep "virt*" | grep -v grep
2. Check the log of Virtuoso's most recent activity, with this command
tail /dbpedia/*.log
Output of those commands will show whether Virtuoso DBpedia DB setup (which can take a while due to DB size) is still in progress, or setup has completed but Virtuoso awaits one of the following:
* Startup command
/etc/init.d/virtuoso start
* Restart command
/etc/init.d/virtuoso restart
---++ Related Items
* [[http://ods.openlinksw.com/wiki/ODS/ODSInstallationEC2][OpenLink Data Spaces Installation]]
* EC2 & AMI related information
* [[VirtPayAsYouGoEBSBackedAMI][Virtuoso Pay As You Go (PAGO) EBS-backed EC2 AMI]]
* [[VirtInstallationEC2][Instance-backed Virtuoso EC2 AMI]]
* [[VirtAWSPublicDataSets][Pre-configured & Pre-loaded Virtuoso instances (DBpedia 3.8, BBC Music & Programmes, etc.)]]
* [[VirtEC2AMINeuroCommonsInstall][Creating Your Own Neurocommons Instance]]
* [[VirtEC2AMIBio2rdfInstall][Creating Your Own Bio2RDF Instance]]
* [[VirtEC2AMIMusicBrainzInstall][Creating Your Own MusicBrainz Instance]]
* [[VirtEc2ExtensionUI][Backup your Virtuoso EC2 AMI to S3]]
* [[VirtEC2AMIElasticBlockStorageConfig][Configure your Virtuoso EC2 AMI for use with Amazon Elastic Block Storage (EBS)]]
* [[http://calculator.s3.amazonaws.com/calc5.html][Amazon-provided AWS Simple Monthly Cost Calculator]]
* Protecting your Virtuoso-hosted SPARQL Endpoint
* [[VirtSPARQLEndpointProtection][Safeguarding your Virtuoso-hosted SPARQL Endpoint]]
* [[VirtTipsAndTricksGuideSPARQLEndpointProtection][SPARQL Endpoint Protection Methods Collection]]
* [[VirtTipsAndTricksGuideSPARQLEndpoints][Securing SPARQL endpoints]]
* [[VirtSPARQLSecurityWebID][WebID Protocol & SPARQL Endpoint ACLs Tutorial]]
* [[VirtOAuthSPARQL][SPARQL OAuth Tutorial]]
* [[http://docs.openlinksw.com/virtuoso/][Virtuoso documentation]]
* [[http://docs.openlinksw.com/virtuoso/rdfsparql.html][Virtuoso's SPARQL support]]
* [[VirtTipsAndTricksGuide][Virtuoso Tips and Tricks]]
* [[VirtSPARQLDET][SPARQL Endpoint DET (DEV Extension Type) Configuration Guide]]
CategoryHowTo CategoryODS CategoryVirtuoso CategoryDocumentation CategoryEC2
%VOSCOPY% - %META:TOPICPARENT{name="VirtInstallationEC2"}%
---+ DBpedia Live (Virtuoso PAGO) EBS-backed EC2 AMI
%TOC%
---++ Introduction
In addition to the [[VirtInstallationEC2][Instance-backed EC2 AMI]] that has been available since 2008, a standard unpopulated Virtuoso instance is available as an EBS-backed EC2 AMI based on either a [[https://aws.amazon.com/marketplace/pp/B00ZWMSNOG][BYOL (Bring Your Own License)]] or a [[https://aws.amazon.com/marketplace/pp/B011VMCZ8K/][PAGO (Pay As You Go)]] basis. In each case, the AMI delivers a preconfigured Virtuoso instance.
We also now offer two PAGO variants, each pre-loaded with a DBpedia dataset.
* The DBpedia Snapshot (Virtuoso PAGO) (documented on this page) starts as a static instance, preloaded with the DBpedia 2021-09 dataset, mirroring the public [[http://wiki.dbpedia.org/OnlineAccess][DBpedia]] instance found at [[http://dbpdia.org/sparql][OpenLink Virtuoso SPARQL Query Editor]]. You can make changes to this data, but it will not track changes made to Wikipedia nor DBpedia-Live.
* The [[https://aws.amazon.com/marketplace/pp/B012DSCFEK][DBpedia Live (Virtuoso PAGO)]] (documented on this page) starts as a static instance, preloaded with the DBpedia 2016-04 dataset, and includes an optional switch that enables data updates based on the Wikipedia firehose, effectively giving you a mirror of the public [[http://wiki.dbpedia.org/online-access/DBpediaLive][DBpedia-Live]] instance found at [[http://live.dbpedia.org/sparql][http://live.dbpedia.org/sparql]].
%BR%%BR%
This type of AMI provides several fundamental benefits including —
* Virtuoso DBMS Server is preinstalled with basic tuning for the host operating system. (That said, since we support many AMI machine types/sizes, you should still [[#Performance%20Notes][tune the configuration to suit the available RAM in your instance]].)
* DBpedia Dataset is preloaded and preconfigured (and may be configurable to auto-update).
* You can start and stop the DBpedia instance without having to terminate its host AMI.
* With the hourly model, you pay only for the time the AMI is used.
---++ Prerequisites
* An [[https://aws-portal.amazon.com/gp/aws/developer/registration/index.html/103-7399647-0537426?][Amazon Web Services]] (AWS) account.
* Recently created AWS accounts will have been automatically signed up for the [[http://www.amazon.com/b/ref=sc_fe_l_2?ie=UTF8&node=201590011&no=3435361&me=A36L942TSJ2AJA][Amazon S3 and EC2 Web Service]]. If you created your AWS account a long time ago, you may now need to manually sign up for these services.
* Ensure an AWS
security group allowing access to ports 22 (standard SSH), 80 (standard HTTP), and 8890 (Virtuoso HTTP-based Admin) is used. (This is the setup of the AMI offerings.)
---++ Instantiating DBpedia Live (Virtuoso PAGO) via Web Interface
1 Locate the [[https://aws.amazon.com/marketplace/pp/prodview-zzfalrw6etzhq][DBpedia Snapshot (Virtuoso PAGO)]] image in AWS Marketplace and click the Continue to Subscribe button.
%BR%%BR% %BR%%BR%
1 Click on the Accept Terms button.
%BR%%BR% %BR%%BR%
1 Click on the Continue to Configuration button.
%BR%%BR% %BR%%BR%
1 Select the Region to where the AMI should be deployed and click on the Continue to Launch button.
%BR%%BR% %BR%%BR%
1 Select the EC2 Instance Type, Security Group Settings, Key Pair Settings the AMI should be started with and click on the Launch button.
%BR%%BR%
%BR%
%BR% %BR%%BR%
1 The deployment is now complete. Click on the EC2 Console link to view the launched instance in the AWS EC2 console
%BR%%BR% %BR%%BR%
1 From the EC2 Console not the Public IP address of the instance for accessing it via ssh, http etc
%BR%%BR% %BR%%BR%
---++ First-time Setup & Usage Notes
These steps in this section are only necessary the first time you start the Virtuoso instances on the AMI. This section may be ignored thereafter, as it is not necessary after AMI reboots.
There are two Virtuoso instances in this AMI. One which comes up quickly, with no significant content, so you know the AMI is basically functional; and one which comes up more slowly, with the full DBpedia dataset, which takes significant time to start due to some Amazon requirements for such AWS instances.
1 ssh into your instantiated AMI using:
ssh -i {secure-pem-file} ubuntu@{ec2-dns-name-or-ip-address}
1 The Virtuoso DBMS Server for the Basic Instance will have started with the AMI. You can verify this with ?
ps -ef | grep "virt*" | grep -v grep
1 If you do not see a running instance, execute the following command, and then repeat the command above.
sudo service virtuoso status
sudo service virtuoso start
sudo service virtuoso status
1 We strongly recommend you now use the Conductor to change the password for the 'dba' user from the the AMI instance-id.
%BR%%BR%
1 Retrieve the AMI instance-id by either --
* checking the AMI properties presented by the Amazon AWS console UI --
%BR%%BR%%BR%%BR%
* executing the following command in the Linux shell --
curl http://169.254.169.254/latest/meta-data/instance-id
1 Load the Conductor interface
http://{amazon-ec2-ami-dns-name-or-ip-address}/conductor
1 At the authentication challenge, log in as the dba user, with the AMI instance-id as the password. Note: If unable to connect to the Virtuoso server using the instance-id as password, please [[https://shop.openlinksw.com/support_system/customers/][create a Support Case]] for fastest assistance.
1 Drill down to System Admin → User Accounts.
1 Locate the dba user, and click the associated Edit link.
1 The form allows many things to be changed. For now, just input your desired password into both Password and Confirm Password boxes, and click the Save button.
1 You can now perform other administrative tasks through the Conductor interface, or return to basic DBpedia use.
---++ DBpedia Snapshot (Virtuoso PAGO) Database Interaction via Web Interface
Once online, your DBpedia Live instance will be ready for use from —
%BR%%BR%
* Basic Linked Data Exploration Page — an obvious starting point
http://{amazon-ec2-ami-dns-name-or-ip-address}/resource/DBpedia
* Faceted Browsing Endpoint
http://{amazon-ec2-ami-dns-name-or-ip-address}/fct
* Advanced Faceted Browsing Page
http://{amazon-ec2-ami-dns-name-or-ip-address}/describe/?uri=http://dbpedia.org/resource/DBpedia
* SPARQL Query Service Endpoint
http://{amazon-ec2-ami-dns-name-or-ip-address}/sparql
* Virtuoso Instance Administration Page (Virtuoso Conductor)
http://{amazon-ec2-ami-dns-name-or-ip-address}/conductor
---++ Administering the Virtuoso Instance via SSH
1 Make a ssh connection to the VM using the public key ( pem-file ) and username ( ubuntu by default) chosen when creating the deployment, and the Public IP address from the previous section as follows:
ssh -i {pem-file} ubuntu@{Public IP address}
1 Once connected it is strongly recommended to update the VM to get the latest operating system and Virtuoso updates with the command:
sudo apt-get upgrade
1 Check the Virtuoso server is automatically started post deployment with the command:
sudo service virtuoso status
1 The following commands can be used to Administer the Virtuoso server:
1 Start the Virtuoso Server:
sudo service virtuoso start
1 Stop the Virtuoso Server:
sudo service virtuoso stop
1 Restart the Virtuoso Server:
sudo service virtuoso restart
1 Check status of Virtuoso Server:
sudo service virtuoso status
1 Determine the random password set for the dba user with the command:
sudo cat /opt/virtuoso/database/.initial-password
1 A SQL connection can then be made Virtuoso with the isql command line tool with the command on port 1111 :
isql 1111
Typical output for running these steps are:
$ ssh -i certificates/virtuoso.pem ubuntu@54.221.25.206
The authenticity of host '54.221.25.206 (54.221.25.206)' can't be established.
ECDSA key fingerprint is SHA256:QGsOFcQoa4x5DBavtdHWDQUUQtBdHJ/OkizKep8UOcM.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '54.221.25.206' (ECDSA) to the list of known hosts.
Welcome to Ubuntu 18.04.5 LTS (GNU/Linux 5.4.0-1025-aws x86_64)
* Documentation: https://help.ubuntu.com
* Management: https://landscape.canonical.com
* Support: https://ubuntu.com/advantage
System information as of Fri Jan 29 12:41:03 UTC 2021
System load: 0.0 Processes: 104
Usage of /: 2.0% of 116.27GB Users logged in: 0
Memory usage: 4% IP address for eth0: 10.0.0.214
Swap usage: 0%
* Canonical Livepatch is available for installation.
- Reduce system reboots and improve kernel security. Activate at:
https://ubuntu.com/livepatch
9 packages can be updated.
0 updates are security updates.
Last login: Tue Sep 22 19:26:19 2020 from 108.26.205.225
ubuntu@ip-10-0-0-214:~$ cd /opt/virtuoso/database
ubuntu@ip-10-0-0-214:/opt/virtuoso/database$ sudo bash
root@ip-10-0-0-214:/opt/virtuoso/database# cat .initial-password
i-0343ad51fe5e4f196
root@ip-10-0-0-214:/opt/virtuoso/database# service virtuoso status
? virtuoso.service - OpenLink Virtuoso Database
Loaded: loaded (/lib/systemd/system/virtuoso.service; enabled; vendor preset: enabled)
Active: active (running) since Fri 2021-01-29 12:04:31 UTC; 38min ago
Process: 878 ExecStart=/opt/virtuoso/bin/virtuoso-start.sh $VIRTUOSO_DB_NAMES (code=exited, status=0/SUC
Main PID: 1170 (virtuoso)
Tasks: 15 (limit: 4915)
CGroup: /system.slice/virtuoso.service
??1170 ./virtuoso
Jan 29 12:04:25 ip-10-0-0-214 systemd[1]: Starting OpenLink Virtuoso Database...
Jan 29 12:04:26 ip-10-0-0-214 virtuoso-start.sh[878]: Starting Virtuoso instance in [database]
Jan 29 12:04:26 ip-10-0-0-214 virtuoso-start.sh[878]: - Starting the database
Jan 29 12:04:31 ip-10-0-0-214 systemd[1]: Started OpenLink Virtuoso Database.
root@ip-10-0-0-214:/opt/virtuoso/database# /opt/virtuoso/bin/isql 1111
OpenLink Virtuoso Interactive SQL (Virtuoso)
Version 08.03.3319 as of Sep 1 2020
Type HELP; for help and EXIT; to exit.
Enter password for dba :
Connected to OpenLink Virtuoso
Driver: 08.03.3319 OpenLink Virtuoso ODBC Driver
SQL> status('');
REPORT
VARCHAR
_______________________________________________________________________________
OpenLink Virtuoso VDB Server
Version 08.03.3319-pthreads for Linux as of Sep 1 2020
Started on: 2021-01-29 12:45 GMT+0
CPU: 0.05% RSS: 148MB PF: 0
Database Status:
File size 67108864, 8192 pages, 5733 free.
20000 buffers, 1115 used, 85 dirty 0 wired down, repl age 0 0 w. io 0 w/crsr.
Disk Usage: 1074 reads avg 0 msec, 0% r 0% w last 23 s, 138 writes flush 0 MB/s,
34 read ahead, batch = 17. Autocompact 0 in 0 out, 0% saved.
Gate: 166 2nd in reads, 0 gate write waits, 0 in while read 0 busy scrap.
Log = virtuoso.trx, 8325 bytes
VDB: 0 exec 0 fetch 0 transact 0 error
2309 pages have been changed since last backup (in checkpoint state)
Current backup timestamp: 0x0000-0x00-0x00
Last backup date: unknown
Clients: 1 connects, max 1 concurrent
RPC: 6 calls, 1 pending, 1 max until now, 0 queued, 0 burst reads (0%), 0 second 0M large, 10M max
Checkpoint Remap 38 pages, 0 mapped back. 0 s atomic time.
DB master 8192 total 5733 free 38 remap 1 mapped back
temp 256 total 251 free
Lock Status: 0 deadlocks of which 0 2r1w, 0 waits,
Currently 1 threads running 0 threads waiting 0 threads in vdb.
24 Rows. -- 2 msec.
SQL>
---++ Performance Notes
Please be aware of the following, which impact the performance and utility of your AMI:
* This AMI includes a bundled Virtuoso license which enables 10 Database Sessions and the use of 4 logical processors. Licenses that upgrade these attributes are available as paid upgrade options.
%BR%%BR%
* Virtuoso always takes full advantage of the memory it's configured to use. This may be much less than is found in its host environment/AMI. This AMI is pre-configured for an m5.xlarge EC2 Instance Type, so will use 16GB or RAM. If you choose a larger EC2 Instance Type, then the NumberOfBuffer and MaxDirtyBuffers parameters in the /opt/virtuoso/database/virtuoso.ini configuration file should be increased to correspond to the chosen Instance Type's available memory, as detailed in the [[http://virtuoso.openlinksw.com/dataspace/doc/dav/wiki/Main/VirtRDFPerformanceTuning#General%20Memory%20Usage%20Settings][Virtuoso Performance Tuning Guide]]. A few examples are shown below. After changing these or any other settings in the INI file, restart the Virtuoso server [[#Virtuoso%20Server][as described above]].
%BR%%BR%
| *EC2 Instance Type* | *System RAM* | *NumberOfBuffers* | *MaxDirtyBuffers* |
| m5.xlarge | 16 GB | 1360000 | 1000000 |
| m5.2xlarge | 32 GB | 2720000 | 2000000 |
| m5.4xlarge | 64 GB | 5440000 | 4000000 |
| m5.8xlarge | 128 GB | 10880000 | 8000000 |
%BR%%BR%
* There are a wide range of AMI choices, offering various combinations of system memory and logical processors. To improve performance, use an EC2 Instance Type with more memory and more logical processors. To make use of additional processors, you will need to also acquire an upgraded Virtuoso license.
---++ Troubleshooting
If the Virtuoso server fails to start:
* Run the command sudo service virtuoso status to see if the Virtuoso server is running
* Check the /opt/virtuoso/database/virtuoso.log file to see why the server might have failed to start
* Ensure the file /opt/virtuoso/database/virtuoso.lck does not exist before starting the server
* Attempt to start the Virtuoso server with the command sudo service virtuoso start
* Run the command sudo service virtuoso status again to see if the Virtuoso server is running
* If it is now running attempt a connect via the SQL or HTTP interfaces as detailed above
---++ Related Items
* [[http://ods.openlinksw.com/wiki/ODS/ODSInstallationEC2][OpenLink Data Spaces Installation]]
* EC2 & AMI related information
* [[VirtPayAsYouGoEBSBackedAMI][Virtuoso Pay As You Go (PAGO) EBS-backed EC2 AMI]]
* [[VirtInstallationEC2][Instance-backed Virtuoso EC2 AMI]]
* [[VirtAWSPublicDataSets][Pre-configured & Pre-loaded Virtuoso instances (DBpedia 3.8, BBC Music & Programmes, etc.)]]
* [[VirtEC2AMINeuroCommonsInstall][Creating Your Own Neurocommons Instance]]
* [[VirtEC2AMIBio2rdfInstall][Creating Your Own Bio2RDF Instance]]
* [[VirtEC2AMIMusicBrainzInstall][Creating Your Own MusicBrainz Instance]]
* [[VirtEc2ExtensionUI][Backup your Virtuoso EC2 AMI to S3]]
* [[VirtEC2AMIElasticBlockStorageConfig][Configure your Virtuoso EC2 AMI for use with Amazon Elastic Block Storage (EBS)]]
* [[http://calculator.s3.amazonaws.com/calc5.html][Amazon-provided AWS Simple Monthly Cost Calculator]]
* Protecting your Virtuoso-hosted SPARQL Endpoint
* [[VirtSPARQLEndpointProtection][Safeguarding your Virtuoso-hosted SPARQL Endpoint]]
* [[VirtTipsAndTricksGuideSPARQLEndpointProtection][SPARQL Endpoint Protection Methods Collection]]
* [[VirtTipsAndTricksGuideSPARQLEndpoints][Securing SPARQL endpoints]]
* [[VirtSPARQLSecurityWebID][WebID Protocol & SPARQL Endpoint ACLs Tutorial]]
* [[VirtOAuthSPARQL][SPARQL OAuth Tutorial]]
* [[http://docs.openlinksw.com/virtuoso/][Virtuoso documentation]]
* [[http://docs.openlinksw.com/virtuoso/rdfsparql.html][Virtuoso's SPARQL support]]
* [[VirtTipsAndTricksGuide][Virtuoso Tips and Tricks]]
* [[VirtSPARQLDET][SPARQL Endpoint DET (DEV Extension Type) Configuration Guide]]
CategoryHowTo CategoryODS CategoryVirtuoso CategoryDocumentation CategoryEC2
%VOSCOPY% |
![[RDF Data]](/fct/images/sw-rdf-blue.png)
![[cxml]](/fct/images/cxml_doc.png)
![[csv]](/fct/images/csv_doc.png)
![[text]](/fct/images/ntriples_doc.png)
![[turtle]](/fct/images/n3turtle_doc.png)
![[ld+json]](/fct/images/jsonld_doc.png)
![[rdf+json]](/fct/images/json_doc.png)
![[rdf+xml]](/fct/images/xml_doc.png)
![[atom+xml]](/fct/images/atom_doc.png)
![[html]](/fct/images/html_doc.png)