%META:TOPICPARENT{name="VirtGraphReplication"}%

---+ Replication Example: 2-node Bi-directional Topology

%TOC%

---++ Introduction

The following Guide demonstrates the Virtuoso RDF Bi-directional Graph Replication, e.g.,
%BR%%BR%<img src="%ATTACHURLPATH%/topo-bidirectional.png" />%BR%%BR%

---++Prerequisites

---+++Database INI Parameters

Suppose there are 2 Virtuoso instances respectively with the following ini parameters values:

   1. virtuoso1.ini:
<verbatim>
...
[Database]
DatabaseFile    = virtuoso1.db
TransactionFile = virtuoso1.trx
ErrorLogFile     = virtuoso1.log
...
[Parameters]
ServerPort               = 1111
SchedulerInterval        = 1
...
[HTTPServer]
ServerPort                  = 8891
...
[URIQA]
DefaultHost = localhost:8891
...
[Replication]
ServerName   = db1
...
</verbatim>
   1. virtuoso2.ini:
<verbatim>
...
[Database]
DatabaseFile    = virtuoso2.db
TransactionFile = virtuoso2.trx
ErrorLogFile     = virtuoso2.log
...
[Parameters]
ServerPort               = 1112
SchedulerInterval        = 1
...
[HTTPServer]
ServerPort                  = 8892
...
[URIQA]
DefaultHost = localhost:8892
...
[Replication]
ServerName   = db2
...
</verbatim>
 

---+++Database DSNs

Use the ODBC Administrator on your Virtuoso host (e.g., on Windows, *Start* menu -> *Control Panel* -> *Administrative Tools* -> <b>Data Sources (ODBC)</b>; on Mac OS X, <code><nowiki>/Applications/Utilities/OpenLink ODBC Administrator.app</nowiki></code>) to create a System DSN for db1 and db2 with names db1 and db2 respectively.

---+++Install Conductor package

On each of the 2 Virtuoso instances install the [[https://virtuoso.openlinksw.com/download/][conductor_dav.vad]] package.


---++Create Publication on db2

   1. Go to http://localhost:8892/conductor and log in as dba
   1. Go to Conductor -> Replication -> Transactional -> Publications
%BR%%BR%<img src="%ATTACHURLPATH%/bd1.png" />%BR%%BR%
   1. Click <b>Enable RDF Publishing</b>
   1 As result publication with the name <b>RDF Publication</b> should be created
%BR%%BR%<img src="%ATTACHURLPATH%/bd2.png" />%BR%%BR%
   1 Click the link which is the publication name. 
   1 You will be shown the publication items page
%BR%%BR%<img src="%ATTACHURLPATH%/bd3.png" />%BR%%BR%
   1 Enter for Graph IRI:
<verbatim>
http://example.org
</verbatim>
%BR%%BR%<img src="%ATTACHURLPATH%/bd4.png" />%BR%%BR%
   1 Click Add New
   1 The item will be created and shown in the list of items for the currently viewed publication. 
%BR%%BR%<img src="%ATTACHURLPATH%/bd5.png" />%BR%%BR%


---++Create subscription from db1 to db2's Publication

   1 Log in at http://localhost:8891/conductor
   1 Go to Replication -> Transactional -> Subscriptions 
%BR%%BR%<img src="%ATTACHURLPATH%/bd6.png" />%BR%%BR%
   1 Click <b>New Subscription</b>
%BR%%BR%<img src="%ATTACHURLPATH%/bd7.png" />%BR%%BR%
   1 From the list of "Specify new data source" select Data Source db2
%BR%%BR%<img src="%ATTACHURLPATH%/bd8.png" />%BR%%BR%
   1 Enter for db2 dba user credentials
%BR%%BR%<img src="%ATTACHURLPATH%/bd9.png" />%BR%%BR%
   1 Click "Add Data Source"
   1 As result <b>db2</b> will be shown in the "Connected Data Sources" list. 
%BR%%BR%<img src="%ATTACHURLPATH%/bd10.png" />%BR%%BR%
   1 Select <b>db2</b> the "Connected Data Sources" list and click "Publications list"
%BR%%BR%<img src="%ATTACHURLPATH%/bd11.png" />%BR%%BR%
   1 As result will be shown the list of available publications for the selected data source. Select the one with name "RDF Publication" and click "List Items".
%BR%%BR%<img src="%ATTACHURLPATH%/bd12.png" />%BR%%BR%
   1 As result will be shown the "Confirm subscription" page. 
%BR%%BR%<img src="%ATTACHURLPATH%/bd13.png" />%BR%%BR%
   1 The sync interval by default is 10 minutes. For the testing purposes, we will change it to 1 minute.
%BR%%BR%<img src="%ATTACHURLPATH%/bd14.png" />%BR%%BR%
   1 Click "Subscribe"
   1 The subscription will be created. 
%BR%%BR%<img src="%ATTACHURLPATH%/bd15.png" />%BR%%BR%

---++Create Publication on db1

   1. Go to http://localhost:8891/conductor and log in as dba
   1. Go to Conductor -> Replication -> Transactional -> Publications
%BR%%BR%<img src="%ATTACHURLPATH%/bd16.png" />%BR%%BR%
   1. Click <b>Enable RDF Publishing</b>
   1 As result publication with the name <b>RDF Publication</b> should be created
%BR%%BR%<img src="%ATTACHURLPATH%/bd17.png" />%BR%%BR%
   1 Click the link which is the publication name. 
   1 You will be shown the publication items page
%BR%%BR%<img src="%ATTACHURLPATH%/bd18.png" />%BR%%BR%
   1 Enter for Graph IRI:
<verbatim>
http://example.org
</verbatim>
%BR%%BR%<img src="%ATTACHURLPATH%/bd19.png" />%BR%%BR%
   1 Click Add New
   1 The item will be created and shown in the list of items for the currently viewed publication. 
%BR%%BR%<img src="%ATTACHURLPATH%/bd20.png" />%BR%%BR%


---++Create subscription from db2 to db1's Publication

   1 Log in at http://localhost:8892/conductor
   1 Go to Replication -> Transactional -> Subscriptions 
%BR%%BR%<img src="%ATTACHURLPATH%/bd21.png" />%BR%%BR%
   1 Click <b>New Subscription</b>
%BR%%BR%<img src="%ATTACHURLPATH%/bd22.png" />%BR%%BR%
   1 From the list of "Specify new data source" select Data Source db1
%BR%%BR%<img src="%ATTACHURLPATH%/bd23.png" />%BR%%BR%
   1 Enter for db1 dba user credentials
%BR%%BR%<img src="%ATTACHURLPATH%/bd24.png" />%BR%%BR%
   1 Click "Add Data Source"
%BR%%BR%<img src="%ATTACHURLPATH%/bd25.png" />%BR%%BR%
   1 As result <b>db1</b> will be shown in the "Connected Data Sources" list. Select it and click "Publications list"
%BR%%BR%<img src="%ATTACHURLPATH%/bd26.png" />%BR%%BR%
   1 As result will be shown the list of available publications for the selected data source. Select the one with name "RDF Publication" and click "List Items".
%BR%%BR%<img src="%ATTACHURLPATH%/bd27.png" />%BR%%BR%
   1 As result will be shown the "Confirm subscription" page.  
%BR%%BR%<img src="%ATTACHURLPATH%/bd28.png" />%BR%%BR%
   1 The sync interval by default is 10 minutes. For the testing purposes, we will change it to 1 minute.
%BR%%BR%<img src="%ATTACHURLPATH%/bd29.png" />%BR%%BR%
   1 Click "Subscribe"
   1 The subscription will be created. 
%BR%%BR%<img src="%ATTACHURLPATH%/bd30.png" />%BR%%BR%


---++Insert Data into a Named Graph on the db2 Virtuoso Instance

   1. Log in at http://localhost:8892/conductor
   1 Go to Linked Data -> Quad Store Upload 
%BR%%BR%<img src="%ATTACHURLPATH%/bd31.png" />%BR%%BR%
   1 In the shown form:
      1 Tick the box for <b>Resource URL</b> and enter your resource URL, e.g.:
<verbatim>
http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com#this
</verbatim>
      1 Enter for Named Graph IRI:
<verbatim>
http://example.org
</verbatim>
%BR%%BR%<img src="%ATTACHURLPATH%/bd32.png" />%BR%%BR%
   1 Click Upload
   1 A successful upload will result in a shown message.
%BR%%BR%<img src="%ATTACHURLPATH%/bd33.png" />%BR%%BR%
   1 Check the count of the inserted triples by executing a query like the following against the SPARQL endpoint, 
http://localhost:8892/sparql:
<verbatim>
SELECT COUNT(*) 
   FROM <http://example.org>
WHERE { ?s ?p ?o }
</verbatim>
%BR%%BR%<img src="%ATTACHURLPATH%/bd34.png" />%BR%%BR%
   1 Should return <b>57</b> as total.
%BR%%BR%<img src="%ATTACHURLPATH%/bd35.png" />%BR%%BR%


---++Check data on the Destination instance db1

   1 To check the starting count, execute from db1's SPARQL Endpoint:
<verbatim>
SELECT COUNT(*) 
   FROM <http://example.org>
WHERE { ?s ?p ?o }
</verbatim>
   1 Should return <b>57</b> as total.
%BR%%BR%<img src="%ATTACHURLPATH%/bd35.png" />%BR%%BR%

---++Add new data on db2

   1 Disconnect db1.
   1 On the Host Virtuoso Instance db2 go to Conductor -> Database -> Interactive SQL enter the following statement:
<verbatim>
SPARQL INSERT INTO GRAPH <http://example.org> 
  { 
     <http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com#this>
     <http://xmlns.com/foaf/0.1/interest>
     <http://dbpedia.org/resource/Web_Services> 
  } ;
</verbatim>
%BR%%BR%<img src="%ATTACHURLPATH%/bd36.png" />%BR%%BR%
   1 Click "Execute"
   1 As result the triples will be inserted
%BR%%BR%<img src="%ATTACHURLPATH%/bd37.png" />%BR%%BR%
   1 Check the count of the destination instance graph's triples by executing the following query like against the SPARQL endpoint, 
http://localhost:8892/sparql:
<verbatim>
SELECT COUNT(*) 
   FROM <http://example.org>
WHERE { ?s ?p ?o }
</verbatim>
   1 Should return <b>58</b> as total.
%BR%%BR%<img src="%ATTACHURLPATH%/bd38.png" />%BR%%BR%

---++Check data on the Destination instance db1
 
   1 Start instance db1
   1 To confirm that the triple count has increased by the number of inserted triples, execute the following statement on db1's SPARQL Endpoint:
<verbatim>
SELECT COUNT(*) 
   FROM <http://example.org>
WHERE { ?s ?p ?o }
</verbatim>
   1 Should return <b>58</b> as total.
%BR%%BR%<img src="%ATTACHURLPATH%/bd38.png" />%BR%%BR%

---++Add new data on db1

   1 Disconnect db2.
   1 On the Host Virtuoso Instance db1 go to Conductor -> Database -> Interactive SQL enter the following statement:
<verbatim>
SPARQL INSERT INTO GRAPH <http://example.org> 
  { 
    <http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com#this>  	
    <http://xmlns.com/foaf/0.1/interest>  	
    <http://dbpedia.org/resource/Web_Clients> 
  } ;
SPARQL INSERT INTO GRAPH <http://example.org> 
  { 
    <http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com#this>  	
    <http://xmlns.com/foaf/0.1/interest>  	
    <http://dbpedia.org/resource/SPARQL> 
  } ;
</verbatim>
%BR%%BR%<img src="%ATTACHURLPATH%/bd39.png" />%BR%%BR%
   1 Click "Execute"
   1 As result the triples will be inserted
%BR%%BR%<img src="%ATTACHURLPATH%/bd40.png" />%BR%%BR%
   1 Check the count of the destination instance graph's triples by executing the following query like against the SPARQL endpoint, 
http://localhost:8891/sparql:
<verbatim>
SELECT COUNT(*) 
   FROM <http://example.org>
WHERE { ?s ?p ?o }
</verbatim>
   1 Should return <b>60</b> as total.
%BR%%BR%<img src="%ATTACHURLPATH%/bd41.png" />%BR%%BR%

---++Check data on the Destination instance db2
 
   1 Start instance db2
   1 To confirm that the triple count has increased by the number of inserted triples, execute the following statement on db2's SPARQL Endpoint:
<verbatim>
SELECT COUNT(*) 
   FROM <http://example.org>
WHERE { ?s ?p ?o }
</verbatim>
   1 Should return <b>60</b> as total.
%BR%%BR%<img src="%ATTACHURLPATH%/bd41.png" />%BR%%BR%

---++Related

   * [[VirtGraphReplicationStar][Replication Example: Star Topology]]
   * [[VirtGraphReplicationChain][Replication Example: Chain Topology]]
   * [[VirtGraphReplicationPSQL][Set up RDF Replication via procedure calls]]   
   * [[http://ods.openlinksw.com/wiki/ODS/VirtPubSubHub][Example of Linked Data Usage of PubSubHubbub Implementation]]
   * [[VirtRdfReplScenarios][Exploit Virtuoso's Replication Functionality Web based Solutions]]