• Topic
  • Discussion
  • VOS.VirtRDFInsert(1.2) -- Owiki? , 2018-04-13 12:07:13 Edit owiki 2018-04-13 12:07:13

    RDF Insert Methods in Virtuoso

    Loading RDF datasets into a Virtuoso Graph IRI

    Loading RDF datasets into one or more Virtuoso Graph IRIs

    Loading RDF datasets using the Conductor "Quad Store Upload" tab menu option

    RDF Sink Folders (Virtuoso or ODS-Briefcase)

    HTTP PUT

    Using this approach we can upload RDF resources into Virtuoso's WebDAV repository and then automatically upload the triples within the resource into the Virtuoso Quad store (if you so choose via Virtuoso's special RDF Sink Folder feature of WebDAV ).

    HTTP PUT Example 1


    <rdf:RDF xmlns="http://www.example/jose/foaf.rdf#"
        xmlns:foaf="http://xmlns.com/foaf/0.1/"
        xmlns:log="http://www.w3.org/2000/10/swap/log#"
        xmlns:myfoaf="http://www.example/jose/foaf.rdf#"
        xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
    
        <foaf:Person rdf:about="http://www.example/jose/foaf.rdf#jose">
            <foaf:homepage rdf:resource="http://www.example/jose/"/>
            <foaf:knows rdf:resource="http://www.example/jose/foaf.rdf#juan"/>
            <foaf:name>Jose Jimen~ez</foaf:name>
            <foaf:nick>Jo</foaf:nick>
            <foaf:workplaceHomepage rdf:resource="http://www.corp.example/"/>
        </foaf:Person>
    
        <foaf:Person rdf:about="http://www.example/jose/foaf.rdf#juan">
            <foaf:mbox rdf:resource="mailto:juan@mail.example"/>
        </foaf:Person>
    
        <foaf:Person rdf:about="http://www.example/jose/foaf.rdf#julia">
            <foaf:mbox rdf:resource="mailto:julia@mail.example"/>
        </foaf:Person>
    
        <rdf:Description rdf:about="http://www.example/jose/foaf.rdf#kendall">
            <foaf:knows rdf:resource="http://www.example/jose/foaf.rdf#edd"/>
        </rdf:Description>
    </rdf:RDF>
    


    File: myfoaf.rdf
    Destination Server: demo.openlinksw.com
    
    curl -T myfoaf.rdf http://demo.openlinksw.com/DAV/home/demo/rdf_sink/myfoaf.rdf -u demo:demo
    <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
    <HTML>
    <HEAD>
      <TITLE>201 Created</TITLE>
    </HEAD>
    <BODY>
      <H1>Created</H1>
      Resource /DAV/home/demo/rdf_sink/ myfoaf.rdf has been created.
    </BODY>
    </HTML>
    

    HTTP PUT Example 2

    1. Create a folder of type "Linked Data Import" for an ODS user with the Briefcase application
      1. Go to http://cname/ods, click the "Sign In" link and login as user "demo" for example;
      2. Click the Briefcase application from the left vertical navigation bar;
      3. Click "New Folder";
      4. In the presented form specify the folder name and type, for example:
        • Folder name: "MyData?";
        • Folder type: "Linked Data Import"



      5. Go to the tab "Linked Data Import";
      6. Specify "Graph name", for example "urn:mydata";
      7. Select the "Sponger (on/off)" check-box option to enable the Virtuoso sponger for use.
        • Optionally you can select which cartridges to be included from the "Sponger Extractor Cartridges" and "Sponger Meta Cartridges" lists:



      8. Click "Create".
    2. As result the new folder will be created.



    3. Assume the existence of a local file called "kidehen.n3" containing:

      <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://www.w3.org/2000/01/rdf-schema#label> "Kingsley" . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://rdfs.org/sioc/ns#creator_of> <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/1300> .

    4. Run the following command from a terminal shell, where cname is replaced with the actual Virtuoso host:port to load the file to the specified location:

      $ curl -T kidehen.n3 http://cname/DAV/home/demo/MyData/ -u demo:demo <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <HTML> <HEAD> <TITLE>201 Created</TITLE> </HEAD> <BODY> <H1>Created</H1>Resource /DAV/home/demo/MyData/kidehen.n3 has been created. </BODY> </HTML>

    5. Go to Briefcase application and view the content of the folder "DAV/home/demo/MyData"
    6. As a result of the curl command to uploaded file "kidehen.n3" an additional file "urn_mydata.RDF" is available as the identifier for the Linked Data graph created in the Quad Store:



    7. The inserted triples can be queried from the Virtuoso SPARQL endpoint, i.e. http://cname/sparql by:
      1. Entering the query below in the "Query Text" window:

        SELECT * FROM <urn:mydata> WHERE { ?s ?p ?o }





      2. Click the "Run Query" button;
      3. The inserted triples from the "kidehen.n3" is displayed as the result set:



    References

    1. HTTP/1.1 PUT
    2. Some Virtuoso PUT Documentation regarding Multipart Forms

    HTTP POST

    Virtuoso's support for HTTP content negotiation and the SPARQL Protocol enables the execution of SPARUL as part of an HTTP POST payload using Content-Type: application/sparql-query.

    HTTP POST Example 1

    1. For user demo from Conductor -> System Admin -> User Accounts -> user demo -> Edit make sure the following properies are set:
      • User type is SQL/ODBC and WebDAV;
      • Accounts Roles contains in "Selected" list SPARQL_UPDATE:



    2. From Conductor -> Web Application Server -> Content Management or ODS Briefcase UI create a DAV collection "xx" with the following properties:
      • owner is user demo (the user's password let's say is "demo");
      • permissions set to rwxrwxrwxn:



    1. Execute the following command:

      curl -i -d "INSERT {<http://demo.openlinksw.com/DAV/home/demo_about.rdf> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User>}" -u "demo:demo" -H "Content-Type: application/sparql-query" http://localhost:8890/DAV/xx/yy

    2. The response should be:

      HTTP/1.1 201 Created Server: Virtuoso/05.00.3023 (Win32) i686-generic-win-32 VDB Connection: Keep-Alive Content-Type: text/html; charset=ISO-8859-1 Date: Fri, 28 Dec 2007 12:50:12 GMT Accept-Ranges: bytes MS-Author-Via: SPARQL Content-Length: 0

    3. the result in the DAV/xx location will be a new WebDAV resource with name "yy" containing the inserted RDF:

      <?xml version="1.0" encoding="utf-8" ?> <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"> <rdf:Description rdf:about="http://demo.openlinksw.com/DAV/home/demo_about.rdf"> <ns0pred:type xmlns:ns0pred="http://www.w3.org/1999/02/22-rdf-syntax-ns#" rdf:resource="http://rdfs.org/sioc/ns#User"/> </rdf:Description> </rdf:RDF>

    HTTP POST Example 2

    1. Create a DAV collection, for ex. with name "test" for user for ex. demo with password demo.
      • Note: user "demo" should have from "User type": SQL/ODBC and WebDAV and should have "SPARQL_UPDATE" role set from Conductor -> System Admin -> User Accounts -> user demo' Edit Properties.
    2. Execute the following command:

      curl -i -d "INSERT IN GRAPH <http://mygraph.com> { <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://www.w3.org/2000/01/rdf-schema#label> <Kingsley Uyi Idehen> . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://rdfs.org/sioc/ns#creator_of> <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/1300> } " -u "demo:demo" -H "Content-Type: application/sparql-query" http://localhost:8890/DAV/home/demo/test/myrq

    3. As result the response will be:

      HTTP/1.1 201 Created Server: Virtuoso/05.00.3023 (Win32) i686-generic-win-32 VDB Connection: Keep-Alive Content-Type: text/html; charset=ISO-8859-1 Date: Thu, 20 Dec 2007 16:25:25 GMT Accept-Ranges: bytes MS-Author-Via: SPARQL Content-Length: 0

    4. Now let's check the inserted triples. Go to the SPARQL endpoint, i.e., http://localhost:8890/sparql and:
      1. Enter for Default Graph URI:

        http://mygraph.com

      2. Enter in the Query area:

        SELECT * WHERE {?s ?p ?o}

      3. Click the button "Run Query"
      4. As result will be shown the inserted triples:

        s p o http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://rdfs.org/sioc/ns#User http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://www.w3.org/2000/01/rdf-schema#label Kingsley http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://rdfs.org/sioc/ns#creator_of http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/1300

    Examples using LOAD feature of SPARUL

    Using the file: protocol specifier

    1. A RDF file can be loaded from an absolute path on the file system (whose location is specified in the DirsAllowed? param in the INI file) using the file:/// protocol specifier:

      SQL> sparql load <file://home/virtuoso/database/data/test.rdf> into <test>; Done. -- 48 msec. SQL> sparql select count(*) from <test> where {?s ?p ?o}; callret-0 INTEGER _______________________________________________________________________________ 31 1 Rows. -- 1 msec. SQL>

    2. A RDF file can also be uploaded directly from the Virtuoso Web Server root(~/vsp) directory using the file:/ protocol specifier:

      SQL> sparql load <scheme:/test.rdf> into <test>; Done. -- 8 msec. SQL> sparql select count(*) from <test> where {?s ?p ?o}; callret-0 INTEGER _______________________________________________________________________________ 31 1 Rows. -- 1 msec. SQL>

    Using a SPARQL query stored on DAV

    1. Execute from ISQL:

      SPARQL INSERT IN GRAPH <http://mygraph.com> { <http://myopenlink.net/dataspace/Kingsley#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://myopenlink.net/dataspace/Kingsley#this> <http://rdfs.org/sioc/ns#id> <Kingsley> . <http://myopenlink.net/dataspace/Caroline#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://myopenlink.net/dataspace/Caroline#this> <http://rdfs.org/sioc/ns#id> <Caroline> . <http://myopenlink.net/dataspace/Matt#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://myopenlink.net/dataspace/Matt#this> <http://rdfs.org/sioc/ns#id> <Matt> . <http://myopenlink.net/dataspace/demo#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://myopenlink.net/dataspace/demo#this> <http://rdfs.org/sioc/ns#id> <demo> . };

    2. Create DAV collection which is visible to public, for ex: http://localhost:8890/DAV/tmp
    3. Upload to the DAV collection the following file for ex. with name listall.rq and with the following content:

      PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX rdfs: <http://www.w3.org/2000/01/rdf-schema#> PREFIX sioc: <http://rdfs.org/sioc/ns#> SELECT ?x ?p ?o FROM <http://mygraph.com> WHERE { ?x rdf:type sioc:User . ?x ?p ?o. ?x sioc:id ?id . FILTER REGEX(str(?id), "^King") } ORDER BY ?x

    4. Now from ISQL execute the following command:

      SPARQL LOAD bif:concat ("http://", bif:registry_get("URIQADefaultHost"), "/DAV/tmp/listall.rq") INTO GRAPH <http://myNewGraph.com>;

    5. As result should be shown the message:

      callret-0 VARCHAR _______________________________________________________________________________ Load <http://localhost:8890/DAV/tmp/listall.rq> into graph <http://myNewGraph.com> -- done 1 Rows. -- 321 msec.

    SPARQL Insert via /sparql endpoint

    SPARQL INSERT operation can be sent to a web service endpoint as a single statement and executed in sequence.

    Example

    Using the Virtuoso ISQL tool or using the /sparql UI, for ex. at http://localhost:8890/sparql, execute the following:

    1. Insert into graph http://BookStore.com 3 triples:

      SPARQL INSERT IN GRAPH <http://BookStore.com> { <http://www.dajobe.org/foaf.rdf#i> <http://purl.org/dc/elements/1.1/date> <1999-04-01T00:00:00> . <http://www.w3.org/People/Berners-Lee/card#i> <http://purl.org/dc/elements/1.1/date> <1998-05-03T00:00:00> . <http://www.w3.org/People/Connolly/#me> <http://purl.org/dc/elements/1.1/date> <2001-02-08T00:00:00> };

    2. As result will be shown the message:

      Insert into <http://BookStore.com>, 3 triples -- done

    3. Next we will select all triples from the graph http://BookStore.com:

      SPARQL SELECT * FROM <http://BookStore.com> WHERE {?s ?p ?o};

    4. As result will be shown:

      s p o VARCHAR VARCHAR VARCHAR _______________________________________________________________________________ http://www.w3.org/People/Berners-Lee/card#i http://purl.org/dc/elements/1.1/date 1998-05-03T00:00:00 http://www.w3.org/People/Connolly/#me http://purl.org/dc/elements/1.1/date 2001-02-08T00:00:00 http://www.dajobe.org/foaf.rdf#i http://purl.org/dc/elements/1.1/date 1999-04-01T00:00:00 3 Rows. -- 0 msec.

    5. Now let's insert into graph another http://NewBookStore.com graph's values:

      SPARQL PREFIX dc: <http://purl.org/dc/elements/1.1/> PREFIX xsd: <http://www.w3.org/2001/XMLSchema#> INSERT INTO GRAPH <http://NewBookStore.com> { ?book ?p ?v } WHERE { GRAPH <http://BookStore.com> { ?book dc:date ?date FILTER ( xsd:dateTime(?date) < xsd:dateTime("2000-01-01T00:00:00")). ?book ?p ?v. } };

    6. As result will be shown:

      callret-0 VARCHAR _______________________________________________________________________________ Insert into <http://NewBookStore.com>, 2 triples -- done

    7. Finally we will check the triples from the graph NewBookStore.com:

      SQL> sparql select * from <http://NewBookStore.com> where {?s ?p ?o};

    8. As result will be shown:

      s p o VARCHAR VARCHAR VARCHAR _______________________________________________________________________________ http://www.w3.org/People/Berners-Lee/card#i http://purl.org/dc/elements/1.1/date 1998-05-03T00:00:00 http://www.dajobe.org/foaf.rdf#i http://purl.org/dc/elements/1.1/date 1999-04-01T00:00:00 2 Rows. -- 10 msec.

    References

    SPARQL Insert via HTTP Post using Content-Type: application/sparql-query and ODS wiki

    • With HTTP Post and ODS wiki, you can write an RDF document and perform INSERT/UPDATE actions over it.
    • You can write to a file using SIOC terms for ODS-Wiki.
    • You can check with sparql the inserted / updated triples in the Quad Store.

    Example

    1. Suppose there is ODS user test3 with ODS password 1, which has testWiki wiki instance.
    2. Execute the following:

      curl -i -d "INSERT { <http://localhost:8890/dataspace/test3/wiki/testWiki> <http://atomowl.org/ontologies/atomrdf#contains> <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://rdfs.org/sioc/ns#has_container> <http://localhost:8890/dataspace/test3/wiki/testWiki> . <http://localhost:8890/dataspace/test3/wiki/testWiki> <http://atomowl.org/ontologies/atomrdf#entry> <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> . <http://localhost:8890/dataspace/test3/wiki/testWiki> <http://rdfs.org/sioc/ns#container_of> <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://rdfs.org/sioc/ns#topic> <http://localhost:8890/dataspace/test3/wiki/testWiki> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://atomowl.org/ontologies/atomrdf#source> <http://localhost:8890/dataspace/test3/wiki/testWiki> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/types#Comment> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://atomowl.org/ontologies/atomrdf#Entry> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://www.w3.org/2000/01/rdf-schema#label> 'MyTest' . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://atomowl.org/ontologies/atomrdf#Link> . <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://rdfs.org/sioc/ns#content> <test> }" -u "test3:1" -H "Content-Type: application/sparql-query" http://localhost:8890/DAV/home/test3/wiki/testWiki/MyTest

    3. As result we should have 2 files created:
      1. In the user DAV folder "DAV/home/test3/wiki/testWiki/" will be created a file "MyTest?" with type "application/sparql-query".
        1. You can view the content of this file from from the Conductor UI or from the user's Briefcase UI, path "DAV/home/test3/wiki/testWiki":
        2. It content will be:

          <?xml version="1.0" encoding="utf-8" ?> <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki"><ns0pred:entry xmlns:ns0pred="http://atomowl.org/ontologies/atomrdf#" rdf:resource="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:label xmlns:ns0pred="http://www.w3.org/2000/01/rdf-schema#">MyTest</ns0pred:label></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:type xmlns:ns0pred="http://www.w3.org/1999/02/22-rdf-syntax-ns#" rdf:resource="http://atomowl.org/ontologies/atomrdf#Link"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:type xmlns:ns0pred="http://www.w3.org/1999/02/22-rdf-syntax-ns#" rdf:resource="http://rdfs.org/sioc/types#Comment"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:type xmlns:ns0pred="http://www.w3.org/1999/02/22-rdf-syntax-ns#" rdf:resource="http://atomowl.org/ontologies/atomrdf#Entry"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:has_container xmlns:ns0pred="http://rdfs.org/sioc/ns#" rdf:resource="http://localhost:8890/dataspace/test3/wiki/testWiki"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki"><ns0pred:container_of xmlns:ns0pred="http://rdfs.org/sioc/ns#" rdf:resource="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki"><ns0pred:contains xmlns:ns0pred="http://atomowl.org/ontologies/atomrdf#" rdf:resource="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:content xmlns:ns0pred="http://rdfs.org/sioc/ns#">test</ns0pred:content></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:topic xmlns:ns0pred="http://rdfs.org/sioc/ns#" rdf:resource="http://localhost:8890/dataspace/test3/wiki/testWiki"/></rdf:Description> <rdf:Description rdf:about="http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest"><ns0pred:source xmlns:ns0pred="http://atomowl.org/ontologies/atomrdf#" rdf:resource="http://localhost:8890/dataspace/test3/wiki/testWiki"/></rdf:Description> </rdf:RDF>

      2. To the user's wiki instance will be added a new WikiWord? "MyTest?" with content the value of the SIOC term attribue "content":

        <http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest> <http://rdfs.org/sioc/ns#content> <test>

        i.e., the content will be "test".
        1. You can view this file in path "DAV/home/test3/wiki/testWiki/" and its name will be "MyTest.txt".
        2. Using the ODS wiki UI you can:
          1. Go to Index link
          2. As result the MyTest? article will be shown in the given list. Click on its link.
          3. As result the content of the article will be shown.
    4. Now lets check what data was inserted in the Quad Store:
      1. Go to the sparql endpoint, i.e. for ex. to http://localhost:8890/sparql
      2. Enter for Default Graph URI:

        http://localhost:8890/DAV/home/test3/wiki/testWiki/MyTest

      3. Enter for Query text:

        SELECT * WHERE {?s ?p ?o}

      4. Click the "Run Query" button.
      5. As result will be shown the inserted triples:

        s p o http://localhost:8890/dataspace/test3/wiki/testWiki http://rdfs.org/sioc/ns#container_of http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://localhost:8890/dataspace/test3/wiki/testWiki http://atomowl.org/ontologies/atomrdf#entry http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://localhost:8890/dataspace/test3/wiki/testWiki http://atomowl.org/ontologies/atomrdf#contains http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://rdfs.org/sioc/types#Comment http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://atomowl.org/ontologies/atomrdf#Entry http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://atomowl.org/ontologies/atomrdf#Link http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://www.w3.org/2000/01/rdf-schema#label MyTest http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://rdfs.org/sioc/ns#has_container http://localhost:8890/dataspace/test3/wiki/testWiki http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://rdfs.org/sioc/ns#content test http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://rdfs.org/sioc/ns#topic http://localhost:8890/dataspace/test3/wiki/testWiki http://localhost:8890/dataspace/test3/wiki/testWiki/MyTest http://atomowl.org/ontologies/atomrdf#source http://localhost:8890/dataspace/test3/wiki/testWiki

    References

    Example Using WebDAV

    Mount folder to DAV and dump; if this is the rdf_sink the Quad Store is updated automatically, or you can load from DAV manually to quad store.

    1. Using ODS Briefcase:
      1. Go to your ods location, for ex. http://localhost:8890/ods
      2. Register user, for ex. user test1
      3. Login if not already in ods
      4. Go to ODS ->Briefcase
      5. Create new instance
      6. Go to the briefcase instance by clicking its name link
      7. Upload file in a new created folder mytest or in the rdf_sink folder with:
        1. checked option "RDF Store"
        2. set RDF Graph Name, for example, http://localhost:8890/DAV/home/test1/<name of the current folder>/, e.g., http://localhost:8890/DAV/home/test1/mytest/ or http://localhost:8890/DAV/home/test1/rdf_sink/
        3. For example, upload the following file with name jose.rdf.

          <rdf:RDF xmlns="http://www.example/jose/foaf.rdf#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:log="http://www.w3.org/2000/10/swap/log#" xmlns:myfoaf="http://www.example/jose/foaf.rdf#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <foaf:Person rdf:about="http://www.example/jose/foaf.rdf#jose"> <foaf:homepage rdf:resource="http://www.example/jose/"/> <foaf:knows rdf:resource="http://www.example/jose/foaf.rdf#juan"/> <foaf:name>Jose Jimen~ez</foaf:name> <foaf:nick>Jo</foaf:nick> <foaf:workplaceHomepage rdf:resource="http://www.corp.example/"/> </foaf:Person> <foaf:Person rdf:about="http://www.example/jose/foaf.rdf#juan"> <foaf:mbox rdf:resource="mailto:juan@mail.example"/> </foaf:Person> <foaf:Person rdf:about="http://www.example/jose/foaf.rdf#julia"> <foaf:mbox rdf:resource="mailto:julia@mail.example"/> </foaf:Person> <rdf:Description rdf:about="http://www.example/jose/foaf.rdf#kendall"> <foaf:knows rdf:resource="http://www.example/jose/foaf.rdf#edd"/> </rdf:Description> </rdf:RDF>

      8. Execute the following query:

        -- for specified user folder: SELECT * FROM <http://localhost:8890/DAV/home/test1/mytest/> WHERE {?s ?p ?o} -- or if the file is uploaded into the rdf_sink folder SELECT * FROM <http://localhost:8890/DAV/home/test1/rdf_sink/> WHERE {?s ?p ?o}

      9. As result the following triples should be found:

        s p o http://www.example/jose/foaf.rdf#jose http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://xmlns.com/foaf/0.1/Person http://www.example/jose/foaf.rdf#jose http://xmlns.com/foaf/0.1/nick Jo http://www.example/jose/foaf.rdf#jose http://xmlns.com/foaf/0.1/name Jose Jimen~ez http://www.example/jose/foaf.rdf#jose http://xmlns.com/foaf/0.1/knows http://www.example/jose/foaf.rdf#juan http://www.example/jose/foaf.rdf#jose http://xmlns.com/foaf/0.1/homepage http://www.example/jose/ http://www.example/jose/foaf.rdf#jose http://xmlns.com/foaf/0.1/workplaceHomepage http://www.corp.example/ http://www.example/jose/foaf.rdf#kendall http://xmlns.com/foaf/0.1/knows http://www.example/jose/foaf.rdf#edd http://www.example/jose/foaf.rdf#julia http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://xmlns.com/foaf/0.1/Person http://www.example/jose/foaf.rdf#julia http://xmlns.com/foaf/0.1/mbox mailto:julia@mail.example http://www.example/jose/foaf.rdf#juan http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://xmlns.com/foaf/0.1/Person http://www.example/jose/foaf.rdf#juan http://xmlns.com/foaf/0.1/mbox mailto:juan@mail.example

    2. Using Conductor UI:
      1. Go to Conductor UI, for ex. at http://localhost:8890/conductor
      2. Login as dba user
      3. Go to WebDAV&HTTP and create new folder, for ex. test
      4. Upload in the folder test a file, for ex. the file jose.rdf from above with options:
        1. Destination: RDF Store
        2. Set the RDF IRI

    Example Using Linked Data Import folder and Upload from File

    1. Create for ODS user demo a folder from type "Linked Data Import" using the Briefcase UI:
      1. Go to http://cname/ods and click Sign In;
      2. Enter user demo log in credentials;
      3. Click Briefcase from the left vertical navigation bar;
      4. Click "New Folder";
      5. In the presented form specify for ex.:
        • Folder name: "MyData?";
        • Folder type: "Linked Data Import"



      6. Go to tab "Linked Data Import";
      7. Specify "Graph name", for ex. "urn:mydata";
      8. Hatch "Sponger (on/off)" check-box, which setting will enable the Sponger usage.
        1. Optionally you can select which cartridges to be included from the "Sponger Extractor Cartridges" and "Sponger Meta Cartridges" lists:



      9. Click "Create".
    2. As result the new folder should be created:



    3. Click its name link:



    4. Click "Upload".
    5. In the presented form:
      1. Choose "Destination": WebDAV;
      2. Specify the source for the n3, .ttl etc. file we are going to import. For example, choose source "File" and click "Choose file" in order to select from your local filesystem for ex. a file with name "kidehen.n3" and content as follows:

        <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://rdfs.org/sioc/ns#User> . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://www.w3.org/2000/01/rdf-schema#label> "Kingsley" . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://rdfs.org/sioc/ns#creator_of> <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/1300> .





      3. Click "Upload".
    6. Should be created a new file with the name as specified in the form from above:



    7. Now let's check the inserted triples. Go to your Virtuoso SPARQL endpoint, i.e., http://cname/sparql and:
      1. Enter in the Query area the following simple query:

        SELECT * FROM <urn:mydata> WHERE { ?s ?p ?o }





      2. Click the button "Run Query"
      3. As result will be shown the inserted triples:

        s p o http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://rdfs.org/sioc/ns#User http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://www.w3.org/2000/01/rdf-schema#label Kingsley http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://rdfs.org/sioc/ns#creator_of http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/1300

    Example Using Linked Data Import folder and a manually created resource with N3/Turtle content

    1. Create for ODS user demo a folder from type "Linked Data Import" using the Briefcase UI:
      1. Go to http://cname/ods and click Sign In;
      2. Enter user demo log in credentials;
      3. Click Briefcase from the left vertical navigation bar;
      4. Click "New Folder";
      5. In the presented form specify for ex.:
        • Folder name: "MyData?";
        • Folder type: "Linked Data Import"



      6. Go to tab "Linked Data Import";
      7. Specify "Graph name", for ex. "urn:mydata";
      8. Hatch "Sponger (on/off)" check-box, which setting will enable the Sponger usage.
        1. Optionally you can select which cartridges to be included from the "Sponger Extractor Cartridges" and "Sponger Meta Cartridges" lists:



      9. Click "Create".
    2. As result the new folder should be created:



    3. Click its name link:



    4. Click "Create".
    5. In the presented form:
      1. Specify "File name", for ex: mytest.n3 ;
      2. Specify "File Mime Type", for ex: text/rdf+n3 ;
      3. Enter in the "File Content" text area the following triples:

        <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://rdfs.org/sioc/ns#id> "kidehen@openlinksw.com" . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://rdfs.org/sioc/ns#link> <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com> . <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this> <http://rdfs.org/sioc/ns#account_of> <http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com#this> .





      4. Click "Create".
    6. Should be created a new file with the name as specified in the form from above:



    7. Now let's check the inserted triples. Go to your Virtuoso SPARQL endpoint, i.e., http://cname/sparql and:
      1. Enter in the Query area the following simple query:

        SELECT * FROM <urn:mydata> WHERE { ?s ?p ?o }





      2. Click the button "Run Query"
      3. As result will be shown the inserted triples:



    Example Using Virtuoso Crawler

    The following example is using Virtuoso Crawler which includes the Sponger options so you crawl non-RDF and get RDF and this data will go to the Quad Store.

    1. Go to conductor UI. For ex. at http://localhost:8890/conductor
    2. Login as dba user
    3. Go to tab "Web Application Server" -> "Content Management" -> "Content Imports"
    4. Click the "New Target" button
    5. In the shown form enter set respectively:
      1. "Crawl Job Name": Tim Berners-Lee's electronic Business Card
      2. "Data Source Address (URL)": http://www.w3.org/People/Berners-Lee
      3. "Local WebDAV Identifier" for ex.: /DAV/home/demo/rdf_sink/
      4. Choose from the list "Local resources owner": demo
      5. Check the check.box with label "Store metadata".
      6. Check all the check-boxes shown below the check-box "Store metadata".





      7. Click "Create".
    6. The new created target should be presented in the list of available targets:



    7. Click the button "Import Queues".
    8. For "Robot target" with label "Tim Berners-Lee's electronic Business Card" click the start link.
    9. As result should be shown the number of the pages retrieved.

    10. Now using the SPARQL endpoint with Sponger option "Use only local data" enter for Default Graph URI: http://www.w3.org/People/Berners-Lee and execute the following query:

      SELECT * WHERE {?s ?p ?o}

    11. As result should be shown the following triples:

      s p o http://www.w3.org/People/Berners-Lee http://www.w3.org/1999/02/22-rdf-syntax-ns#type http://xmlns.com/foaf/0.1/Document http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Answers for young people - Tim Berners-Lee http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Berners-Lee: Weaving the Web http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Declaration by Tim BL 28 Feb 1996 w.r.t. CDA challenge http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Errata - Berners-Lee: Weaving the Web http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Frequently asked questions by the Press - Tim BL http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Glossary - Weaving the Web - Berners-Lee http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Longer Bio for Tim Berners-Lee http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Michael Dertouzos has left us http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title The Future of the Web and Europe http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title The World Wide Web: Past, Present and Future http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title The World Wide Web: A very short personal history http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Tim Berners-Lee http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Tim Berners-Lee - 3Com Founders chair http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Tim Berners-Lee: Disclosures http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Tim Berners-Lee: WWW and UU and I http://www.w3.org/People/Berners-Lee http://purl.org/dc/elements/1.1/title Tim Berners-Lee: WorldWideWeb, the first Web client

    References

    Examples using SPARQL 1.1 Graph Store HTTP Protocol

    Example using SPARQL Query & Sponger

    (i.e. we Sponge the Resources in the FROM Clause or values for the graph-uri parameter in SPARQL protocol URLs)

    1. Execute the following query:

      SPARQL SELECT ?id FROM NAMED <http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/sioc.ttl> OPTION (get:soft "soft", get:method "GET") WHERE { GRAPH ?g { ?id a ?o } } LIMIT 10;

    2. As result will be shown the retrived triples:

      id VARCHAR _______________________________________________________________________________ http://www.openlinksw.com/dataspace/kidehen@openlinksw.com#this http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com#this http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/612 http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/612 http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/610 http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/610 http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/856 http://www.openlinksw.com/dataspace/kidehen@openlinksw.com/weblog/kidehen@openlinksw.com%27s%20BLOG%20%5B127%5D/856 10 Rows. -- 20 msec.

    References

    Example using Virtuoso PL APIs

    1. In the example script we implement a basic mapper which maps a text/plain mime type to an imaginary ontology, which extends the class Document from FOAF with properties 'txt:UniqueWords?' and 'txt:Chars', where the prefix 'txt:' we specify as 'urn:txt:v0.0:'.

      USE DB; CREATE PROCEDURE DB.DBA.RDF_LOAD_TXT_META ( IN graph_iri VARCHAR, IN new_origin_uri VARCHAR, IN dest VARCHAR, INOUT ret_body ANY, INOUT aq ANY, INOUT ps ANY, INOUT ser_key ANY ) { DECLARE words, chars INT; DECLARE vtb, arr, subj, ses, str ANY; DECLARE ses ANY; -- if any error we just say nothing can be done DECLARE EXIT HANDLER FOR SQLSTATE '*' { RETURN 0; }; subj := COALESCE (dest, new_origin_uri); vtb := vt_batch (); chars := LENGTH (ret_body); -- using the text index procedures we get a list of words vt_batch_feed (vtb, ret_body, 1); arr := vt_batch_strings_array (vtb); -- the list has 'word' and positions array, so we must divide by 2 words := LENGTH (arr) / 2; ses := string_output (); -- we compose a N3 literal http (sprintf ('<%s> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://xmlns.com/foaf/0.1/Document> .\n', subj), ses); http (sprintf ('<%s> <urn:txt:v0.0:UniqueWords> "%d" .\n', subj, words), ses); http (sprintf ('<%s> <urn:txt:v0.0:Chars> "%d" .\n', subj, chars), ses); str := string_output_string (ses); -- we push the N3 text into the local store DB.DBA.TTLP (str, new_origin_uri, subj); RETURN 1; } ; -- DELETE FROM DB.DBA.SYS_RDF_MAPPERS WHERE RM_HOOK = 'DB.DBA.RDF_LOAD_TXT_META'; INSERT SOFT DB.DBA.SYS_RDF_MAPPERS (RM_PATTERN, RM_TYPE, RM_HOOK, RM_KEY, RM_DESCRIPTION) VALUES ('(text/plain)', 'MIME', 'DB.DBA.RDF_LOAD_TXT_META', null, 'Text Files (demo)'); -- here we set order to some large number so don't break existing mappers UPDATE DB.DBA.SYS_RDF_MAPPERS SET RM_ID = 2000 WHERE RM_HOOK = 'DB.DBA.RDF_LOAD_TXT_META';

    2. To test the mapper we just use /sparql endpoint with option 'Retrieve remote RDF data for all missing source graphs' to execute:

      SELECT * FROM <http://demo.openlinksw.com:8890/tutorial/hosting/ho_s_30/WebCalendar/tools/summary.txt> WHERE { ?s ?p ?o }

    3. Check the results here.

    Important: Setting Sponger Permissions

    In order to allow the Sponger to update the local RDF quad store with triples constituting the the Network Resource being fetched as structured data, the role "SPARQL_UPDATE" must be granted to the account "SPARQL". This should normally be the case. If not, you must manually grant this permission. As with most Virtuoso DBA tasks, the Conductor provides the simplest means of doing this.

    References

    Example using SIMILE RDF Bank API

    Virtuoso implements the HTTP-based Semantic Bank API that enables client applications to post to its RDF Triple Store. This method offers an alternative to using Virtuoso/PL functions or WebDAV uploads as the triples-insertion mechanism.
    1. From your machine go to FireFox?->Tools->PiggyBank?->My Semantic Bank Accounts
    2. Add in the shown form:
      1. For bank address: http://demo.openlinksw.com/bank
      2. For account id: demo
      3. For password: demo
    3. Go to demo.openlinksw.com/ods
    4. Log in as user demo, password: demo
    5. Go to the Weblog tab from the main ODS Navigation
    6. Click on weblog instance name, for ex. "demo's Weblog".
    7. When the weblog home page is loaded, click Alt + P.
    8. As result is shown the "My PiggyBank?" page with all the collected information presented in items.
    9. For several of the items add Tags from the form "Tag" shown for each of them.
    10. As result should be shown the message "Last updated: [here goes the date value].
    11. You can also click "Save" and "Publish" for these items.
    12. Go to http://demo.openlinksw.com/sparql
    13. Enter for the "Default Graph URI" field: http://simile.org/piggybank/demo
    14. Enter for the "Query text" text-area:

      PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX sioc: <http://rdfs.org/sioc/ns#> SELECT * FROM <http://simile.org/piggybank/demo> WHERE {?s ?p ?o}

    15. Click "Run Query".
    16. As results are shown the found results.

    References

    Example using RDF NET


    SQL> SELECT DB.DBA.HTTP_RDF_NET ('SPARQL LOAD 
    "http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com" 
    INTO GRAPH <http://www.openlinksw.com/>');
    
    callret
    VARCHAR
    _______________________________________________________
    
    <?xml version="1.0" ?>
    <rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" 
    xmlns:vcard="http://www.w3.org/2001/vcard-rdf/3.0#" 
    xmlns="http://example.org/book/" xmlns:dc="http://purl.org/dc/elements/1.1/" 
    xmlns:ns="http://example.org/ns#">
    <rdf:Description>
    <callret-0>LOAD <http://www.openlinksw.com/dataspace/person/kidehen@openlinksw.com> 
    INTO GRAPH <http://www.openlinksw.com/> -- done</callret-0>
    </rdf:Description>
    </rdf:RDF>
    
    1 Rows. -- 1982 msec.
    

    See Also

    References

    CategoryRDF CategoryHowTo CategoryVirtuoso CategorySPARQL