Virtuoso Open Source Edition News (2011)

Later Years

• 2012 to present

2011

2011-11-01: Announcing Virtuoso Open-Source Edition v6.1.4

New product features as of November 1, 2011 in V6.1.4, include:

Upgrading from previous versions

• Added information about upgrading from previous 6.1.x to 6.1.4
• Enabled check for bad index due to XML fragment
• See: README.UPGRADE

Database engine

• Added new implementation of search_excerpt that can handle both ANSI/UTF8 and Wide strings
• Added new setting RdfFreeTextRulesSize
• Added improved support for inference-rules-based reasoning and materialized Linked Data Views generated from ODBC/JDBC-accessible relational databases
• Added option to register post-processing callbacks to SPARQL DESCRIBE
• Added initial support for PHP 5.3 runtime hosting
• Added aggregate DB.DBA.GROUP_DIGEST which makes it possible to return part of large output from DB.DBA.GROUP_CONCAT without running out of row length limits
• Added optimized codegen for built-in aggregate functions
• Added option to enable/disable ?P statistics generation for SPARQL query patterns
• Added support for HTML5+Microformat, Microformat/JSON, and JSON-LD serialization formats to SPARQL endpoint
• Added support for SPARQL 1.1 IF and COALESCE
• Added support for SPARQL 1.1 SPARQL HTTP Graph Store Protocol covering Graph-level CRUD operations
• Added support for SQL QUERY syntax in declaration of Linked Data Views
• Added support for calling XPath/XQuery functions from SPARQL
• Fixed code generation using gawk 4
• Fixed code generation for service invocation for case of IN parameter that is not bound in SINV sub-query is neither external/global nor fixed in parent group pattern
• Fixed col_default to be same dtp as col_dtp to prevent default value misuse
• Fixed compiler warnings
• Fixed connection leak in connection pool during long checkpoints
• Fixed crash running FILTER query containing IN clause with only one item in it
• Fixed deadlock on attempt of qr_recompile during the run of SPARQL-to_SQL front-end
• Fixed disable dep cols check
• Fixed disabled pg_check_map by default to make checkpoint faster
• Fixed handling of GROUP BY and ORDER BY using expressions
• Fixed hang or crash after checkpoint is finished
• Fixed issues with cost based optimizer
• Fixed issue with multiple transitive subqueries in SQL optimizer
• Fixed issue with ORDER BY expression optimization
• Fixed JSON output for native parsers
• Fixed key dep cols check for sample
• Fixed lock status report
• Fixed memory leaks
• Fixed possible mutex deadlock
• Fixed problems re-creating quad map
• Fixed RDF View generation
• Fixed recompile all QR's cached on CLI connection when dropping a group or creating new graph group
• Fixed set sl_owner before cpt_rollback in order to know which thread owns the process, otherwise other threads may wrongly go inside the wait_checkpoint
• Fixed skip rules which perform HTTP redirect when doing a POST
• Fixed space calculation when changed records does not fit in available space on page
• Fixed SPARQL OPTIONAL keyword sometimes causing queries to not return graph matches
• Fixed SQL codegen bug in SPARQL queries of R2RML rewriter
• Fixed when iri exceeds 2KB limit and flag is enabled then shorten the iri, instead of rejecting it
• Rebuilt Jena, Sesame2, and JDBC drivers
• Updated documentation

SPARQL and RDF

• Added new cartridges for Eventbrite, Eventful, Foursquare, Gowalla, Google+, Google Places, Google Product, Google Profile, Gowalla, Guardian, Hyperpublic, Jigsaw, LinkedIn?, Plancast, ProgrammableWeb?, Seatgeek, Seevl, SimpleGeo?, Upcoming, XRD, Zappos, and Zoopla
• Added ontologies for OpenLink CV/Resume, Google+, and many others associated with Sponger Cartridges
• Added new cartridge for Twitter using Twitter 2.0 REST API
• Added enhancements to Facebook Graph API and OpenGraph? based cartridges
• Added built-in support for social bookmarking to Faceted Browser and Sponger generated Linked Data pages
• Added new HTML base User Interface for default SPARQL endpoint
• Added support for MS-Author-Via: SPARQL, to SPARQL response headers when using SPARQL endpoint
• Added support for conditional operators such as like, ==, < > ranges, and IN on native Faceted Browser pages
• Added improved permalink functionality on Faceted Browser pages
• Added support for Javascript-like hrefs in RDFa
• Added w3-1999-xhtml/vocab for RDFa 1.1
• Added HTTP status codes in SPARQL graph store protocol
• Added API for selective sponging via URL enhanced patterns
• Added support for CREATE LITERAL CLASS "format string" ...
• Fixed bad conversion of utf8 in RDF/XML
• Fixed "delayed" filters like ?x p1 ?o1 ; p2 ?o2 . OPTIONAL { ... } . FILTER (?o1 = ?o2)
• Fixed map OpenLink Zillow ontology to geo:lat/long
• Fixed map oplog:likes_XXX property to like:likes
• Fixed minor issues
• Fixed SPARUL LOAD INTO command creating duplicate graphs
• Fixed translation from nodeID://xxx to _:xxx
• Fixed URL encoding issues in RDF/XML
• Fixed when dropping a graph, also check if there is a quad map for it

ODS Applications

• Added ACL eXecute flag
• Added RDF/XML and TTL representations to Offers
• Added SIOC object services
• Added WebID? verification service
• Added annotation rules
• Added app discussion rules
• Added discussion IRIs
• Added header and head links for IRIs
• Added ldap schema support to WebID?
• Added mail verification service
• Added support for WebID? idp
• Added user's rewrite rules
• Added user/mail availability action
• Updated CKEditor to version 3.6.1
• Fixed <a>++
• Fixed ACL using patterns
• Fixed API functions
• Fixed call auth check only when needed
• Fixed changing/deleting events does not trigger re-sync with publication
• Fixed Delicious import/publish
• Fixed description presentation
• Fixed Facebook UI
• Fixed IE JS problems
• Fixed import atom sources
• Fixed move/copy API with wrong source/destination
• Fixed navigation and UI
• Fixed Offers, Likes and Dislikes, Topic of Interest
• Fixed search RSS problem
• Fixed SIOC RDF links API functions
• Fixed typo in messages
• Fixed WebDAV selection

2011-03-30: Announcing Virtuoso Open-Source Edition v6.1.3

New product features as of March 30, 2011, V6.1.3, include:

Core Database Engine

• Added configurable normalization of accented characters
• Added global X.509 CA repository
• Added IMAP, IMAP-SSL and POP3-SSL client support
• Added HTTP maintenance functions
• Added optimization for case when there is no locality
• Added optimization to look at GS index only
• Added optimization to boolean expression evaluation
• Added read-ahead on extent
• Added retry deadlock if HTTP session is not flushed
• Added retry on deadlock when sponging on multiple threads
• Added support for CORS on http endpoints
• Added support for passing NVARCHAR arguments to thread-safe dicts
• Added S/MIME encrypt and decrypt functions
• Added SSL const decoration in explain
• Added new aggregate functions primarily for use with SPARQL-BI
• Added transitivity cache
• Fixed busy loop when no free remaps
• Fixed check for 5xx or 4xx status codes
• Fixed check if subselect has a recursive ref
• Fixed cost model to count inx cond and scale card at end
• Fixed error on INSERT DATA with literals of non-default types
• Fixed following checkpoint kill recovery remap extents may have allocated pages with no corresponding logical page because recovery performs unremap. Therefor if em remap page is allocated in em but free in dbs freemap, disregards and reset em allocation, if no logical page. If logical page, concider the dbs freeset in error and mark page as allocated.
• Fixed delay increase on sequential deadlock
• Fixed index_only on partial can return has data even if main row does not
• Fixed infinite loop when dealing with string like abc&def and no token
• Fixed issue parsing SPARQL function calls with zero arguments
• Fixed issue with aggregates, distinct and ORDER BY
• Fixed issue with closing XAConnection and connection pool
• Fixed issue with combination of UNION in the argument of IN causing General internal Optimized compiler error
• Fixed issue with partial index when no path is followed
• Fixed JDBC driver lost prepared data after execution query, so next execute of prepared query throws exception
• Fixed memleaks
• Fixed moved mutex lock/unlock calls to avoid deadlock
• Fixed recovery mode
• Fixed send body of 509 bandwidth error
• Fixed set HTTP status to 503 when showing maintenance page and added a Retry-After: 1800 (seconds) header as a hint to the remote
• Fixed set local timezone
• Fixed size of input buffer of an XML parser is now adaptive
• Updated documentation

SPARQL and RDF related

• Added attribution ontology
• Added Evri ontology
• Added new Sponger Cartridges for EOL, Evri, Google Books, Groupon, hNews, hRecipe, ProductWiki?, RDFa, RDFohloh, and many others
• Added checking for RDFa DOCTYPE declaration
• Added automatic wdrs:describedby relations for ingested RDF resources
• Added expiration header handling re. Sponger cache invalidation scheme enhancements
• Added SPARQL-FED for Linked Data virtualization across 3rd party SPARQL endpoints
• Added SPARQL, SPARQL-BI, and SPARQL-FED invocation from XSLT
• Added index to search over label text
• Added initial codegen for ASK subquery
• Added lax mode in CSV import
• Added MinExpiration? param for Sponger
• Added more prefixes
• Added namespace prefix 'fn' for XPATH 2.0 and XQuery 1.0 Core Functions library
• Added new SPARQL-to-SQL codegen for type cast functions
• Added new SQL optimization to convert --
  

  
  sprintf ('format', col0, col1, ..., colN) = exnp 
  

  
  -- into more index friendly --
  

  
  ( col0 = sprintf_inverse ('format', expn, 2)[0] and 
    col1 = sprintf_inverse ('format', expn, 2)[1] and ...  
    colN = sprintf_inverse ('format', expn, 2)[N] )
  

  
  
• Added optimization of SPARQL arithmetic and numerical comparisons
• Added RDFa W3c validation button
• Added RDFS (RDF Schema)
• Added refresh=clean mode, to drop cache even if it is in the middle of sponging on another threads
• Added scheduler task to keep volume under some limit
• Added special immutable setting for inf rules
• Added support for CSV as an output format
• Added support for DEFINE input:inference in SPARQL DESCRIBE
• Added support for DEFINE output:format "NT" for N-Triples
• Added support for FILTER EXISTS and FILTER NOT EXISTS
• Added support for URL template discovery via http://{virtuoso-instance-cname}/.well-known/host-meta
• Added support for INSERT, UPDATE, and DELETE operations against XMLA endpoint
• Added support for MINUS
• Added support for posh triples
• Added support for RDB2RDF
• Added support of "rdfs:seeAlso" predicate in case of recursive sponging
• Added WebID? Protocol-based ACL support across all SSL/TLS endpoints, e.g., WebDAV, SPARQL, Sponger, other Virtuoso deployed Web Services
• Fixed datatype for Twitter
• Fixed DATETIME format
• Fixed do not use triple dicts on long files
• Fixed do not check immutable graph when dba is running
• Fixed DOI and RDFa handling in Sponger
• Fixed enable xlat IRIs
• Fixed hReview aggregates handling in Sponger Cartridge
• Fixed issue with SPARQL CONSTRUCT/INSERT/DELETE/MODIFY queries
• Fixed issue with sponging options and DESCRIBE on /sparql endpoint
• Fixed issue with SPARQL FILTER with two OPTIONALs
• Fixed issues reported by W3C Validator
• Fixed issues with SPARQL-FED, i.e., made it capable of accommodating rudimentary 3rd party SPARQL endpoints
• Fixed missing column error in SPARQL-to-SQL preprocessor
• Fixed missing namespace in /results
• Fixed security issue in SPARQL
• Fixed SPARQL parse bug with NOT FROM NAMED queries like --
  

  
  SELECT DISTINCT ?g ?p NOT FROM NAMED virtrdf: 
     WHERE { GRAPH ?g { ?s ?p ?o }}
  

  
  
• Fixed sqltype and display size of DV_IRI_ID column
• Fixed use common API to delete target
• Fixed use doi proxy if no hslookup plugin
• Fixed use DSN from content-location when it exists
• Fixed use exclusive locks when doing SPARUL ops
• Fixed when selection list contains expressions with constants do not inline OJ
• Fixed small bugs

ODS Applications

• Added ACL Inheritance
• Added ACL semantic ping
• Added group sharing
• Added IMAP and IMAPS support
• Added JSON format for WebFinger?
• Added language and type options for offers
• Added 'Likes', 'Dislikes', 'Owns', 'Knows', and 'Social Network'
• Added linkblog pages
• Added login with Google account
• Added microblog template
• Added new index on OL accounts
• Added new login and register library
• Added profile security for offers, likes, etc.
• Added progress bar, ping, and ACL
• Added RDF graph property for links
• Added RDFa info
• Added RSS and Atom imports
• Added signed and/or encrypted mails
• Added support for LinkedIn
• Added Salmon Slap protocol as notification services option
• Added support for SWD
• Added support for Twitter
• Added UI for Login Authentication Keys
• Added WebID? to 'My Profile'
• Fixed ACL handling
• Fixed HTTPS handling
• Fixed certificates
• Fixed hyperlink session expire issue
• Fixed OpenID server parameters extraction
• Fixed RDF object properties
• Fixed Twitter and LinkedIn registration/login
• Fixed WebID for Briefcase instances
• Fixed X.509 certificates in user pages
• Fixed XRDS
• Updated to CKeditor version 3.5.2

Previous Years

• 2010
• 2009
• 2008
• 2007
• 2006

CategoryVirtuoso CategoryOpenSource CategoryWebSite