Most of the Sponger's extractor cartridges work on a pool of data, such as an HTML webpage containing metadata, which are extracted into triples. Some of the cartridges make API calls to upstream web services to retrieve the relevant pool of data first.
Query Language cartridges are for situations where the data arises from a query executed on the upstream site, ie the data being sponged is the result-set of another query.
Maybe the upstream server holds control over, or offers limited or restricted access to, the data; maybe you have a pre-existing application that uses the given language to express its queries.
Virtuoso's Sponger has 3 cartridges that support upstream queries:
Upstream query editor interface: http://www.freebase.com/queryeditor
Language: MQL, a means of expressing filters in JSON.
Sample:
{
"album": [{
"id": null,
"limit": 2,
"name": null,
"track": []
}],
"id": null,
"name": "The Police",
"type": "/music/artist"
}
There are no special requirements; because it doesn't even need an app key to use it, it should be enabled by default after installing the Cartridges VAD package.
Upstream query editor interface: http://developer.yahoo.com/yql/console/
Language: a web-based SQL-style dialect
Sample:
select * from local.search where query="sushi" and location="san francisco, ca"
Permalink to query URL: http://query.yahooapis.com/v1/public/yql?q=select%20*%20from%20local.search%20where%20query%3D%22sushi%22%20and%20location%3D%22san%20francisco%2C%20ca%22&diagnostics=true
There are no special requirements; because it doesn't even need an app key to use it, it should be enabled by default after installing the Cartridges VAD package.
Upstream query editor interface: http://www.wolframalpha.com/
Language: custom, pseudo-natural-language
Sample:
airspeed of a laden swallow
Permalink to query URL: http://www.wolframalpha.com/input/?i=airspeed+of+a+laden+swallow&dataset=
Both the Wolfram|Alpha cartridge and meta-cartridge require an App-ID issued from the Wolfram Alpha developer dashboard. For a detailed overview, see the cartridge configuration instructions.
Upstream query editor interface: http://treasury.io/
Language: a web-based SQL-style dialect
Sample:
SELECT "table", "date", "year_month", "year", "month", "day", "weekday", "account", "account_raw", "is_total", "close_today", "open_today", "open_mo", "open_fy", "url" FROM "t1" limit 10
There are no special requirements; because it doesn't even need an app key to use it, it should be enabled by default after installing the Cartridges VAD package.