| content
| - %META:TOPICPARENT{name="VirtBulkRDFLoader"}%
---+ Virtuoso Bulk Load Example: DBpedia data sets
The following example demonstrates how to upload the DBpedia data sets into Virtuoso using the Bulk Loading Sequence.
1 Assuming there is a folder named "<code>tmp</code>" in your filesystem, and it is within a directory specified in the <b><code>[[http://docs.openlinksw.com/virtuoso/databaseadmsrv.html#fp_acliniallowed][DirsAllowed]]</code></b> param defined in your <code>virtuoso.ini</code> file.
1 Load the required DBpedia data sets into the "<code>tmp</code>" folder
* The latest data sets can be downloaded from the [[http://wiki.dbpedia.org/Downloads][DBpedia Download]] page. Note the compressed bzip'ed "<code>.bz2</code>" data set files need to be uncompressed first as the bulk loader scripts only supports the auto extraction of gzip'ed "<code>.gz</code>" files.
1 If it hasn't already been, execute the [[VirtBulkRDFLoaderScript][Bulk Loading script]].
1 Register the graph IRI under which the triples are to be loaded, e.g., "<code><nowiki>http://dbpedia.org</nowiki></code>":
<verbatim>
SQL> ld_dir ('tmp', '*.*', 'http://dbpedia.org');
Done. -- 90 msec.
</verbatim>
* Note that while this procedure will also work with gzip'ed files, it is important to keep the pattern: <code><nowiki><name>.<ext>.gz</nowiki></code>, e.g., '<code><nowiki>ontology.owl.gz</nowiki></code>' or <code><nowiki>ontology.nt.gz</nowiki></code>
* Note that if there are other data files in your folder (<code>tmp</code>), then their content will also be loaded into the specified graph.
%BR%%BR%
1 Create a file named <b><code>global.graph</code></b> in the "<code>tmp</code>" folder, with its entire content being the URI of the desired target graph, e.g.,
<verbatim>
http://dbpedia.org
</verbatim>
1 Finally, execute the <code><nowiki>rdf_loader_run</nowiki></code> procedure. This may take some time, depending on the size of the data sets.
<verbatim>
SQL> rdf_loader_run ();
Done. -- 100 msec.
</verbatim>
1 As a result, the Virtuoso log should contain notification that the loading has completed:
<verbatim>
10:21:50 PL LOG: Loader started
10:21:50 PL LOG: No more files to load. Loader has finished
</verbatim>
1 Run a <code><nowiki>checkpoint</nowiki></code> to commit all transactions to the database.
<verbatim>
SQL> checkpoint;
Done. -- 53 msec.
</verbatim>
1 To check the inserted triples for the given graph, execute a query similar to --
<verbatim>
SQL> SPARQL
SELECT COUNT(*)
FROM <http://dbpedia.org>
WHERE
{
?s ?p ?o
} ;
</verbatim>
1 Install the [[http://s3.amazonaws.com/opldownload/uda/vad-packages/6.2/virtuoso/dbpedia_dav.vad][DBpedia]] and [[http://s3.amazonaws.com/opldownload/uda/vad-packages/6.2/virtuoso/rdf_mappers_dav.vad][RDF Mappers]] VAD packages, using either the Virtuoso Conductor or the following manual commands:
<verbatim>
SQL> vad_install ('dbpedia_dav.vad', 0);
SQL> vad_install ('rdf_mappers_dav.vad', 0);
</verbatim>
1 The Virtuoso-hosted data set can now be explored using a HTML browser, or queried from the SPARQL or Faceted Browser web service endpoints. For example, with the DBpedia 3.5.1 data sets, a description of the resource Bob Marley can be viewed as: <code><nowiki>http://<your-cname>:<your-port>/resource/Bob_Marley </nowiki></code>
%BR%%BR%<img src="%ATTACHURLPATH%/VirtAWSPublicDataSets07.png" style="wikiautogen"/> %BR%%BR%
---++Related
* [[VirtBulkRDFLoader][Virtuoso Bulk data set loader]]
|
![[RDF Data]](/fct/images/sw-rdf-blue.png)
![[cxml]](/fct/images/cxml_doc.png)
![[csv]](/fct/images/csv_doc.png)
![[text]](/fct/images/ntriples_doc.png)
![[turtle]](/fct/images/n3turtle_doc.png)
![[ld+json]](/fct/images/jsonld_doc.png)
![[rdf+json]](/fct/images/json_doc.png)
![[rdf+xml]](/fct/images/xml_doc.png)
![[atom+xml]](/fct/images/atom_doc.png)
![[html]](/fct/images/html_doc.png)