通過將巨大的xml文件轉換為rdf來填充本體

Question

我嘗試使用從奇跡數據庫Wikia提取的數據填充本體（您可以提取包含Wiki的所有信息的xml）。 我的問題是此xml太重，無法對其進行任何處理（超過500Mo）。 我嘗試使用xslt將其轉換為更簡單的rdf文件，但是由於xml文件大小，這是完全不可能的。

xml文檔是由頁面組成的：

<page>
<title>Aeroika (Earth-616)</title>
<ns>0</ns>
<id>1035</id>
  <sha1>11t0be5viqp0vsj8zwglfu3wea8fou4</sha1>
<revision>
  <id>1786343</id>
  <timestamp>2011-10-04T17:49:37Z</timestamp>
  <contributor>
    <username>HamsterMan</username>
    <id>2082346</id>
  </contributor>
  <minor/>
  <text xml:space="preserve" bytes="1652">{{Marvel Database:Character Template
| Image                   = Aeroika (Earth-616).jpg
| RealName                = Aeroika
| CurrentAlias            = Aeroika
| Aliases                 = 
| Identity                = 
| Affiliation             = [[Defenders (Earth-616)|Defenders]]
| Relatives               = 
| Universe                = Earth-616
| BaseOfOperations        = [[Tunnelworld]]

| Gender                  = Male
| Height                  = 
| Weight                  = 
| Eyes                    = 
| Hair                    = Gold
| UnusualSkinColour       = Gold
| UnusualFeatures         = Wings growing out of his head.
}}
[[Category:Flight]]</text>
</revision>
</page>

例如，在這種情況下，我做了一個xslt來提取rdf中的重要數據。

<xsl:template match="/">
<rdf:RDF
xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:si="http://www.w3schools.com/rdf/">

<xsl:for-each select="page">
    <xsl:choose>
        <xsl:when test="contains(revision/text, 'Character Template')">
            <rdf:Description rdf:about="{title}">
                <Image><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Image'),'|'),'=')" /></Image>
                <RealName><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'RealName'),'|'),'=')" /></RealName>
                <CurrentAlias><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'CurrentAlias'),'|'),'=')" /></CurrentAlias>
                <Aliases><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Aliases'),'|'),'=')" /></Aliases>
                <Identity><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Identity'),'|'),'=')" /></Identity>
                <Affiliation><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Affiliation'),'|'),'=')" /></Affiliation>
                <Relatives><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Relatives'),'|'),'=')" /></Relatives>
                <Universe><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Universe'),'|'),'=')" /></Universe>
                <BaseOfOperations><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'BaseOfOperations'),'|'),'=')" /></BaseOfOperations>
                <Gender><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Gender'),'|'),'=')" /></Gender>
                <Height><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Height'),'|'),'=')" /></Height>
                <Weight><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Weight'),'|'),'=')" /></Weight>
                <Eyes><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Eyes'),'|'),'=')" /></Eyes>
                <Hair><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Hair'),'|'),'=')" /></Hair>
                <UnusualSkinColour><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'UnusualSkinColour'),'|'),'=')" /></UnusualSkinColour>
                <UnusualFeatures><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'UnusualFeatures'),'|'),'=')" /></UnusualFeatures>
                <Citizenship><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Citizenship'),'|'),'=')" /></Citizenship>
                <MaritalStatus><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'MaritalStatus'),'|'),'=')" /></MaritalStatus>
                <Occupation><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Occupation'),'|'),'=')" /></Occupation>
                <Education><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Education'),'|'),'=')" /></Education>
                <Origin><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Origin'),'|'),'=')" /></Origin>
                <PlaceOfBirth><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'PlaceOfBirth'),'|'),'=')" /></PlaceOfBirth>
                <Creators><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Creators'),'|'),'=')" /></Creators>
                <First><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'First'),'|'),'=')" /></First>
                <HistoryText><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'HistoryText'),'|'),'=')" /></HistoryText>
                <Powers><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Powers'),'|'),'=')" /></Powers>
                <Abilities><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Abilities'),'|'),'=')" /></Abilities>
                <Strength><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Strength'),'|'),'=')" /></Strength>
                <Weaknesses><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Weaknesses'),'|'),'=')" /></Weaknesses>
                <Equipement><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Equipement'),'|'),'=')" /></Equipement>
                <Transportation><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Transportation'),'|'),'=')" /></Transportation>      
                <Weapons><xsl:value-of select="substring-after(substring-before(substring-after(revision/text, 'Weapons'),'|'),'=')" /></Weapons>
            </rdf:Description>
        </xsl:when>
        <xsl:otherwise>
        </xsl:otherwise>
    </xsl:choose>
</xsl:for-each>
</rdf:RDF>
</xsl:template>

</xsl:stylesheet> 

您是否知道我該怎么做？ 謝謝

Answer 1

您的XSLT樣式表將“常規” XML轉換為RDF / XML語法-它將同樣大甚至更大，並且幾乎難以處理。 而且，RDF / XML手工編寫很復雜，而且容易出錯。 調試XSLT將是一場噩夢。

如果您的目標是使數據集更緊湊，更易於處理，則建議您將XML轉換為RDF Turtle或RDF N-Triples語法。 這些是極其簡單，緊湊的基於文本的格式，非常適合流處理，並且任何支持RDF的軟件都可以讀取和寫入這些格式。

您可以使用XSLT，或者如果這樣給您帶來可伸縮性問題，請使用具有一些基本XML支持的任何編程/腳本語言-獲取流XML解析器，並掛接在一個簡單的腳本/程序中，該腳本/程序可以處理解析器輸出並動態創建RDF數據。 或者，由於您輸入的XML是相當規則的結構，您甚至可以完全跳過使用XML解析器，而只是湊在一起幾個正則表達式來讀取數據-無論哪種技術您都最熟悉。

當然，您也可以嘗試使用一些內置了對這種事情的支持的最終用戶工具。 例如，Topbraid Composer開箱即用地具有一些新穎的轉換功能。