堆栈内存溢出
  繁体   English   中英

比较两个 JSON 文件并仅使用 jq/bash 保持匹配

[英]Compare two JSON files and keep only matching using jq/bash

 原文  2023-01-02 00:56:54  5   1    json/ bash/ inner-join/ jq

问题描述

我有两个文件（我只复制了其中的一小部分，因为它们相当大）：

_titles2.txt：（小样本）

{
  "titleId": "0100000000010800"
}
{
  "titleId": "010000000EEF0800"
}
{
  "titleId": "0100000011D90800"
}
{
  "titleId": "010000001260E800"
}
{
  "titleId": "01000000160F6800"
}
{
  "titleId": "010000100C4B8800"
}

titles.json（同样只是一个小样本）

{
    "1": {
        "bannerUrl": null,
        "category": null,
        "description": null,
        "developer": null,
        "frontBoxArt": null,
        "iconUrl": null,
        "id": "0100000000000816",
        "intro": null,
        "isDemo": null,
        "key": null,
        "languages": null,
        "name": null,
        "nsuId": null,
        "numberOfPlayers": null,
        "publisher": null,
        "rank": 34342,
        "rating": null,
        "ratingContent": null,
        "region": null,
        "regions": null,
        "releaseDate": null,
        "rightsId": null,
        "screenshots": null,
        "size": 0,
        "version": null
    },
    "2": {
        "bannerUrl": "https://img-eshop.cdn.nintendo.net/i/c42553b4fd0312c31e70ec7468c6c9bccd739f340152925b9600631f2d29f8b5.jpg",
        "category": [
            "Platformer",
            "Action"
        ],
        "description": "Explore incredible places far from the Mushroom Kingdom as you join Mario and his new ally Cappy on a massive, globe-trotting 3D adventure. Use amazing new abilities\u2014like the power to capture and control objects, animals, and enemies\u2014to collect Power Moons so you can power up the Odyssey airship and save Princess Peach from Bowser\u2019s wedding plans!\n\nThanks to heroic, hat-shaped Cappy, Mario\u2019s got new moves that\u2019ll make you rethink his traditional run-and-jump gameplay\u2014like cap jump, cap throw, and capture. Use captured cohorts such as enemies, objects, and animals to progress through the game and uncover loads of hidden collectibles. And if you feel like playing with a friend, just pass them a Joy-Con\u2122 controller! Player 1 controls Mario while Player 2 controls Cappy. This sandbox-style 3D Mario adventure\u2014the first since 1996\u2019s beloved Super Mario 64\u2122 and 2002\u2019s Nintendo GameCube\u2122 classic Super Mario Sunshine\u2122\u2014is packed with secrets and surprises, plus exciting new kingdoms to explore.",
        "developer": null,
        "frontBoxArt": null,
        "iconUrl": "https://img-eshop.cdn.nintendo.net/i/ad4d31f664a1ce704f0219da2805f8459595bc3c01c3f04df2e32ba34a05b8c6.jpg",
        "id": "0100000000010000",
        "intro": "Embark on a cap-tivating, globe-trotting adventure",
        "isDemo": false,
        "key": null,
        "language": "en",
        "languages": [
            "ja",
            "en",
            "es",
            "fr",
            "de",
            "it",
            "nl",
            "ru",
            "zh",
            "zh"
        ],
        "name": "Super Mario Odyssey\u2122",
        "nsuId": 70010000001130,
        "numberOfPlayers": 2,
        "publisher": "Nintendo",
        "rank": 2,
        "rating": 10,
        "ratingContent": [
            "Cartoon Violence",
            "Comic Mischief"
        ],
        "region": "US",
        "regions": [
            "CO",
            "AR",
            "CL",
            "PE",
            "KR",
            "HK",
            "NZ",
            "BE",
            "CZ",
            "DK",
            "ES",
            "FI",
            "HU",
            "NL",
            "PL",
            "RU",
            "ZA",
            "MX",
            "CA",
            "FR",
            "DE",
            "JP",
            "AU",
            "GB",
            "US"
        ],
        "releaseDate": 20171027,
        "rightsId": "01000000000100000000000000000003",
        "screenshots": [
            "https://img-eshop.cdn.nintendo.net/i/c497547957d9dd3668e891aa97ff4899a3f40bd1bd430020f8cbdf673f02bdeb.jpg",
            "https://img-eshop.cdn.nintendo.net/i/1839d571921e3fb19ef48da64c145cb8ce573b07d7390c6350f15291b3905048.jpg",
            "https://img-eshop.cdn.nintendo.net/i/d0510e4804381287c64dc3ab374ae9273419e263e9a732e72af3b39cd70f2b5f.jpg",
            "https://img-eshop.cdn.nintendo.net/i/ab713d841b0f0d9bbce38b589d75dd3bba2aef005418e59d3f0fd95389ae7016.jpg",
            "https://img-eshop.cdn.nintendo.net/i/abcf9708cc28ef5b7ab412aa17fafe4ad181f0b957456ffd9b83de2561d9f62a.jpg",
            "https://img-eshop.cdn.nintendo.net/i/7db70ecd883f94d935f65b9f4454b8151b6f8be7c4be95543e87488e48e5a6b9.jpg"
        ],
        "size": 6026166272,
        "version": 0
    },
    "3": {
        "bannerUrl": null,
        "category": null,
        "description": null,
        "developer": null,
        "frontBoxArt": null,
        "iconUrl": null,
        "id": "0100000000010800",
        "intro": null,
        "isDemo": null,
        "key": null,
        "languages": null,
        "name": null,
        "nsuId": null,
        "numberOfPlayers": null,
        "publisher": null,
        "rank": 34341,
        "rating": null,
        "ratingContent": null,
        "region": null,
        "regions": null,
        "releaseDate": null,
        "rightsId": null,
        "screenshots": null,
        "size": 0,
        "version": 262144
    },
    "4": {
        "bannerUrl": null,
        "category": null,
        "description": null,
        "developer": null,
        "frontBoxArt": null,
        "iconUrl": null,
        "id": "010000000E5EE000",
        "intro": null,
        "isDemo": null,
        "key": null,
        "languages": null,
        "name": null,
        "nsuId": null,
        "numberOfPlayers": null,
        "publisher": null,
        "rank": 34340,
        "rating": null,
        "ratingContent": null,
        "region": null,
        "regions": null,
        "releaseDate": null,
        "rightsId": null,
        "screenshots": null,
        "size": 0,
        "version": 0
    },
    "5": {
        "bannerUrl": "https://img-eshop.cdn.nintendo.net/i/74dbbc2f5dd60e8c671a0c0a1ad18034e80e26375589765e90449ea4b5e15739.jpg",
        "category": [
            "Adventure",
            "Action",
            "Simulation"
        ],
        "description": "Explore a darkened office complex and uncover the truth behind the horrifying events that have befallen its inhabitants.\nPlay as one of two characters with unique storylines, monster encounters, and gameplay challenges. \nNavigate a multi-story maze that grows scarier, harder, and more twisted as you struggle to escape the madness.",
        "developer": null,
        "frontBoxArt": null,
        "iconUrl": "https://img-eshop.cdn.nintendo.net/i/4699a0d5b05a057a5d20c252d2d46a7eec5d41cfd46eb33e4e87b6247b3f7486.jpg",
        "id": "010000000EEF0000",
        "intro": "Shadows 2: Perfidia is a survival horror game inspired by classics like the Penumbra series and Layers of Fear.",
        "isDemo": false,
        "key": null,
        "language": "en",
        "languages": [
            "en"
        ],
        "name": "Shadows 2: Perfidia",
        "nsuId": 70010000021900,
        "numberOfPlayers": 1,
        "publisher": "Ultimate Games",
        "rank": 2963,
        "rating": 17,
        "ratingContent": [
            "Blood and Gore",
            "Intense Violence",
            "Nudity",
            "Sexual Content",
            "Strong Language"
        ],
        "region": "US",
        "regions": [
            "BE",
            "CZ",
            "DK",
            "ES",
            "FI",
            "HU",
            "NL",
            "PL",
            "RU",
            "ZA",
            "MX",
            "CA",
            "FR",
            "DE",
            "AU",
            "GB",
            "US"
        ],
        "releaseDate": 20190806,
        "rightsId": null,
        "screenshots": [
            "https://img-eshop.cdn.nintendo.net/i/a40b9ad80b4d6ab05c2ebc5dbf16484e4074a3a2b32b1ca15505dde5d56ebdd5.jpg",
            "https://img-eshop.cdn.nintendo.net/i/4cd32eaf41ee287b4e9854646598c5b2feaf405d431977cf8f5002ef5a3fa428.jpg",
            "https://img-eshop.cdn.nintendo.net/i/e2547655c002df78f573e1a79afd39dc70defce4d7e33fb3b68820fb5468d89d.jpg",
            "https://img-eshop.cdn.nintendo.net/i/85d23d86660204f1f6fb14feece746e12860ce26944cff47ca407b53e8f2c686.jpg",
            "https://img-eshop.cdn.nintendo.net/i/e499c7e25643ed0366cfdcff9c14da9cc5a528f841aba9be7188b531ef2fe219.jpg",
            "https://img-eshop.cdn.nintendo.net/i/6b36b07122f2a4b8ac34df656159ce2e4020a6c19c06f8cdcafc221c9b4b5598.jpg"
        ],
        "size": 2687500288,
        "version": 0
    },

使用 jq，我想测试 _titles2.txt 中的每个对象 'titleId' 是否作为 'id' 存在于 titles.json 中。 如果它确实存在，我希望创建第三个 json 文件，其中包含所有已完成的“匹配项”。

我能够用一个“titleId”来做到这一点，但似乎无法弄清楚如何为整个文件做这件事（除了做一个巨大的 for 循环并单独测试每个）

希望有人可以帮助解决这个问题。 谢谢你。

感谢高峰的回答！ 完美运行并在大约 15 秒内完成搜索！

我希望你能帮我修改这个命令？ 我有完全相同的任务要做，有两个与 _titles2.txt 格式相同的文件（大写字母除外）

_titles3.txt

  {
    "TITLEID": "0100000000010000"
  }
  {
    "TITLEID": "0100000000010800"
  }
  {
    "TITLEID": "010000000E5EE000"
  }
  {
    "TITLEID": "010000000EEF0000"
  }
  {
    "TITLEID": "010000000EEF0800"
  }

回顾一下——使用 jq，我想测试 _titles2.txt 中的每个对象“titleId”是否作为“TITTLEID”存在于 _titles3.txt 中。 如果它确实存在，我希望创建第三个 json 文件，其中包含所有已完成的“匹配项”。 （相同的结果，但我在让命令工作时遇到问题，因为它不再是一个大的 object - 我也无法控制数据，所以我无法控制我得到的东西）

1 个解决方案

解决方案1
 5 已采纳  2023-01-02 02:07:24

如果我正确地理解了这个问题，则无需多次调用 jq 或编写 shell 循环。

例如，如果您的目标是生成单个 JSON object，您可以使用以下命令生成 go：

< titles.json jq --slurpfile titleIds _titles2.txt '
  INDEX($titleIds[]; .titleId) as $dict
  | with_entries( select($dict[.value.id]))
'

——

对于后续问题：您可以通过调用 INDEX 来处理这两种情况，如下所示：

INDEX($titleIds[]; .titleId//.TITLEID)

暂无
暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 使用jq或bash中的任何其他工具比较两个json文件 在bash中使用jq合并两个JSON文件 使用 jq + bash 将 json 转换为 ini 文件 使用JQ合并两个嵌套的JSON文件 使用 JQ 合并两个 Json 文件 使用 jq 或替代命令行工具比较 JSON 文件 在bash中使用jq更改json 使用 BASH 和 JQ 我想将 json 文件与 bash 数组进行比较 两个json文件的输出对象，带有两个使用jq的过滤器 用 jq 合并两个 json 文件
相关标签
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM