解析Google搜索響應Json Python請求。 正則表達式多行

Question

我想將原始響應轉換為有效的JSON，我可以這樣做，但是有點草率。

這是原始回復：

// API callback
google.search.Search.apiary2387({
 "cursor": {
  "currentPageIndex": 0,
  "estimatedResultCount": "4490",
  "moreResultsUrl": "http://www.google.com/cse?oe=utf8&ie=utf8&source=uds&q=ssh&start=0&sort=&cx=013305635491195529773:0ufpuq-fpt0",
  "resultCount": "4,490",
  "searchResultTime": "0.22",
  "pages": [
   {
    "label": 1,
    "start": "0"
   },
   {
    "label": 2,
    "start": "1"
   },
   {
    "label": 3,
    "start": "2"
   },
   {
    "label": 4,
    "start": "3"
   },
   {
    "label": 5,
    "start": "4"
   },
   {
    "label": 6,
    "start": "5"
   },
   {
    "label": 7,
    "start": "6"
   },
   {
    "label": 8,
    "start": "7"
   },
   {
    "label": 9,
    "start": "8"
   },
   {
    "label": 10,
    "start": "9"
   }
  ]
 },
 "context": {
  "title": "Pastebin Active",
  "total_results": "0",
  "facets": []
 },
 "results": [
  {
   "GsearchResultClass": "GwebSearch",
   "cacheUrl": "http://www.google.com/search?q=cache:PBL2A25kpZoJ:pastebin.com",
   "clicktrackUrl": "https://www.google.com/url?q=http://pastebin.com/u/ssh&sa=U&ved=0ahUKEwiO4fjNpovMAhWBPxoKHYJXAS4QFggEMAA&client=internal-uds-cse&usg=AFQjCNHczEhDXdcUnRZhpArEeSiHfjwMJA",
   "content": "BitBucket - Backup your code in the cloud! Host unlimited private projects, for free\n. SIGN UP takes 10 seconds, and it's free! Guest ...",
   "contentNoFormatting": "BitBucket - Backup your code in the cloud! Host unlimited private projects, for free\n. SIGN UP takes 10 seconds, and it's free! Guest ...",
   "formattedUrl": "pastebin.com/u/\u003cb\u003essh\u003c/b\u003e",
   "title": "\u003cb\u003eSsh's\u003c/b\u003e Pastebin - Pastebin.com",
   "titleNoFormatting": "Ssh's Pastebin - Pastebin.com",
   "unescapedUrl": "http://pastebin.com/u/ssh",
   "url": "http://pastebin.com/u/ssh",
   "visibleUrl": "pastebin.com",
   "richSnippet": {
    "cseImage": {
     "src": "http://pastebin.com/i/facebook.png"
    },
    "metatags": {
     "fbAppId": "231493360234820",
     "ogTitle": "Ssh's Pastebin - Pastebin.com",
     "ogType": "article",
     "ogUrl": "http://pastebin.com/u/ssh",
     "ogImage": "http://pastebin.com/i/facebook.png",
     "ogSiteName": "Pastebin",
     "viewport": "width=device-width, maximum-scale=1.0, user-scalable=no"
    }
   }
  }
 ]
}
);

為了提取有效的JSON，我必須刪除JavaScript調用，所以我刪除了所有內容，直到第一個(並且最后刪除了) 。

我認為這是可行的：

import requests
import re
import json

url = 'https://www.googleapis.com/customsearch/v1element?key=AIzaSyCVAXiUzRYsML1Pv6RwSG1gunmMikTzQqY&rsz=filtered_cse&num=1&hl=en&prettyPrint=true&source=gcsc&gss=.com&sig=432dd570d1a386253361f581254f9ca1&start=0&cx=013305635491195529773:0ufpuq-fpt0&q=ssh&sort=&googlehost=www.google.com&callback=google.search.Search.apiary2387'

resp = requests.get(url)

content = resp.content

formatted = re.sub(r'(.*\(|\);$)','', content , re.I|re.M|re.DOTALL)

formatted_json = json.loads(formatted)
for i, result in enumerate(formatted_json['results']):
    print formatted_json['results'][i]['url']

這是我必須添加才能使其工作的內容：

formatted = re.sub(r'// API callback', '', content)

我不知道為什么，因為我將刪除所有內容，直到找到( ，如果使用標志re.M ，為什么它不適用於所有行？

您可以看到(r'(.*\\(|\\);$)','', content , re.DOTALL)應該可以工作：

https://regex101.com/r/uN2wV4/3

（選項/s表示.也是\\n像DOTALL ）

Answer 1

我創建了以下regex ：

(\{(?:.|\n)*\})

而不是替換，而是使內容在左括號和右括號之間。

因此，您可以將其與re.search結合使用以獲取所需的內容：

formatted = re.search(r'(\{(?:.|\n)*\})', content).group()

---

更新：使用re.DOTALL

re.DOTALL等效於/s修飾符（更新了regex ）：

formatted = re.search(r'(\{.*\})', content, re.DOTALL).group()

Answer 2

最簡單的方法：只需從請求中刪除此參數：

callback=google.search.Search.apiary2387

響應是有效的Json。