如何从文本文件中的 url 检索 json 文件

Question

I have to check the json data from an url using curl curl -H "User-agent: 'your bot 0.1'" url.json | jq curl -H "User-agent: 'your bot 0.1'" url.json | jq this code is working

i wanted try this for a.txt file containing 200 url like these

https://www.reddit.com/user/wanderer_007_.json

https://www.reddit.com/... .

https://www.reddit.com/... .

https://www.reddit.com/... .

https://www.reddit.com/... .

these are just examples. but whenever I give the text file as an input

#!/usr/bin/bash

while read -r line; do
    name="$line"
   curl -H "User-agent: 'your bot 0.1'" $name | jq 
done < test001.txt


curl: (3) URL using bad/illegal format or missing URL
curl: (3) URL using bad/illegal format or missing URL
curl: (3) URL using bad/illegal format or missing URL
curl: (3) URL using bad/illegal format or missing URL
curl: (3) URL using bad/illegal format or missing URL

but if I try to use the url individually it is working as intended

Answer 1

Try to wrap the filename in curl command with double quotes:

curl -H "User-agent: 'your bot 0.1'" "$name" | jq

The error may be due to Bash interpreting some wierd characters in URLs specially. For example space in the URL may cause $name to split into 2 command-line arguments making curl unable to parse its inputs.