How to use utf-8 characters in dryscrape in Python?

Question

I need use utf-8 characters in set dryscrape method. But after run show this error:

UnicodeEncodeError: 'ascii' codec can't encode characters in position 0-4: ordinal not in range(128)

My code (for example):

site = dryscrape.Session()
site.visit("https://www.website.com")
search = site.at_xpath('//*[@name="search"]')
search.set(u'فارسی')
search.form().submit()

Also u'فارسی' change to search.set(unicode('فارسی', 'utf-8')) , But show this error.

Answer 1

Its very easy... This method working perfectly with google. Also try with any other if you know the url prams

import dryscrape as d
d.start_xvfb()
br = d.Session()
import urllib.parse
query = urllib.parse.quote("فارسی")
print(query)  #it prints : '%D9%81%D8%A7%D8%B1%D8%B3%DB%8C'
Url = "http://google.com/search?q="+query
br.visit(Url)
print(br.xpath('//title')[0].text())
#it prints : Google Search - فارسی
#You can also check it with br.render("url_screenshot.png")