Selenium Webdriver - Python - leboncoin (classified) - pb 选择下拉列表和框

Question

I continue my path on the learning curve of Python/Selenium.

Selenium Webdriver - Python - leboncoin - pb to select a button with an accent

After successfully connected to the site, and selecting the button, I would like to populate the fields to submit a classified ad.

At this stage, there are 2 fields I am trying to select, a dropdown list and a box. the Html is the below

Dropdown list

<div class="selectWrapper single">
<select id="category" class="select" name="category">
<option value="0">«Choisissez une catégorie»</option>
<option id="cat71" value="71" style="background-color:#E6E6E6" disabled="">-- EMPLOI --</option>
<option id="cat33" value="33">Offres d'emploi</option>
<option id="cat1" value="1" style="background-color:#E6E6E6" disabled="">-- VEHICULES --</option>
<option id="cat2" value="2">Voitures</option>
<option id="cat3" value="3">Motos</option>
<option id="cat4" value="4">Caravaning</option>
<option id="cat5" value="5">Utilitaires</option>
<option id="cat6" value="6">Equipement Auto</option>
<option id="cat44" value="44">Equipement Moto</option>
<option id="cat50" value="50">Equipement Caravaning</option>
<option id="cat7" value="7">Nautisme</option>
<option id="cat51" value="51">Equipement Nautisme</option>
<option id="cat8" value="8" style="background-color:#E6E6E6" disabled="">-- IMMOBILIER --</option>
<option id="cat9" value="9">Ventes immobilières</option>
<option id="cat10" value="10">Locations</option>
<option id="cat11" value="11">Colocations</option>
<option id="cat13" value="13">Bureaux & Commerces</option>
<option id="cat66" value="66" style="background-color:#E6E6E6" disabled="">-- VACANCES --</option>
<option id="cat12" value="12">Locations & Gîtes</option>
<option id="cat67" value="67">Chambres d'hôtes</option>
<option id="cat68" value="68">Campings</option>
<option id="cat69" value="69">Hôtels</option>
<option id="cat70" value="70">Hébergements insolites</option>
<option id="cat14" value="14" style="background-color:#E6E6E6" disabled="">-- MULTIMEDIA --</option>
<option id="cat15" value="15">Informatique</option>
<option id="cat43" value="43">Consoles & Jeux vidéo</option>
<option id="cat16" value="16">Image & Son</option>
<option id="cat17" value="17">Téléphonie</option>
<option id="cat18" value="18" style="background-color:#E6E6E6" disabled="">-- MAISON --</option>
<option id="cat19" value="19">Ameublement</option>
<option id="cat20" value="20">Electroménager</option>
<option id="cat45" value="45">Arts de la table</option>
<option id="cat39" value="39">Décoration</option>
<option id="cat46" value="46">Linge de maison</option>
<option id="cat21" value="21">Bricolage</option>
<option id="cat52" value="52">Jardinage</option>
<option id="cat22" value="22">Vêtements</option>
<option id="cat53" value="53">Chaussures</option>
<option id="cat47" value="47">Accessoires & Bagagerie</option>
<option id="cat42" value="42">Montres & Bijoux</option>
<option id="cat23" value="23">Equipement bébé</option>
<option id="cat54" value="54">Vêtements bébé</option>
<option id="cat24" value="24" style="background-color:#E6E6E6" disabled="">-- LOISIRS --</option>
<option id="cat25" value="25">DVD / Films</option>
<option id="cat26" value="26">CD / Musique</option>
<option id="cat27" value="27">Livres</option>
<option id="cat28" value="28">Animaux</option>
<option id="cat55" value="55">Vélos</option>
<option id="cat29" value="29">Sports & Hobbies</option>
<option id="cat30" value="30">Instruments de musique</option>
<option id="cat40" value="40">Collection</option>
<option id="cat41" value="41">Jeux & Jouets</option>
<option id="cat48" value="48">Vins & Gastronomie</option>
<option id="cat56" value="56" style="background-color:#E6E6E6" disabled="">-- MATERIEL PROFESSIONNEL --</option>
<option id="cat57" value="57">Matériel Agricole</option>
<option id="cat58" value="58">Transport - Manutention</option>
<option id="cat59" value="59">BTP - Chantier Gros-oeuvre</option>
<option id="cat60" value="60">Outillage - Matériaux 2nd-oeuvre</option>
<option id="cat32" value="32">Équipements Industriels</option>
<option id="cat61" value="61">Restauration - Hôtellerie</option>
<option id="cat62" value="62">Fournitures de Bureau</option>
<option id="cat63" value="63">Commerces & Marchés</option>
<option id="cat64" value="64">Matériel Médical</option>
<option id="cat31" value="31" style="background-color:#E6E6E6" disabled="">-- SERVICES --</option>
<option id="cat34" value="34">Prestations de services</option>
<option id="cat35" value="35">Billetterie</option>
<option id="cat49" value="49">Evénements</option>
<option id="cat36" value="36">Cours particuliers</option>
<option id="cat65" value="65">Covoiturage</option>
<option id="cat37" value="37" style="background-color:#E6E6E6" disabled="">-- -- --</option>
<option id="cat38" value="38">Autres</option>
</select>
</div>
<span class="label-error full " data-for="category"></span>
</div>

Box

<div class="inputWrapper">
<input id="subject" class="nude" name="subject" maxlength="50" value="" type="text">
<span class="unit"></span>
</div>

As there are no accent, It thought I could directly use their tag and the code is the below

Python code:

Select(driver.find_element_by_id("category")).select_by_visible_text("Locations")

driver.find_element_by_id("subject").send_keys("text to insert")

For both, I have an error.

Error message

Traceback (most recent call last):
  File "connectionwebdriver2", line 31, in test_connectionwebdriver2
    driver.find_element_by_xpath("//*[@id='cat10']").click()
  File "/Users/olivierhoen/scrap/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 385, in find_element_by_xpath
    return self.find_element(by=By.XPATH, value=xpath)
  File "/Users/olivierhoen/scrap/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 955, in find_element
    'value': value})['value']
  File "/Users/olivierhoen/scrap/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 312, in execute
    self.error_handler.check_response(response)
  File "/Users/olivierhoen/scrap/lib/python3.6/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.NoSuchElementException: Message: An element could not be located on the page using the given search parameters.

Though I have read different posts and selenium documentation, I am a bit stuck

Thanks in advance for your support

Best,

Full Python code (I have set up specific credential)

# -*- coding: utf-8 -*-
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.keys import Keys
from selenium.webdriver.support.ui import Select
from selenium.webdriver.support.ui import WebDriverWait
from selenium.common.exceptions import NoSuchElementException
from selenium.common.exceptions import NoAlertPresentException
import unittest, time, re

class Connectionwebdriver2(unittest.TestCase):
    def setUp(self):
        self.driver = webdriver.Safari()
        self.driver.maximize_window()
        self.base_urldr = "https://compteperso.leboncoin.fr/account/index.html"
        self.verificationErrors = []
        self.accept_next_alert = True
        self.driver.implicitly_wait(10)

    def test_connectionwebdriver2(self):
        driver = self.driver
        wait = WebDriverWait(driver,10)
        driver.get(self.base_urldr)
        driver.find_element_by_name("st_username").clear()
        driver.find_element_by_name("st_username").send_keys("thecoingood@gmail.com")
        driver.find_element_by_name("st_passwd").clear()
        driver.find_element_by_name("st_passwd").send_keys("thecoingood1")
        driver.find_element_by_id("connect_button").click()
        #driver.get("https://www2.leboncoin.fr/ai?ca=15_s")
        WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//li[@class='deposer']"))).click()
        driver.find_element_by_xpath("//*[@id='cat10']").click()
        driver.find_element_by_xpath("//*[@id='subject']").send_keys("test")
        time.sleep(10)

Answer 1

This should work for you :)

from selenium import webdriver
driver = webdriver.Firefox()
driver.get("https://www.leboncoin.fr/ai/form/0")
driver.find_element_by_xpath("//*[@id='cat10']").click()
driver.find_element_by_xpath("//*[@id='subject']").send_keys("test")

and to find the xpath of an element do this: Gif

Edit: Just did some modifications to your code to test it, and it works perfectly in firefox.

driver = webdriver.Firefox()
driver.maximize_window()
base_urldr = "https://compteperso.leboncoin.fr/account/index.html"
verificationErrors = []
accept_next_alert = True
driver.implicitly_wait(10)

wait = WebDriverWait(driver,10)
driver.get(base_urldr)
driver.find_element_by_name("st_username").clear()
driver.find_element_by_name("st_username").send_keys("thecoingood@gmail.com")
driver.find_element_by_name("st_passwd").clear()
driver.find_element_by_name("st_passwd").send_keys("thecoingood1")
driver.find_element_by_id("connect_button").click()
#driver.get("https://www2.leboncoin.fr/ai?ca=15_s")
WebDriverWait(driver, 20).until(EC.element_to_be_clickable((By.XPATH, "//li[@class='deposer']"))).click()
driver.find_element_by_xpath("//*[@id='cat10']").click()
driver.find_element_by_xpath("//*[@id='subject']").send_keys("test")
time.sleep(10)