繁体   English   中英

跳过错误并在循环中遇到3个错误后继续运行-从Pandas获取价格数据

[英]skip the error and continue to run after getting 3 errors in a loop - Getting Price data from Pandas

我正在创建一个循环来迭代一个函数。 该功能只是通过代码列表从yahoo财务获取数据。 但是,某些报价器在yahoo财务中没有数据,有时还存在错误,因此,每当出现此错误时,我都需要重新运行该函数。

基本上,重新运行可以解决该错误,但如果数据库中没有数据,则无济于事。 因此,我想使用一个循环来定义是否有错误,然后重新运行,但是如果该代码出现3次错误,则跳过该代码。

我认为我在循环中做错了什么,它没有通过该报价器,并且即使该报价器已经出错了3次以上,它仍在重新运行。 我可以知道如何解决吗?

谢谢!

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
import pickle
import datetime as dt
import os
import pandas as pd
import pandas_datareader.data as web

def save_hsci_tickers():
    driver = webdriver.Chrome(r"C:/Users/kman/Downloads/chromedriver_win32/chromedriver.exe")
    wait = WebDriverWait(driver, 10)
    driver.get("https://www.hsi.com.hk/HSI-Net/HSI-Net?cmd=tab&pageId=en.indexes.hscis.hsci.constituents&expire=false&lang=en&tabs.current=en.indexes.hscis.hsci.overview_des%5Een.indexes.hscis.hsci.constituents&retry=false")
    tickers = []
    for name in wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR, "table.greygeneraltxt td.greygeneraltxt,td.lightbluebg"))):
        data = str(name.get_attribute('textContent'))
        tickers.append(data)
    edit = [x for x in tickers if x != '']
    final = edit[::2]
    driver.quit()

    def yahoo_ticker(data):
        if len(data) <= 4:
            return data.zfill(4) + '.HK'
        else:
            return data[0:] + '.HK'
    yahoo_tickers = [yahoo_ticker(data) for data in final]
    with open("hscitickers.pickle","wb") as f:
        pickle.dump(yahoo_tickers, f)

    print(yahoo_tickers)
    return yahoo_tickers

save_hsci_tickers()

def get_data_from_yahoo (reload_hscitickers=False):
    if reload_hscitickers:
        tickers = save_hsci_tickers()
    else:
        with open("hscitickers.pickle","rb") as f:
            tickers = pickle.load(f)

    if not os.path.exists('stock_dfs'):
        os.makedirs('stock_dfs')

    start = dt.datetime(2009,6,30)
    end = dt.datetime(2017,6,30)

    for ticker in tickers:
        print(ticker)
        if not os.path.exists('stock_dfs/{}.csv'.format(ticker)):
            df =web.DataReader(ticker,'yahoo',start,end)
            df.to_csv('stock_dfs/{}.csv'.format(ticker))
        else:
            print('Already have {}'.format(ticker))

attempts = 0
while True:
    try:
        get_data_from_yahoo()
    except:
        if attempts < 3:
            attempts += 1
            continue
        if attempts >= 3:
            pass
    else:
        break

您必须在while循环之外定义变量尝试,以使其起作用。

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM