[英]Use Loguru logging library to log requests made in an imported file
所以我在 python 文件 (main.py) 中編寫了程序,該文件使用 api 包裝文件 (bluerev.py) 中的類。 我想使用 main.py 中的 loguru 記錄器來收集程序中的所有異常 + 在 api 包裝器中發出的所有請求。 所以 bluerev.py api 包裝器中設置的日志記錄如下所示:
import logging
#Logging setup
logger = logging.getLogger(__name__)
logger.addHandler(logging.NullHandler())
class BluerevApiRequestHandler:
def __init__(self):
self.date_str_format = "%Y-%m-%dT%H:%M:%S.%f"
@staticmethod
def setup_logger_for_requests():
"""
Sets up the requests library to log api requests
"""
logger.setLevel(logging.DEBUG)
requests_log = logging.getLogger("requests.packages.urllib3")
requests_log.setLevel(logging.DEBUG)
requests_log.propagate = True
main.py 日志記錄代碼如下所示:
from blurev import *
from loguru import logger
#more imports and code
@logger.catch
def main():
# associated file and credential locations
gmail_creds_file = "gmail_creds.json"
revu_creds_file = r"revu_credentials.json"
token_file = r"revu_refresh_token.json"
files_location = os.path.join(os.getcwd(), "rev_dist_files")
review_files_location = os.path.join(os.getcwd(), "files_to_distribute")
# Set up Logging
logging_file = r"plan_review_distributor.log"
#logging_format_str = "%(levelname)s - %(asctime)-15s - %(filename)s - line %(lineno)d --> %(message)s"
logger.add(os.path.join(files_location, logging_file), level="WARNING")
logger.add(os.path.join(files_location, logging_file), filter="blurev", level="DEBUG")
#call the requests logging function here in main()
request_handler = BluerevApiRequestHandler()
request_handler.setup_logger_for_requests()
#more code
所以我想知道這應該如何改變,以便通過 main.py 中的函數和代碼在 blurev.py 文件中調用的請求被記錄到 logging_file 中。 現在他們不是。
問題是loguru
使用與經典logging
庫完全不同的日志記錄機制。 經典的logging
庫構建了一個層次結構的記錄器,並且日志記錄傳播到根目錄(參見 Python 文檔中的高級日志教程以供參考)。 但是loguru
根本不使用這種層次結構,它的運作方式與它完全脫節。
因此,如果您希望使用經典logging
庫發出的日志最終由loguru
處理,則必須攔截它們。
這是我的解決方案的最小可重現示例:
# main.py
import logging as classic_logging
import os
from blurev import BluerevApiRequestHandler
from loguru import logger as loguru_logger
@loguru_logger.catch
def main():
logging_file = r"plan_review_distributor.log"
loguru_logger.add(os.path.join(".", logging_file), filter=lambda rec: rec["name"] != "blurev", level="WARNING")
loguru_logger.add(os.path.join(".", logging_file), filter="blurev", level="DEBUG")
root_logger = classic_logging.getLogger("")
root_logger.handlers = [InterceptHandler()] # replace ANY pre-existing handler
root_logger.setLevel("DEBUG")
request_handler = BluerevApiRequestHandler()
request_handler.do_something_using_requests()
########################################################################################################################
# recipe from https://loguru.readthedocs.io/en/stable/overview.html#entirely-compatible-with-standard-logging
class InterceptHandler(classic_logging.Handler):
def emit(self, record):
# Get corresponding Loguru level if it exists
try:
level = loguru_logger.level(record.levelname).name
except ValueError:
level = record.levelno
# Find caller from where originated the logged message
frame, depth = classic_logging.currentframe(), 2
while frame.f_code.co_filename == classic_logging.__file__:
frame = frame.f_back
depth += 1
loguru_logger.opt(depth=depth, exception=record.exc_info).log(level, record.getMessage())
########################################################################################################################
if __name__ == "__main__":
main()
# bluerev.py
import logging as classic_logging
import requests
bluerev_logger = classic_logging.getLogger(__name__)
class BluerevApiRequestHandler:
def do_something_using_requests(self):
print(requests.get("http://example.com").text.splitlines()[3]) # expecting: " <title>Example Domain</title>"
classic_logging.getLogger("requests.packages.urllib3").warning("warning from requests") # simulating
bluerev_logger.debug("debug from bluerev")
bluerev_logger.critical("critical from bluerev")
這個想法是為經典的根記錄器添加一個處理程序,它將日志記錄傳輸到 loguru 記錄器。 我們不需要setup_logger_for_requests
,我們只是讓日志記錄自然地從"requests.packages.urllib3"
向上傳播。
我在第一個loguru
器中添加了一個過濾器,這樣"blurev"
日志記錄就不會被兩次寫入文件(因為被兩個接收器捕獲)。
這是我得到的 output:
# stdout
2022-01-07 11:58:02.480 | DEBUG | urllib3.connectionpool:_new_conn:227 - Starting new HTTP connection (1): example.com:80
2022-01-07 11:58:02.653 | DEBUG | urllib3.connectionpool:_make_request:452 - http://example.com:80 "GET / HTTP/1.1" 200 648
2022-01-07 11:58:02.654 | WARNING | blurev:do_something_using_requests:14 - warning from requests
2022-01-07 11:58:02.654 | DEBUG | blurev:do_something_using_requests:15 - debug from bluerev
2022-01-07 11:58:02.654 | CRITICAL | blurev:do_something_using_requests:16 - critical from bluerev
<title>Example Domain</title>
# plan_review_distributor.log
2022-01-07 11:58:02.654 | WARNING | blurev:do_something_using_requests:14 - warning from requests
2022-01-07 11:58:02.654 | DEBUG | blurev:do_something_using_requests:15 - debug from bluerev
2022-01-07 11:58:02.654 | CRITICAL | blurev:do_something_using_requests:16 - critical from bluerev
請參閱Loguru 的文檔部分“與標准日志記錄完全兼容” 。
此外,您有時會寫“bluerev”,有時會寫“bluerev”,請小心!
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.