OSError: [WinError 123] 当我创建 kfp 组件时

Question

I'm trying to create a pipeline in Vertex AI with kfp using my own components from local notebook in Spyder.

When I run the following piece of code:

@component(base_image="python:3.9", packages_to_install=["pandas"])
def create_dataset(
    gcs_csv_path_train: str,
    dataset: Output[Dataset],
):
    import pandas as pd
    df = pd.read_csv(gcs_csv_path_train)
    dataset = df.pop('Class')

I get the following error:

OSError: [WinError 123] The filename, directory name, or volume label syntax is incorrect: '<ipython-input-11-b28c15ec667f>'

The error is not raised if I use a Jupyter notebook online.

What am I doing wrong? Thanks.

Answer 1

You need to check the file path that you use in your code. Because there are some characters that are not accepted such as the colon “ : ” in Windows file names. You can see more documentation about Windows standar paths.

When using the path in the python code, please follow below:

• Use 'r' before any path- The r is a string literal that lets treat any string as a raw string, which means all escape codes will be ignored.
• Use either double quotes “file-path” or single quote 'file-path' to specify the path.
• Don't use a combination of both “” or '

Correct file path is as below

filepath = r'C:\Test\file\file-input-thecodebuzz.txt'

OR

filepath = r"C:\Test\file\file-input-thecodebuzz.txt"

You can see more documentation .