DVC：从云端拉取数据失败

Question

我正在尝试为我的 ml model 实施 CI/CD，我正在为此使用 DVC。 这是我的 yaml 文件`

name: train-model
on:
  push:
    paths:
      - "data/**"
      - "src/**"
      - "params.yaml"
      - "dvc.*"
jobs:
  train-model:
    runs-on: ubuntu-latest
    environment: cloud
    permissions:
      contents: read
      id-token: write
    steps:
      - uses: actions/checkout@v3
        with:
          ref: ${{ github.event.pull_request.head.sha }}
      - uses: iterative/setup-cml@v1
      - uses: actions/setup-python@v2
        with:
          python-version: "3.9"
      - name: SetupGitUser
        run: cml ci
        env:
          REPO_TOKEN: ${{ secrets.PERSONAL_ACCESS_TOKEN }}
      - name: TrainModel
        env:
          REPO_TOKEN: ${{ secrets.PERSONAL_ACCESS_TOKEN }}
        run: |
          pip install -r requirements.txt
          dvc pull
          dvc repro
          dvc push`

但是我不断收到此错误

ERROR: failed to pull data from the cloud - Checkout failed for following targets:
785
/home/runner/work/open-source-mlops-e2e/open-source-mlops-e2e/data/raw
786
/home/runner/work/open-source-mlops-e2e/open-source-mlops-e2e/data/processed
787
/home/runner/work/open-source-mlops-e2e/open-source-mlops-e2e/models/clf-model.joblib
788
Is your cache up to date?
789
<https://error.dvc.org/missing-files>
790
Error: Process completed with exit code 1.

当我做 dvc pull -v 它工作正常 -

2023-01-27 15:11:16,824 DEBUG: Preparing to transfer data from '/workspace/open-source-mlops-e2e/dvc' to '/workspace/open-source-mlops-e2e/.dvc/cache'
2023-01-27 15:11:16,825 DEBUG: Preparing to collect status from '/workspace/open-source-mlops-e2e/.dvc/cache'
2023-01-27 15:11:16,825 DEBUG: Collecting status from '/workspace/open-source-mlops-e2e/.dvc/cache'
2023-01-27 15:11:16,841 DEBUG: built tree 'object 6920135c1a76a56a030a224fb82afb28.dir'                                                                         
2023-01-27 15:11:16,893 DEBUG: built tree 'object 9f384869826bdf146e6ff572c85d0d1e.dir'                                                                         
Everything is up to date.                                                                                                                                       
2023-01-27 15:11:16,900 DEBUG: Analytics is enabled.
2023-01-27 15:11:16,958 DEBUG: Trying to spawn '['daemon', '-q', 'analytics', '/tmp/tmp03jb3nq0']'
2023-01-27 15:11:16,959 DEBUG: Spawned '['daemon', '-q', 'analytics', '/tmp/tmp03jb3nq0']'

我的数据存储在我自己的 gitpod 实例中，所以我不确定为什么它不起作用

[core]
    remote = myremote
['remote "myremote"']
    url = /workspace/open-source-mlops-e2e/dvc

谁能提出任何建议？

当我执行 dvc pull -v 它工作正常 -- 2023-01-27 15:11:16,824 DEBUG: 准备将数据从 '/workspace/open-source-mlops-e2e/dvc' 传输到 '/workspace/open- source-mlops-e2e/.dvc/cache' 2023-01-27 15:11:16,825 DEBUG：准备从'/workspace/open-source-mlops-e2e/.dvc/cache' 2023-01-27 收集状态15:11:16,825 调试：从“/workspace/open-source-mlops-e2e/.dvc/cache”收集状态 2023-01-27 15:11:16,841 调试：构建树“对象 6920135c1a76a56a030a224fb82afb28.dir”
2023-01-27 15:11:16,893 调试：构建树“对象 9f384869826bdf146e6ff572c85d0d1e.dir”
一切都是最新的。
2023-01-27 15:11:16,900 DEBUG：启用分析。 2023-01-27 15:11:16,958 调试：尝试生成“['daemon'、'-q'、'analytics'、'/tmp/tmp03jb3nq0']' 2023-01-27 15:11:16,959 调试：生成'['daemon', '-q', 'analytics', '/tmp/tmp03jb3nq0']'

我的数据存储在我自己的 gitpod 实例中，所以我不确定为什么它不起作用任何人都可以提出任何建议吗？

Answer 1

ERROR: failed to pull data from the cloud - Checkout failed for following targets

这意味着无法在配置的远程 ( url = /workspace/open-source-mlops-e2e/dvc ) 上找到数据。 您确定数据已推送到给定位置的gitpod实例吗？

通常你需要先dvc add...数据，可能运行dvc repro ，然后dvc push送到配置的远程（ /workspace/... ），然后你就可以拉它了。