+
Skip to content

[Bug]: LoRA微调时报错:--deepspeed: invalid dict value #311

@yt7589

Description

@yt7589

Is there an existing issue ? / 是否已有相关的 issue ?

  • I have searched, and there is no existing issue. / 我已经搜索过了,没有相关的 issue。

Describe the bug / 描述这个 bug

我运行LoRA微调命令:bash ./lora_finetune_ocnli.sh,报错:
finetune.py: error: argument --deepspeed: invalid dict value: 'configs/ds_config_zero3_offload.json'

To Reproduce / 如何复现

复现步骤:

cd MiniCPM/finetune
conda activate cpm # cpm是我为MiniCPM创建的虚拟环境
# 我已经运行此目录下pip install -r requirements.txt
bash ./lora_finetune_ocnli.sh

报如下错误:

finetune.py: error: argument --deepspeed: invalid dict value: 'configs/ds_config_zero3_offload.json'

注:我看了funetune.py文件,里面没有定义--deepspeed命令行参数。

Expected behavior / 期望的结果

可以正确启动LoRA微调过程

Screenshots / 截图

Image

Environment / 环境

- OS: [Ubuntu 22.04]
- Pytorch: [torch 2.7.1-cu126]
- CUDA: [CUDA 12.4]
- Device: [ A100 40G 4块]

Additional context / 其他信息

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载