这是indexloc提供的服务,不要输入任何密码
Skip to content

How to design prompts when training multiple images together? #92

@wilxy

Description

@wilxy

Hi, thank you for the great work!

When training a single image, the prompt is generally designed as:
{'content': '<image>\nThe question.\nThink first, call image_zoom_in_tool if needed, then answer. Format strictly ... ', 'role': 'user'}

How to design prompts when training multiple images together?
Specifically, images in multi_modal_data["image"] are more than one. Does the prompt need to be changed to:
{'content': '<image><image>\nThe question.\nThink first, call image_zoom_in_tool if needed, then answer. Format strictly ... ', 'role': 'user'}
And how to tell the order of images?

Thanks again for your excellent work!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions