这是indexloc提供的服务，不要输入任何密码
Skip to content

Assistant Message and image_url #44

New issue
New issue
Closed
Closed
Assistant Message and image_url#44
@chrisetheridge

Description

@chrisetheridge
chrisetheridge
opened on Jun 26, 2024

When using this code:

openai4j/service/src/test/java/com/theokanning/openai/service/assistants/AssistantImageTest.java

Lines 64 to 87 in 61fa82c

Run run = service.createThreadAndRun(CreateThreadAndRunRequest.builder()
.assistantId(assistantId)
.thread(ThreadRequest.builder()
.messages(Collections.singletonList(
MessageRequest.builder()
.content(Arrays.asList(
new ImageContent("这个图片里面描述了什么?"),
new ImageContent(new ImageUrl("https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg"))
))
.build()))
.build())
.build());
threadId= run.getThreadId();
Run retrievedRun = service.retrieveRun(run.getThreadId(), run.getId());
while (!(retrievedRun.getStatus().equals("completed"))
&& !(retrievedRun.getStatus().equals("failed"))
&& !(retrievedRun.getStatus().equals("expired"))
&& !(retrievedRun.getStatus().equals("incomplete"))
&& !(retrievedRun.getStatus().equals("requires_action"))) {
retrievedRun = service.retrieveRun(threadId, run.getId());
}
OpenAiResponse<Message> response = service.listMessages(threadId, MessageListSearchParameters.builder().runId(retrievedRun.getId()).build());
List<Message> data = response.getData();
assertTrue(!data.isEmpty());

The messages returned from listMessages don't have an ImageUrl object. They only have a MessageContent object with type image_url but no image_url. The Assistant Playground does show that this data is returned from the API when listing thread messages.

Is it possibly because the messages returned from the Threads API are being coerced to Assistant MessageContent which doesn't cater for image_url?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions