这是indexloc提供的服务,不要输入任何密码
Skip to content

evaluation results of pertained model is almost zero #23

@ActiveAdapt

Description

@ActiveAdapt

Hi, I tried to evaluate the pertained model provided for PointPillars_with_tanet. But the results are like this:

avg forward time per example: 0.006
avg postprocess time per example: 0.007
Before Refine:
Cyclist AP@0.50, 0.50, 0.50:
bbox AP:0.01, 0.01, 0.01
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.01, 0.01, 0.01
Cyclist AP@0.50, 0.25, 0.25:
bbox AP:0.01, 0.01, 0.01
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.01, 0.01, 0.01
Pedestrian AP@0.50, 0.50, 0.50:
bbox AP:0.01, 0.14, 0.14
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.01, 0.01
Pedestrian AP@0.50, 0.25, 0.25:
bbox AP:0.01, 0.14, 0.14
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.01, 0.01

After Refine:
Cyclist AP@0.50, 0.50, 0.50:
bbox AP:0.00, 0.00, 0.00
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.00, 0.00
Cyclist AP@0.50, 0.25, 0.25:
bbox AP:0.00, 0.00, 0.00
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.00, 0.00
Pedestrian AP@0.50, 0.50, 0.50:
bbox AP:0.00, 0.00, 0.03
bev AP:0.00, 0.00, 0.03
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.00, 0.01
Pedestrian AP@0.50, 0.25, 0.25:
bbox AP:0.00, 0.00, 0.03
bev AP:0.00, 0.07, 0.07
3d AP:0.00, 0.00, 0.05
aos AP:0.00, 0.00, 0.01

Cyclist coco AP@0.25:0.05:0.70:
bbox AP:0.01, 0.01, 0.01
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.00, 0.00
Pedestrian coco AP@0.25:0.05:0.70:
bbox AP:0.04, 0.04, 0.06
bev AP:0.00, 0.01, 0.03
3d AP:0.00, 0.00, 0.02
aos AP:0.03, 0.02, 0.04

Cyclist coco AP@0.25:0.05:0.70:
bbox AP:0.01, 0.01, 0.01
bev AP:0.00, 0.00, 0.00
3d AP:0.00, 0.00, 0.00
aos AP:0.00, 0.00, 0.00
Pedestrian coco AP@0.25:0.05:0.70:
bbox AP:0.04, 0.04, 0.06
bev AP:0.00, 0.01, 0.03
3d AP:0.00, 0.00, 0.02
aos AP:0.03, 0.02, 0.04

Is this abnormal? what could be the reason for this?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions