Thanks for your great work!. I tested the results on LayoutSAM-Eval using the following script:
python train.py --cfg project/plangen/cfg/uni/h_text_ump+oimsam.py --opt test=True resume=./checkpoints/plan/checkpoint-200000 test_data.data_name='creati' test_data.task_type='uni'
While the results on Global-wise Quality match the reported numbers in your paper, the Region-wise Quality appears significantly lower. Specifically, I obtained:
Total number of bbox: 19133
Total score of spatial: 11990.0; Average score of spatial: 0.6267
Total score of color: 10256.0; Average score of color: 0.536
Total score of texture: 10662.0; Average score of texture: 0.5573
Total score of shape: 10407.0; Average score of shape: 0.5439
I wonder if there are any implementation details I may have missed that would affect this evaluation. Also, do you have any plans to release the evaluation code? Many thanks!
Thanks for your great work!. I tested the results on LayoutSAM-Eval using the following script:
python train.py --cfg project/plangen/cfg/uni/h_text_ump+oimsam.py --opt test=True resume=./checkpoints/plan/checkpoint-200000 test_data.data_name='creati' test_data.task_type='uni'While the results on Global-wise Quality match the reported numbers in your paper, the Region-wise Quality appears significantly lower. Specifically, I obtained:
I wonder if there are any implementation details I may have missed that would affect this evaluation. Also, do you have any plans to release the evaluation code? Many thanks!