Added fallback for incomplete configs for vlm models launched as llms#828

clefourrier wants to merge 3 commits intomainhuggingface/lighteval:mainfrom

clem_config_fallbackhuggingface/lighteval:clem_config_fallbackCopy head branch name to clipboard