{"id":1688,"date":"2024-05-13T14:34:58","date_gmt":"2024-05-13T12:34:58","guid":{"rendered":"https:\/\/multi3generation.eu\/?page_id=1688"},"modified":"2024-05-13T14:34:58","modified_gmt":"2024-05-13T12:34:58","slug":"benchmark","status":"publish","type":"page","link":"https:\/\/multi3generation.inesc-id.pt\/?page_id=1688","title":{"rendered":"Benchmark"},"content":{"rendered":"\n<p>As a result of the collaboration between Multi3Generation members, the VILMA&nbsp;benchmark was produced. The paper and resource can be found here:<\/p>\n\n\n\n<p>Paper:&nbsp;<a href=\"https:\/\/openreview.net\/forum?id=liuqDwmbQJ\">https:\/\/openreview.net\/forum?id=liuqDwmbQJ<\/a><br>Arxiv:&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/2311.07022\">https:\/\/arxiv.org\/abs\/2311.07022<\/a><br>Website:&nbsp;<a href=\"https:\/\/cyberiada.github.io\/ViLMA\">https:\/\/cyberiada.github.io\/ViLMA<\/a><br>Codebase:&nbsp;<a href=\"https:\/\/github.com\/ilkerkesen\/ViLMA\">https:\/\/github.com\/ilkerkesen\/ViLMA<\/a><\/p>\n\n\n\n<p>Published as a conference paper at ICLR 2024<\/p>\n\n\n\n<p>Reference: Ilker Kesen, Andrea Pedrotti, Mustafa Dogan, Michele Cafagna, Emre Can Acikgoz, Letitia Parcalabescu, Iacer Calixto, Anette Frank, Albert Gatt, Aykut Erdem, Erkut Erdem<br>ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As a result of the collaboration between Multi3Generation members, the VILMA&nbsp;benchmark was produced. The paper and resource can be found here: Paper:&nbsp;https:\/\/openreview.net\/forum?id=liuqDwmbQJArxiv:&nbsp;https:\/\/arxiv.org\/abs\/2311.07022Website:&nbsp;https:\/\/cyberiada.github.io\/ViLMACodebase:&nbsp;https:\/\/github.com\/ilkerkesen\/ViLMA Published as a &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":289,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1688","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=\/wp\/v2\/pages\/1688","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1688"}],"version-history":[{"count":0,"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=\/wp\/v2\/pages\/1688\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=\/wp\/v2\/pages\/289"}],"wp:attachment":[{"href":"https:\/\/multi3generation.inesc-id.pt\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1688"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}