This paper introduces VQAonline, the first Visual Question Answering (VQA) dataset derived from real-world scenarios, specifically online community forums. Unlike traditional VQA datasets, VQAonline features answers that are significantly longer, averaging 173 words. Given this unique characteristic, the paper evaluates six popular metrics for longer text evaluation to determine their alignment with human judgments. After identifying the most suitable metrics, the study assesses six leading vision and language foundation models using VQAonline, pinpointing their main challenges. The dataset is publicly available, offering a valuable resource for advancing research in the VQA field by providing a more authentic and complex set of data for training and evaluating AI models.
-
Czerwionka, Thomas, and Claudia De Witt. Betreuung von Online-Communities of inquiry. na, 2006.
-
Members
- JoelR
- Voyage
- GazzaGarratt
- rainx
- Adriano Faria
- opentype
- Dilip
- Nathan Explosion
- YourSharona
- DawPi
- Live Games
- bernhara
- Kentraiyle Robinson
- IC Essentials
- Myr
- Chris Anderson
- Como
- Brian
- MichaelR
- Edward Ellas
- Square Wheels
- IPS THEME
- aXenDev
- PrettyPixels
- Analog
- Denis Dyack
- A Zayed
- Labis
- DursunKaptan
- V0RT3X
- MissB
- TheLlamaman
- Andy Y
- envy
- eivindsimensen
- JoeyM
- aLEX49566
- adik
- Codepixel
- alsl sndnxnx
- burnyourfeelings
- N700
- isvans
- Marius
- Matt
- terabyte
- Thomas Taschler
- Surpac
- JoshB
- Ioannis D
- abobader
- ReyDev
- Richard Arch
- bdmusic 24
- Majster87
- TomCat
- Paul
- Pmw
- Torgeir Rui
- Kammer et
- Nicolas PC
- XwReK
- Claudia999
- Kirill Gromov
- Synergy
- bing11
- Marvin Moore
- ArashDev
- onlyME
- ali hagi
- StevenM
- NewVicious
- lukash
- TracyIsland
- Andhrafriends Admin
- Daffy
- hyprem
- GuitarGathering
- Tripp
- Askancy
- MLK
- Jelly Belly
- eveneme eveneme
- Nomad
- Morphe
- lordi
- shahed
- John Horton
- PayMap
- Serval
- Nomer3
- Dennis Maidon
- Zennuie
- COSMIN
- wulfx01
- Matthew Hawley
- Verto
- George Anderssen
- Toby
- Cheryl