On Thursday, December 5 @ 11am ET, join Cary Institute for a virtual scientific seminar by Dr. Sara Beery, Massachusetts Institute of Technology (MIT).
Natural world images collected by communities of enthusiast volunteers provide a vast and largely uncurated data source. For instance, iNaturalist has over 200 million images tagged with species labels, already contributing immensely to research such as biodiversity monitoring and having been cited in over 4,000 scientific papers. Yet, these images are also known to contain a wealth of "secondary data" captured unintentionally or otherwise included in images and not properly reflected in image labels. Although this data contains crucial insights into interactions, animal social behavior, morphology, habitat, co-occurrence, and many more questions, the costly, time-consuming, or expert-dependent analysis needed to extract such information prevents breakthroughs.
Advances in deep learning methods for language and computer vision have the potential to enable the efficient and automated processing techniques needed to unlock the "hidden treasure" in such datasets. The ability to directly search large image collections for these concepts would enable richer analyses, beyond species identification. We propose interactive, open-ended image retrieval as a mechanism to support scientific discovery in these collections and introduce INQUIRE, a novel text-to-image retrieval benchmark built to provide a rigorous evaluation that challenges models to demonstrate advanced knowledge and visual reasoning on expert, scientifically impactful retrieval tasks.
Free and open to all. Registration required via Eventbrite.
