Independent measurement researchlatenttrait.ai
Latent TraitLatent TraitMeasurement Science for Artificial Intelligence
Publications

Research record

Published and public research spanning psychometric measurement, AI evaluation, human and machine judgment, validated datasets, and accessible media.

Measurement & psychometrics
2026
Discourse Processes

Disentangling local versus global processing dispositions in autistic cognition using item response theory models: comparing multimodal comics versus text-based narratives in a …

Alexander Mario Blum, James M. Mason, R. C. Irey, Y. Toyama, Y. Liu, Gio Jung, Andrew Scott, J. H. Kim, …

Public record

Evaluation of Vision Language Models with Item Response Theory

Andrew Taylor Scott, Gio Jung, Alexander Mario Blum, Juvenal Francisco Barajas, M. Seth, Shasta Ihorn, Vassilis Athitsos, Ilmi Yoon.

Evaluation & machine judgment
2026
Preprint

Toward Scalable Audio Description Quality Control: A Workflow for Evaluating Human and VLM Raters

Lana Do, Gio Jung, Juvenal Francisco Barajas, Andrew Taylor Scott, Shasta Ihorn, Alexander Mario Blum, Vassilis Athitsos, Ilmi Yoon.

2026
Preprint

How well can VLMs rate audio descriptions: A multi-dimensional quantitative assessment framework

Lana Do, Gio Jung, Juvenal Francisco Barajas, Andrew Taylor Scott, Shasta Ihorn, Alexander Mario Blum, Vassilis Athitsos, Ilmi Yoon.

2026
ICIC

Beyond Lexical Overlap: Validating Semantic Similarity Metrics for LLM-Based Video Caption Augmentation

Juvenal Francisco Barajas, Gio Jung, M. Seth, Lana Do, M. Jagabattuni, Andrew Taylor Scott, Shasta Ihorn, …

Validated datasets & human-centered evaluation
2023
NeurIPS D&B

Validated Image Caption Rating Dataset

Lothar D. Narins, Andrew Taylor Scott, Aakash Gautam, Anagha Kulkarni, Mar Castanon, Benjamin Kao, Shasta Ihorn, Yue-Ting Siu, James M. Mason, Alexander Blum, Ilmi Yoon.

2023
CHI

Improved Image Caption Rating — Datasets, Game, and Model

Andrew Taylor Scott, Lothar D. Narins, Anagha Kulkarni, Mar Castanon, Benjamin Kao, Shasta Ihorn, Yue-Ting Siu, Ilmi Yoon, …

2021
CHI EA

Automated video description for blind and low vision users

A. Bodi, P. Fazli, S. Ihorn, Yue-Ting Siu, Andrew Taylor Scott, L. Narins, Yash Kant, Abhishek Das, Ilmi Yoon.

Earlier work
2020
SFSU

Transfer Learning for Improved Video Description Performance for Visually Impaired and Blind

Andrew Taylor Scott.

2004
Elsevier

Windows to Linux Migration Toolkit: Your Windows to Linux Extreme Makeover

D. Allen.

Profile

Research lineage

The publication record reflects a progression from accessible computing and machine perception, through validated human-centered evaluation and machine judgment, toward psychometric measurement of artificial systems.

Google Scholar profile →