Research Areas

My research connects computational approaches to social questions with the evaluation of AI systems in practice. I examine how technical choices affect the quality of information, how people assess AI outputs, and how policy and organizational settings shape their use.

Track 01

Computational Social Science

I use computational methods to study social and public health questions. My work includes text analysis, social network analysis, and machine learning applied to data on behavior, health, and social conditions. I am interested in how these methods can produce useful evidence and in the limits that data sources and analytic choices place on what we can conclude.

Computational Social ScienceText AnalysisSocial Network AnalysisMachine LearningPublic Health
Track 02

AI Evaluation and Sociotechnical Systems

I study how AI systems are evaluated and incorporated into work shaped by policy, organizational processes, and professional judgment. My current research focuses on policy-aligned AI for child welfare documentation. It connects the reliability of underlying data and retrieval systems with the ways people review AI outputs and retain responsibility for decisions.

AI EvaluationInformation RetrievalSociotechnical SystemsHuman JudgmentPublic Sector AI

Foundation

Data and Evaluation Infrastructure

I examine how document conversion, data preparation, and retrieval affect the evidence available to an AI system. My work with child welfare policy documents includes evaluating conversion errors and retrieval performance, with attention to whether source material can be located and checked.

Document ProcessingInformation RetrievalEvaluation Design

Theory

Organizations, Policy, and AI Use

I use a sociotechnical perspective to examine how policies, organizational roles, and work practices shape AI use. This perspective informs questions about where AI assistance fits into existing processes, what users need to assess its outputs, and how responsibility is assigned.

Sociotechnical SystemsOrganizationsPolicy

Tools

Policy-Aligned AI Systems

My dissertation focuses on retrieval-augmented generation for policy questions and the review of CPS investigation documentation. The research examines policy alignment and source citations, asking whether AI-generated responses and reviews provide evidence that users can verify.

Retrieval-Augmented GenerationPolicy AlignmentDocumentation Review

Oversight

Human Judgment and AI Oversight

I am interested in how practitioners review, question, and act on AI-generated information. My research agenda includes human-in-the-loop and human-on-the-loop oversight, with attention to how these arrangements affect verification, professional judgment, and accountability.

Human–AI InteractionHuman OversightAccountability

Publications & Working Papers

Working Paper

Measuring and Repairing Document Conversion Errors in the Michigan Child Welfare Policy Manual

Deng, N. · Working paper

Examines document conversion errors in child welfare policy materials and approaches to identifying and repairing them.

Working Paper

AI Incidents and Marginalized Populations: A Descriptive Analysis of the AI Incident Database (1983–2026) from a Social Work Perspective

Deng, N., Douglas, S., Aguilar, J. P., & Yin, W. · Working paper

Examines documented AI incidents involving marginalized populations.

Working Paper

An Open Two-Corpus Dataset of Animal Harm Incidents and Criminal Judgments in China (AHID-CN)

Deng, N. · Working paper

Presents a dataset of animal harm incidents and criminal judgments in China.

2026 Published

Searching the Literature by Meaning: Benchmarking Free and Commercial Word Embedding Models on Social Work Text

Perron, B. E., Wang, M., Deng, N., & Ahn, E. · Journal of Evidence-Based Social Work

Compares free and commercial embedding models for semantic retrieval on social work text.

2021 Published

Applying statistical machine learning methods to analyze differences in the severity level of COVID-19 among countries

Yin, W., Pan, C., Deng, N., & Ji, D. · Journal of Software, 16(5), 219–234

2020 Published

Application of social network analysis of COVID-19 related tweets mentioning cannabis and opioids to gain insights for drug abuse research

Yoon, S., Odlum, M., Broadwell, P., Davis, N., Cho, H., Deng, N., Patrao, M., et al. · Health Informatics Conference Proceedings