JYJingbo Yue
Purdue University · Electrical and Computer Engineering

Jingbo
Yue.

Jackie Yue

Computer Engineering Student & Undergraduate Researcher

I study how visual evidence can make multimodal AI systems more reliable by combining object-level verification, image segmentation, and geometric consistency with multimodal reasoning. My work connects food recognition, visual grounding, and portion estimation with knowledge-based retrieval and targeted recovery of missed or uncertain food items.

Computer VisionPattern RecognitionMultimodal AI
Portrait of Jingbo (Jackie) Yue
Purdue UniversityWest Lafayette, IN
01 / Background

About Me

I am Jingbo (Jackie) Yue, a Computer Engineering student at Purdue University. I conduct undergraduate research in the Video and Image Processing Laboratory (VIPER), advised by Prof. Fengqing Zhu.

My recent research examines the reliability of image-based dietary assessment: how food regions can be verified using semantic and geometric evidence, how missed items can be recovered through targeted segmentation review, and how identified foods can be grounded to nutritional reference data.

I previously conducted computer vision research on image-based plant phenotyping and herbicide-injury assessment at Purdue's ABE Plant Sensor Lab (LeafSpec), led by Prof. Jian Jin. Beyond these applications, I enjoy connecting algorithmic image analysis with practical systems engineering.

02 / Research

Research Interests

Approaches and open questions
01 · Visual perception

Computer Vision & Geometric Reasoning

Region-level segmentation, spatial consistency checks, and object-centric recognition. I am interested in combining semantic evidence with geometric constraints to reduce false-positive detections and missed food items.

02 · Reliable inference

Multimodal Verification & Recovery

Structured MLLM inference with item-wise verification, source-blind re-checking, and a targeted residual review. The goal is to recover omitted visual evidence without uncontrolled generation or repeated refinement.

03 · Grounded estimation

Food Recognition & Portion Estimation

Mapping visually identified foods to reference databases such as FNDDS, with attention to ingredient selection, retrieval quality, portion/mass estimation, and downstream nutritional accuracy.

03 / Scholarly work

Publications

Google Scholar ↗
04 / Selected work

Projects

All GitHub repositories ↗
Research · Food vision01

Food-Item Verification & Recovery

Training-free item verification with semantic/geometric evidence and a one-round, segmentation-assisted residual recovery step for image-based nutrition estimation.

SAM3Region verificationVisual grounding
Research · 2026Read paper ↗
Research · Knowledge grounding02

Open-KNEAD Nutrition Estimation

Knowledge-grounded dietary assessment with agentic decomposition, selective retrieval from FNDDS, and structured MLLM-based inference.

RAGFNDDSNutrition estimation
WACV 2027 · AcceptedRead paper ↗
Engineering · Embedded systems03

CATAN Electronic Game System

Senior design prototype linking ESP32 controllers, an interactive touchscreen, NFC interactions, and UART communication, with a classical image-processing approach for board-state recognition.

ESP32UARTHomography
Senior Design · In progressMore details to follow
Applied CV · Plant phenotyping04

ABE530 Plant Phenotyping

Course project exploring image-based plant phenotyping and herbicide-injury assessment. The public repository contains Jupyter notebook experiments and final presentation materials.

Plant image analysisJupyterPattern recognition
ABE530 · Open-source courseworkView repository ↗
05 / Toolbox

Technical Skills

Algorithms, implementation and tools

Image Processing

Morphology · Edge detection · HSV color space

Feature Extraction

HOG descriptors · ROI extraction · Image features

Pattern Recognition

Support Vector Machines · Classification

Geometric Vision

Homography · Perspective transformation · Mapping

Scientific Computing

Python · PyTorch · OpenCV · Jupyter

Development Environment

Linux · Git · CUDA workflows

Embedded Engineering

C / C++ · ESP32 · UART · Microcontrollers

Data & Evaluation

Dataset curation · Error analysis · Validation

Core Foundations

Data structures · Digital signal processing

06 / Academic & social

Find Me Online

07 / Documents

Curriculum Vitae

Academic CV

A current PDF will be available here after the next update.

Updating

GitHub Repositories

Public research and engineering work.

Browse ↗
Get in touch

Let's connect.

Research collaborations, academic inquiries, and professional opportunities.

yue53@purdue.edu