JYJingbo Yue
Purdue University · Electrical and Computer Engineering

Jingbo
Yue.

Jackie Yue

Computer Engineering Student & Undergraduate Researcher

My research focuses on computer vision and multimodal learning, with a particular interest in recognizing individual objects and estimating their physical properties from images through structured, chain-of-thought reasoning. My current work applies these ideas to dietary assessment: identifying the foods in a meal, estimating their portions, and connecting them to nutritional reference data. I develop methods that verify food identities and image regions, recover overlooked items, and address errors that propagate from recognition to nutrition estimation. I am also exploring learning-based approaches that use food appearance, shape, and spatial relationships to improve portion and nutrient estimation across diverse cuisines from the United States, Europe, Oceania, and Asia.

Computer VisionPattern RecognitionMultimodal AI
Portrait of Jingbo (Jackie) Yue
Purdue UniversityWest Lafayette, IN
01 / Background

About Me

I am Jingbo (Jackie) Yue, a Computer Engineering student at Purdue University. I conduct undergraduate research in the Video and Image Processing Laboratory (VIPER), advised by Prof. Fengqing Zhu.

My recent research examines the reliability of image-based dietary assessment: how food regions can be verified using semantic and geometric evidence, how missed items can be recovered through targeted segmentation review, and how identified foods can be grounded to nutritional reference data.

I previously conducted computer vision research on image-based plant phenotyping and herbicide-injury assessment at Purdue's ABE Plant Sensor Lab (LeafSpec), led by Prof. Jian Jin. Beyond these applications, I enjoy connecting algorithmic image analysis with practical systems engineering.

02 / Research

Research Interests

Research questions and methods
01 · Visual perception

Computer Vision & Geometric Reasoning

How can segmentation and spatial consistency help distinguish visible food items from false detections and recover missed items? This direction studies region-level evidence and object-centric recognition.

02 · Reliable inference

Multimodal Verification & Recovery

How can multimodal models check each proposed food item against the image? Our food-item verification work uses region checks and a targeted review of unresolved visual evidence, followed by independent re-verification of recovered items.

03 · Grounded estimation

Food Recognition & Portion Estimation

How do food identification, portion estimates, and reference-data selection affect the final nutrition estimate? Our Open-KNEAD work studies item-level retrieval from FNDDS and auditable portion estimation.

03 / Scholarly work

Publications

Google Scholar
02
2027 · IEEE/CVF WACVAccepted · WACV 2027

Open-KNEAD: Knowledge-grounded Nutrition Estimation via Agentic Decomposition

Bruce Coburn, Jingbo Yue, Jinge Ma, Siddeshwar Raghavan, Gautham Vinod, Fengqing Zhu

Accepted to IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027) · arXiv:2607.12911

In brief: Uses item-wise decomposition and selective FNDDS retrieval to produce an auditable nutrition estimate from a single meal image.

04 / Selected work

Projects

All GitHub repositories
Research · Food vision01

Food-Item Verification & Recovery

Team research project behind the food-item verification paper: checks item identity and whether image regions support portion estimation, then reviews unresolved areas for missed foods.

SAM3Region verificationVisual grounding
Research · 2026Read paper
Research · Knowledge grounding02

Open-KNEAD Nutrition Estimation

Team research project behind Open-KNEAD: decomposes meals into food items and uses selective FNDDS retrieval to support traceable portion and nutrition estimates.

RAGFNDDSNutrition estimation
WACV 2027 · AcceptedRead paper
Engineering · Embedded systems03

CATAN Electronic Game System

Senior design prototype linking ESP32 controllers, an interactive touchscreen, NFC interactions, and UART communication, with a classical image-processing approach for board-state recognition.

ESP32UARTHomography
Senior Design · In progressMore details to follow
Applied CV · Plant phenotyping04

ABE530 Plant Phenotyping

Course project exploring image-based plant phenotyping and herbicide-injury assessment. The public repository contains Jupyter notebook experiments and final presentation materials.

Plant image analysisJupyterPattern recognition
ABE530 · Open-source courseworkView repository
05 / Toolbox

Technical Skills

Algorithms, implementation and tools

Image Processing

Morphology · Edge detection · HSV color space

Feature Extraction

HOG descriptors · ROI extraction · Image features

Pattern Recognition

Support Vector Machines · Classification

Geometric Vision

Homography · Perspective transformation · Mapping

Scientific Computing

Python · PyTorch · OpenCV · Jupyter

Development Environment

Linux · Git · CUDA workflows

Embedded Engineering

C / C++ · ESP32 · UART · Microcontrollers

Data & Evaluation

Dataset curation · Error analysis · Validation

Core Foundations

Data structures · Digital signal processing

Get in touch

Let's connect.

Research collaborations, academic inquiries, and professional opportunities.

jyue.scholar@gmail.com