Hyungjun Doh

Hyungjun Doh

Master’s Student

Purdue University

Biography

I am a Master’s student in the Elmore Family School of Electrical and Computer Engineering at Purdue University. I am a member of the Convergence Design Lab, under the supervision of Dr. Karthik Ramani. I am deep learning researcher with expertise in 3D Reconstruction focusing on category-agnostic 3D articulated objects reconstruction, 3D human avatars, and object pose estimation. I specializes in integrating Gaussian Splatting and Diffusion Models to enhance the quality of 3D object reconstruction, driving innovation in fields such as XR and Digital Twins.

Interests
  • Artificial Intelligence
  • Computer Vision
  • 3D Reconstruction
  • Human-AI Interaction
  • Extended Reality
  • AI-Infused interfaces
  • Task Guidance System
Education
  • M.S. in Electrical and Computer Engineering

    Purdue University, 2024 - Present

  • B.S. in Computer Engineering

    Purdue University, 2023

Projects

*
An Exploratory Study on Multi-modal Generative AI in AR Storytelling

An Exploratory Study on Multi-modal Generative AI in AR Storytelling

An exploratory study evaluating the impact of multi-modality AIGC regarding its quality, interactions to create, and capability of augmenting elements of AR Storytelling.

CARING-AI: Toward Authoring Context-aware Augmented Reality, INstruction through Generative Artificial Intelligence

CARING-AI: Toward Authoring Context-aware Augmented Reality, INstruction through Generative Artificial Intelligence

A code-less and Mocap-free workflow for authoring animated humanoid avatar instructions in AR with Generative-AI.

Visualizing Causality in Mixed Reality for Manual Task Learning: An Exploratory Study

Visualizing Causality in Mixed Reality for Manual Task Learning: An Exploratory Study

Conducted a study on the effects of visualizations of diverse levels of causality in manual task learning in MR.

Plant Growth Analysis in an Aerosol Exposure Chamber

Plant Growth Analysis in an Aerosol Exposure Chamber

Analyzed and visualized data on plant growth in an aerosol exposure chamber.

Animal behavior Analysis in an Aerosol Exposure Chamber

Animal behavior Analysis in an Aerosol Exposure Chamber

Analyzed and visualized data on lizard behavior in an aerosol exposure chamber.

SINDy(Sparse Identification of Nonlinear Dynamics) Application

SINDy(Sparse Identification of Nonlinear Dynamics) Application

Python-based application for the automatic statistical analysis and visualization of bioaerosol concentration data.

Smart Tripod

Smart Tripod

Senior Design Project, Smart Tripod supporiting object detection and hand gesture recognition.

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions

Reviewed 154 papers on Generative AI applications and synthesized a taxonomy of human-GenAI interactions for future design in the field.

Summer Undergraduate Research Fellowship (SURF)

Summer Undergraduate Research Fellowship (SURF)

Conducted individual research by implementing an animation generation pipeline.

Package Manager Application Programming Interface (API)

Package Manager Application Programming Interface (API)

ECE 46100 Software Engineering course semester-long project.

Vertically Integrated Projects (Data Sciences for Smart Cities)

Vertically Integrated Projects (Data Sciences for Smart Cities)

Computer vision research focused on real-world applications such as detecting cracks and scratches to prevent further damage.

Experience

 
 
 
 
 
M.S. Thesis Track
August 2024 – Present Purdue University, West Lafayette
  • Implement 3D hand-object interaction generation.
  • Developed an experimental AR Storytelling testbed with AI-generated multi-modal content.
 
 
 
 
 
Researcher
NEECS (Nano Energy Environment Convergence System) Lab
January 2024 – June 2024 Yonsei University, Seoul
  • Developed software applications that analyze and visualize measured bioaerosol concentration data.
  • Analyzed and visualized data on animal behavior and plant growth in an aerosol exposure chamber.
  • Labeled the lizard joints dataset and fine-tuned a deep learning network.
  • Created a mobile AI application for autonomous bioaerosol recognition for smart farms.
 
 
 
 
 
Undergraduate Research Assistant
January 2023 – December 2023 Purdue University, West Lafayette
  • Developed AR Interfaces
  • Participated in HCI Research Projects
  • Conducted HCI Research as a First-Author
 
 
 
 
 
Teaching Assistant
August 2023 – December 2023 Purdue University, West Lafayette
  • Weekly Office hour
  • Answering Questions
  • Grading Assignments and Project
 
 
 
 
 
Summer Undergraduate Research Fellowship (SURF)
May 2023 – August 2023 Purdue University, West Lafayette
  • Conducted research on animation generation from text and human pose by combining two diffusion models.
 
 
 
 
 
Vertically Integreated Projects Smart Cities
August 2022 – May 2023 Purdue University, West Lafayette
  • Implemented a semantic segmentation neural network to detect cracks and scratches
  • Generated 56 cracks and scratched datasets, each comprising 308 images, by utilizing the Houdini program.

Accomplish­ments

Coursera
Neural Networks and Deep Learning
See certificate