Posts by Collection

projects

Region Attentioned Text-guided 3D Deformation

Region Attentioned Text-guided 3D Deformation

Project available on GitHub, 2024, [code]

This is a team project from the Deep Learning for Computer Vision course at Columbia. We improved a SOTA text-guided shape editing framework ChangeIt3D by leveraging a region-attended editor that leverages shape correspondence to enable more precise, localized geometry modifications.

Tactile-based Online Active Shape Exploration and Reconstruction using Reinforcement Learning

Tactile-based Online Active Shape Exploration and Reconstruction using Reinforcement Learning

Project available on GitHub, 2025, [code]

This is a team project of Deep Learning for Robotic Manipulation course at Columbia. It learns an RL policy for active 3D shape exploration using tactile sensing, enabling robots to perceive objects that are visually occluded. The system is built and evaluated in IsaacSim/IsaacLab with diverse geometries, demonstrating effective online tactile-based reconstruction of unseen objects.

publications

B. Du, J. Kim, Y. Lyu*. Gaussian Mixture-Based Inverse Perception Contract for Uncertainty-Aware Robot Navigation. American Control Conference(ACC), 2026. [paper] [code]

teaching