Events

PhD Defense Towards Controllable and Efficient Diffusion Models
Export Event Save iCal Send to Google Calendar Send to Yahoo Calendar Send to Outlook Live Send to Microsoft Outlook Save iCal Preserve formatting in description (only supported in some calendar applications) Close Friday, August 29, 2025, 02:00pm - 03:30pm

Speaker: Zhixing Zhang

Bio

Location : CoRE 301

Committee: 

Prof. Dimitris Metaxas

Prof. Yongfeng Zhang

Prof. Konstantinos Michmizos

Prof. Xi Peng (external)

Event Type: PhD Defense

Abstract: Diffusion-based generative models have achieved impressive results in image and video synthesis, but their practical use is limited by high computational cost and limited controllability. In this dissertation, we address these challenges by introducing techniques to improve both the controllability and efficiency of diffusion models for image and video generation tasks. To enable fine-grained control, we develop approaches for editing a single input image under user guidance and for text-guided any-length video inpainting. To improve efficiency, we introduce a one-step image2video generation model that eliminates the need for iterative denoising, and a compact diffusion model optimized for mobile devices, enabling near real-time on-device video generation. Together, these contributions advance diffusion models toward real-world applications by enabling high-fidelity generation with greater user control and significantly reduced computational requirements.

Organization: 

Contact  Professor Dimitris Metaxas (Chair)

Zoom Link: https://rutgers.zoom.us/j/93058664441?pwd=AUrgrBbQnhOHaDoJmAzrUOgsIthsST.1