Kernel Learning for Dynamic Texture Synthesis

Xinge You, Senior Member, IEEE, Weigang Guo, Shujian Yu, Kan Li, José C. Príncipe, Fellow, IEEE, and Dacheng Tao, Fellow, IEEE

Abstract— Dynamic textures (DTs) that represent moving scenes such as flames, smoke, and waves, exhibit fixed dynamics within a period of time and have been successfully modeled using linear dynamic systems (LDS). In this paper, we show that the widely used LDS model can be approximated using a principal component regression (PCR) model with the main advantage of simplicity. Furthermore, to capture the nonlinearity of training frames, we extend traditional PCR to its kernelized version and introduce kernel principal component regression (KPCR) to model and synthesize DTs. To ensure algorithm stability, we remove the standard state model and directly apply the quantized kernel least mean squares algorithm from signal processing domain to approximate the performance achieved with KPCR. We term this improvement kernel adaptive dynamic texture synthesis (KADTS), which also has the benefits of computational and memory efficiency. These advantages make KADTS ideally suited for real-world applications, since the majority of electronic devices, including cell phones and laptops, suffer from limited memory and real-time constraints. We demonstrate, via both theoretical and experimental analyses, the connections between DT synthesis using KPCR and KADTS with a regularization network theory. We also show the superiority of our proposed algorithms for DT synthesis compared with other dynamic system-based benchmarks. MATLAB code is available from our project homepage http://bmal.hust.edu.cn/project/dts.html.

About

The Matlab code provided was written for recent work that has resulted in a manuscript being accepted in the IEEE Transactions on Image Processing. The software is licensed under the GNU GPLv3.

Demonstration

Each file contains a demo for one specific method mentioned in the manuscript. For example, the file "KPCR_DTS" contains code for dynamic texture synthesis with kernel principal component regression. Please directly run KPCR_demo.m to get the results.

Citations

Please cite:

Xinge You, Weigang Guo, Shujian Yu, Kan Li, Jose C. Principe, Dacheng Tao, "Kernel Learning for Dynamic Texture Synthesis," IEEE Transactions on Image Processing, 25(10), pp.4782-4795, 2016.

Notes

For any questions, suggestions or cooperations, please feel free to contact Shujian Yu,

yusjlcy9011@ufl.edu

yusj9011@gmail.com

Download

code