VG-CGARN: Video Generation Using Convolutional Generative Adversarial and Recurrent Networks

Generating dynamic videos from static images and accurately modeling object motion within scenes are fundamental challenges in computer vision, with broad applications in video enhancement, photo animation, and visual scene understanding. This paper proposes a novel hybrid framework that combines convolutional neural networks (CNNs), recurrent neural networks (RNNs) with long short-term memory (LSTM) units, and generative adversarial networks (GANs) to synthesize temporally consistent and spatially realistic video sequences from still images. The architecture incorporates splicing techniques, the Lucas-Kanade motion estimation algorithm, and a loop feedback mechanism to address key limitations of existing approaches, including motion instability, temporal noise, and degraded video quality over time. CNNs extract spatial features, LSTMs model temporal dynamics, and GANs enhance visual realism through adversarial training. Experimental results on the KTH dataset, comprising ۶۰۰ videos of fundamental human actions, demonstrate that the proposed method achieves substantial improvements over baseline models, reaching a peak PSNR of ۳۵.۸ and SSIM of ۰.۹۶—representing a ۲۰% performance gain. The model successfully generates high-quality, ۱۰-second videos at a resolution of ۷۲۰×۱۲۸۰ pixels with significantly reduced noise, confirming the effectiveness of the integrated splicing and feedback strategy for stable and coherent video generation.

کلیدواژه ها:

Video Generation ، Convolutional Neural Networks ، Recurrent Neural Networks ، Generative Adversarial Networks