STB-VMM: Swin Transformer based Video Motion Magnification

Ricard Lado-Roigé, Marco A. Pérez

Producción científica: Artículo en revista indizadaArtículorevisión exhaustiva

10 Citas (Scopus)

Resumen

The goal of video motion magnification techniques is to magnify small motions in a video to reveal previously invisible or unseen movement. Its uses extend from bio-medical applications and deepfake detection to structural modal analysis and predictive maintenance. However, discerning small motion from noise is a complex task, especially when attempting to magnify very subtle, often sub-pixel movement. As a result, motion magnification techniques generally suffer from noisy and blurry outputs. This work presents a new state-of-the-art model based on the Swin Transformer, which offers better tolerance to noisy inputs as well as higher-quality outputs that exhibit less noise, blurriness, and artifacts than prior-art. Improvements in output image quality will enable more precise measurements for any application reliant on magnified video sequences, and may enable further development of video motion magnification techniques in new technical fields.

Idioma originalInglés
Número de artículo110493
Número de páginas10
PublicaciónKnowledge-Based Systems
Volumen269
DOI
EstadoPublicada - 7 jun 2023

Huella

Profundice en los temas de investigación de 'STB-VMM: Swin Transformer based Video Motion Magnification'. En conjunto forman una huella única.

Citar esto