|
| 1 | +cff-version: 1.2.0 |
| 2 | +title: 'STB-VMM: Swin Transformer Based Video Motion Magnification' |
| 3 | +message: >- |
| 4 | + If you use this software, please cite it using the |
| 5 | + metadata from this file. |
| 6 | +type: software |
| 7 | +authors: |
| 8 | + - given-names: Ricard |
| 9 | + family-names: Lado-Roigé |
| 10 | + email: ricardlador@iqs.edu |
| 11 | + affiliation: >- |
| 12 | + IQS School of Engineering, Universitat Ramon Llull, |
| 13 | + Via Augusta 390, 08017 Barcelona, Spain |
| 14 | + orcid: 'https://orcid.org/0000-0002-6421-7351' |
| 15 | + - given-names: Marco A. |
| 16 | + family-names: Pérez |
| 17 | + orcid: 'https://orcid.org/0000-0003-4140-1823' |
| 18 | + affiliation: >- |
| 19 | + IQS School of Engineering, Universitat Ramon Llull, |
| 20 | + Via Augusta 390, 08017 Barcelona, Spain |
| 21 | +identifiers: |
| 22 | + - type: doi |
| 23 | + value: 10.48550/arXiv.2302.10001 |
| 24 | + description: >- |
| 25 | + STB-VMM: Swin Transformer Based Video Motion |
| 26 | + Magnification |
| 27 | +repository-code: 'https://github.com/RLado/STB-VMM' |
| 28 | +abstract: >- |
| 29 | + The goal of video motion magnification techniques is to |
| 30 | + magnify small motions in a video to reveal previously |
| 31 | + invisible or unseen movement. Its uses extend from |
| 32 | + bio-medical applications and deep fake detection to |
| 33 | + structural modal analysis and predictive maintenance. |
| 34 | + However, discerning small motion from noise is a complex |
| 35 | + task, especially when attempting to magnify very subtle |
| 36 | + often sub-pixel movement. As a result, motion |
| 37 | + magnification techniques generally suffer from noisy and |
| 38 | + blurry outputs. This work presents a new state-of-the-art |
| 39 | + model based on the Swin Transformer, which offers better |
| 40 | + tolerance to noisy inputs as well as higher-quality |
| 41 | + outputs that exhibit less noise, blurriness and artifacts |
| 42 | + than prior-art. Improvements in output image quality will |
| 43 | + enable more precise measurements for any application |
| 44 | + reliant on magnified video sequences, and may enable |
| 45 | + further development of video motion magnification |
| 46 | + techniques in new technical fields. |
| 47 | +keywords: |
| 48 | + - Computer vision |
| 49 | + - Deep Learning |
| 50 | + - Swin Transformer |
| 51 | + - Motion Magnification |
| 52 | + - Image Quality Assessment |
| 53 | +license: MIT |
| 54 | +version: v1.0.0 |
| 55 | +date-released: '2022-07-12' |
0 commit comments