Captured with Samsung Galaxy S23+ (via Pro Video Mode) at Gangnam-daero, Seoul
Drag the slider handle to compare Blurry LR Input vs FMA-Net++
(Tap anywhere to Play/Pause, Scroll/Pinch to Zoom, Drag to Pan)
Joint video super-resolution and deblurring (VSRDB) requires both efficient long-range temporal modeling and robustness to frame-wise exposure-duration variation, which changes the extent of motion blur across video frames.
We propose FMA-Net++, a non-recurrent, sequence-level framework built from Hierarchical Refinement with Bidirectional Aggregation (HRBA) blocks. By stacking HRBA blocks, FMA-Net++ processes video frames in parallel while hierarchically expanding the temporal receptive field, avoiding the limited temporal receptive field of sliding-window designs and the sequential bottleneck of recurrent ones. To handle exposure-duration-dependent blur, we introduce an Exposure Time-aware Modulation (ETM) layer that conditions HRBA features on exposure embeddings from an Exposure Time-aware Feature Extractor (ETE). The conditioned features guide an exposure-aware flow-guided dynamic filtering module to predict motion- and exposure-aware degradation kernels.
FMA-Net++ decouples degradation learning from restoration: the former predicts degradation priors and the latter exploits them for efficient high-resolution restoration. To evaluate VSRDB under controlled exposure-duration variation, we introduce the REDS-ME (multi-exposure) and REDS-RE (random-exposure) benchmarks. Trained solely on synthetic data, FMA-Net++ achieves state-of-the-art accuracy and temporal consistency on these benchmarks. It further shows strong out-of-distribution performance on GoPro and challenging real-world videos, while outperforming recent methods in both restoration quality and inference speed.
The overall architecture of FMA-Net++, consisting of a Degradation Learning Network and a Restoration Network, both built upon stacked Hierarchical Refinement with Bidirectional Aggregation (HRBA) blocks with Exposure Time-aware Modulation (ETM).
Figure 1. Architecture of FMA-Net++.
Figure 2. Structure of the Hierarchical Refinement with Bidirectional Aggregation (HRBA) block.
Comparison with state-of-the-art methods on REDS-ME and REDS-RE benchmarks. FMA-Net++ achieves superior performance while maintaining high efficiency.
| Methods | # Params (M) | Runtime (s) | REDS4-ME-5:4 | REDS4-ME-5:5 | ||||
|---|---|---|---|---|---|---|---|---|
| PSNR↑ | SSIM↑ | tOF↓ | PSNR↑ | SSIM↑ | tOF↓ | |||
| Super-Resolution + Deblurring | ||||||||
| SwinIR + Restormer | 11.9 + 26.1 | 0.221 + 0.753 | 26.23 | 0.7464 | 3.775 | 25.53 | 0.7229 | 4.558 |
| HAT + FFTformer | 20.8 + 16.6 | 0.352 + 1.414 | 26.66 | 0.7634 | 3.207 | 25.92 | 0.7400 | 3.995 |
| BasicVSR++ + RVRT | 7.3 + 13.6 | 0.048 + 0.349 | 27.28 | 0.7901 | 2.887 | 26.98 | 0.7621 | 3.164 |
| IART + BSSTNet | 13.4 + 52.0 | 1.041 + 0.482 | 27.50 | 0.8006 | 2.578 | 27.26 | 0.7888 | 2.721 |
| Deblurring + Super-Resolution | ||||||||
| Restormer + SwinIR | 26.1 + 11.9 | 0.043 + 0.221 | 26.36 | 0.7499 | 3.464 | 25.84 | 0.7316 | 3.948 |
| FFTformer + HAT | 16.6 + 20.8 | 0.066 + 0.352 | 26.36 | 0.7534 | 3.256 | 25.87 | 0.7356 | 3.739 |
| RVRT + BasicVSR++ | 13.6 + 7.3 | 0.019 + 0.048 | 26.35 | 0.7492 | 3.314 | 25.95 | 0.7424 | 3.610 |
| BSSTNet + IART | 52.0 + 13.4 | 0.025 + 1.041 | 26.51 | 0.7711 | 3.103 | 26.33 | 0.7564 | 3.313 |
| Blind Video Super-Resolution | ||||||||
| DBVSR | 14.1 | 0.096 | 24.50 | 0.7208 | 3.449 | 22.19 | 0.6122 | 4.554 |
| Joint Video Super-Resolution and Deblurring | ||||||||
| Restormer* | 26.5 | 0.045 | 27.45 | 0.7851 | 2.161 | 27.12 | 0.7750 | 2.516 |
| DBVSR* | 14.1 | 0.096 | 26.77 | 0.7629 | 3.021 | 26.07 | 0.7405 | 3.765 |
| BasicVSR++* | 7.3 | 0.048 | 27.70 | 0.7922 | 2.302 | 27.14 | 0.7770 | 2.746 |
| IART* | 13.4 | 1.041 | 28.23 | 0.8153 | 2.143 | 27.64 | 0.7972 | 2.590 |
| VRT* | 35.6 | 0.684 | 27.93 | 0.8045 | 2.366 | 27.41 | 0.7887 | 2.839 |
| RVRT* | 12.9 | 0.385 | 28.11 | 0.8093 | 2.136 | 27.58 | 0.7944 | 2.558 |
| BSSTNet* | 52.0 | 0.548 | 28.75 | 0.8342 | 1.893 | 28.11 | 0.8119 | 2.298 |
| Ev-DeblurVSR | 8.3 | 0.062 | 24.51 | 0.7154 | 3.602 | 24.38 | 0.7047 | 4.094 |
| Ev-DeblurVSR* | 8.3 | 0.062 | 27.40 | 0.7839 | 2.521 | 26.82 | 0.7672 | 3.059 |
| FMA-Net | 9.6 | 0.318 | 26.42 | 0.7958 | 2.503 | 26.67 | 0.8005 | 2.443 |
| FMA-Net* | 9.6 | 0.318 | 29.04 | 0.8275 | 1.891 | 28.51 | 0.8136 | 2.269 |
| FMA-Net++ (Ours) | 12.8 | 0.074 | 29.66 | 0.8546 | 1.688 | 29.24 | 0.8453 | 1.956 |
Table 1. Quantitative comparison on REDS4-ME-5:4 and REDS4-ME-5:5 dataset.
Figure 3. Performance vs. Runtime (GoPro dataset).
| Methods | REDS-RE | GoPro | ||||
|---|---|---|---|---|---|---|
| PSNR↑ | SSIM↑ | tOF↓ | PSNR↑ | SSIM↑ | tOF↓ | |
| Restormer* | 27.79 | 0.7953 | 1.775 | 27.54 | 0.8350 | 3.302 |
| DBVSR* | 27.30 | 0.7742 | 2.398 | 26.05 | 0.7815 | 4.730 |
| BasicVSR++* | 28.14 | 0.8044 | 1.904 | 27.40 | 0.8282 | 3.285 |
| IART* | 28.68 | 0.8248 | 1.852 | 27.76 | 0.8394 | 3.302 |
| VRT* | 28.24 | 0.8124 | 2.071 | 27.39 | 0.8304 | 3.616 |
| RVRT* | 28.56 | 0.8208 | 1.926 | 27.64 | 0.8364 | 3.223 |
| BSSTNet* | 29.33 | 0.8427 | 1.602 | 28.57 | 0.8650 | 2.753 |
| Ev-DeblurVSR* | 27.94 | 0.7987 | 2.039 | 27.25 | 0.8247 | 3.536 |
| FMA-Net* | 29.29 | 0.8413 | 1.614 | 28.83 | 0.8655 | 2.727 |
| FMA-Net++ (Ours) | 30.13 | 0.8643 | 1.360 | 30.49 | 0.9018 | 2.091 |
Table 2. Quantitative comparison on REDS-RE & GoPro dataset.
Figure 4. Visual comparisons on challenging real-world videos (NIQE↓ / MUSIQ↑).
@inproceedings{youk2026fmanetpp,
author = {Youk, Geunhyuk and Oh, Jihyong and Kim, Munchurl},
title = {FMA-Net++: Motion- and Exposure-Aware Joint Video Super-Resolution and Deblurring},
booktitle = {European Conference on Computer Vision (ECCV)},
year = {2026},
}