Regensky, Andy
Andy Regensky, M. Sc.
Since February 2020 I am dealing with the efficient compression of fisheye- and 360°-video data. Special focus is put on effective inter-prediction, where the current image is predicted based on already decoded, temporally preceding or following images. Previous methods for inter-prediction are designed for videos with perspective projection, which follow the pinhole camera model. The special projections of fisheye and 360° images, which can no longer be described by the pinhole camera model, lead to a significantly reduced efficiency of these methods. By incorporating the projection function into the process of inter-prediction, its effectiveness can be increased significantly. Thereby, the projection-based approach is not limited to inter-prediction and can potentially be applied to many other techniques in video coding and signal processing.
More information on the broad topic of next generation video communications at the chair can be found here: Next generation video communications
I offer theses in the field of projection-based fisheye and 360° video coding at any time. Special attention is placed on sufficient experience with Python or C++ and basic knowledge of image and video signal processing. Of course, the required experience scales corresponding to previous study experience: Less experience is expected for a bachelor thesis than for a research internship or a master thesis. If you are interested, just send me an email with a short introduction of your interests and, if applicable, your previous experience in software development and image and video signal processing (e.g. lectures, internships, work experience, private projects).
- Generation of 3D Models from 360° Images (2020)
- Coding of Distortion-Corrected Fisheye Video Sequences using H.266/VVC (2021)
- Development of a Projection-based Intra Prediction Method for Fisheye Images (2021)
- Improving Resampling in Viewport-Adaptive Fisheye Motion Compensation (2021)
- Sphärische Bewegungsmodelle für die Blockbasierte Bewegungskompensation von 360°-Video (2021)
- Investigation of a Rendering Pipeline for the Automatic Generation of Training Data for Checkerboard Segmentation (2022)
- An Overview of the State of the Art in 360-Degree Image and Video Stitching (2022)
- Comparison of the Resampling Quality for Non-Perspective Image Formats (2022)
- Referenzfreie Brennweitenschätzung für perspektivische Videosequenzen (2022)
- Aiding Learned Camera Calibration through Known Reference Patterns (2022)
- Development of a Viewport-Adaptive 360-Degree Image Resampling Technique (2022)
- Development of a Stitching Framework for a Quad-Fisheye 360-Degree Camera (2023)
- Projection-Aware End-to-End Learned Video Compression for 360-Degree Video (2023)
- : Best Presentation Award (9th VDE/ITG Summer School on Video Compression and Processing) – 2024
- : Best Presentation Award (7th VDE/ITG Summer School on Video Compression and Processing) – 2022
- : Luise Prell-Preis (Luise Prell Stiftung) – 2021
2024
The Bjøntegaard Bible - Why your Way of Comparing Video Codecs May Be Wrong
In: IEEE Transactions on Image Processing 33 (2024), p. 987 - 1001
ISSN: 1057-7149
DOI: 10.1109/TIP.2023.3346695
BibTeX: Download
, , , , , , , , , , :
Analysis of Neural Video Compression Networks for 360-Degree Video Coding
Picture Coding Symposium (PCS) (Taichung, 12. June 2024 - 14. June 2024)
BibTeX: Download
, , :
Geometry-Corrected Geodesic Motion Modeling with Per-Frame Camera Motion for 360-Degree Video Compression
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (Seoul, 14. April 2024 - 19. April 2024)
DOI: 10.1109/ICASSP48485.2024.10446915
URL: https://arxiv.org/abs/2312.09266
BibTeX: Download
, :
2023
Image Super-Resolution Using T-Tetromino Pixels
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
BibTeX: Download
, , , :
Processing Energy Modeling for Neural Network Based Image Compression
accepted for IEEE International Conference on Image Processing (ICIP) (Kuala Lumpur, 8. October 2023 - 11. October 2023)
URL: https://arxiv.org/abs/2306.16755
BibTeX: Download
, , , , :
Improving Spherical Image Resampling through Viewport-Adaptivity
IEEE International Conference on Image Processing (ICIP) (Kuala Lumpur, 8. October 2023 - 11. October 2023)
DOI: 10.1109/ICIP49359.2023.10222645
URL: https://arxiv.org/abs/2306.13692
BibTeX: Download
, , , :
Motion Plane Adaptive Motion Modeling for Spherical Video Coding in H.266/VVC
IEEE International Conference on Image Processing (ICIP) (Kuala Lumpur, 8. October 2023 - 11. October 2023)
DOI: 10.1109/ICIP49359.2023.10222661
URL: https://arxiv.org/abs/2306.13694
BibTeX: Download
, , :
Multi-Model Motion Prediction for 360-Degree Video Compression
In: IEEE Access 11 (2023), p. 117004-117017
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2023.3326717
BibTeX: Download
, , :
2022
Fast Reconstruction of Three-Quarter Sampling Measurements Using Recurrent Local Joint Sparse Deconvolution and Extrapolation
In: IEEE Transactions on Circuits and Systems II: Express Briefs 69 (2022), p. 2398-2402
ISSN: 1057-7130
DOI: 10.1109/TCSII.2022.3160012
BibTeX: Download
, , , , :
2021
A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Toronto, 6. June 2021 - 11. June 2021)
DOI: 10.1109/ICASSP39728.2021.9413576
URL: https://arxiv.org/abs/2202.13892
BibTeX: Download
, , :
2020
Boosting Compressed Sensing Using Local Measurements and Sliding Window Reconstruction
In: IEEE Transactions on Image Processing 29 (2020), p. 7931 - 7944
ISSN: 1057-7149
DOI: 10.1109/TIP.2020.3007822
BibTeX: Download
, , , :
Real-Time Frequency Selective Reconstruction through Register-Based Argmax Calculation
IEEE International Workshop on Multimedia Signal Processing (MMSP) (Tampere, 21. September 2020 - 24. September 2020)
DOI: 10.1109/MMSP48831.2020.9287071
URL: https://arxiv.org/abs/2202.13926
BibTeX: Download
, , , :
FishUI: Interactive Fisheye Distortion Visualization
IEEE International Conference on Visual Communications and Image Processing (VCIP) (Macau, 1. December 2020 - 4. December 2020)
DOI: 10.1109/VCIP49819.2020.9301754
BibTeX: Download
, , :
2019
Probabilistic modeling for learning-based distance estimation
23rd International Congress on Acoustics (ICA) (Aachen)
BibTeX: Download
, , :