awesome-homography-estimation-and-image-alignment

This repo contains a curative list of homography estimation, image alignment and related application.

Note: It is worth noting that this repository only focuses on homography estimation methods used for image alignment tasks. Methods for solving poses using homography estimation, such as those on the HPatches benchmarks, are not covered in this repository.

Please feel free to send me pull requests or email to add papers!

If you find this repository useful, please consider STARing this list. Feel free to share this list with others!

There are some similar repositories available, but it appears that they have not been maintained for a long time.

• https://github.com/tzxiang/awesome-image-alignment-and-stitching
• https://github.com/visionxiang/awesome-computational-photography

Overview

• Awesome Homography Estimation and Image Alignment
  • Homography Estimation
  • Image Alignment
  • Application

Homography Estimation

Survey Paper

• A Review of Homography Estimation: Advances and Challenges, Electronics, 2023. [Paper]
• Research on Homography Estimation Method Based on Deep Learning, International Conference on Computational & Experimental Engineering and Sciences, 2024. [Paper]

2024

• DMHomo: Learning Homography with Diffusion Models, ToG. [Paper] [Code]
  • keyword: realistic dataset generation, supervised homography estimation
• UMAD: University of Macau Anomaly Detection Benchmark Dataset, IROS. [Paper] [Code]
• CrossHomo: Cross-Modality and Cross-Resolution Homography Estimation, TPAMI. [Paper] [Code]
  • keyword: cross-modality images, cross-resolution images
• Gyroflow+: Gyroscope-guided unsupervised deep homography and optical flow learning, IJCV. [Paper] [Code]
• Unsupervised Homography Estimation with Pixel-level SVDD, TCSVT. [Paper]
• AbHE: All Attention-Based Homography Estimation, TIM. [Paper] [Code]
• Analyzing the Domain Shift Immunity of Deep Homography Estimation, WACV. [Paper]] [Code]
• MCNet: Rethinking the Core Ingredients for Accurate and Efficient Homography Estimation, CVPR. [Paper] [Code]
• SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning, ECCV. [Paper] [Code]
• Deep Homography Estimation via Dense Scene Matching, RAL. [Paper]
• STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagery, RAL. [Paper] [Project] [Code]
• Implicit Neural Image Stitching With Enhanced and Blended Feature Reconstruction, WACV. [Paper] [Code]
• Deep Unsupervised Homography Estimation for Single-Resolution Infrared and Visible Images Using GNN, Electronics, 2024. [Paper]
• GFNet: Homography Estimation via Grid Flow Regression, arXiv. [Paper]
• Homography Estimation with Adaptive Query Transformer and Gated Interaction Module, TCSVT. [Paper]
• A method of UAV image homography matrix estimation based on deep learning, ICDIP. [Paper]
• Image Registration Algorithm for Stamping Process Monitoring Based on Improved Unsupervised Homography Estimation, Applied Sciences. [Paper]
• HomoMatcher: Dense Feature Matching Results with Semi-Dense Efficiency by Homography Estimation, arXiv. [Paper]

2023

• Edge-aware Correlation Learning for Unsupervised Progressive Homography Estimation, TCSVT. [Paper]
  • keyword: unsupervised homography estimation
• Unsupervised Global and Local Homography Estimation with Motion Basis Learning, TPAMI. [Paper] [Code]
  • keyword: unsupervised homography estimation
• Supervised Homography Learning with Realistic Dataset Generation, ICCV. [Paper] [Code]
  • keyword: realistic dataset generation
• Semi-supervised Deep Large-Baseline Homography Estimation with Progressive Equivalence Constraint, AAAI. [Paper] [Code]
  • keyword: large baseline dataset
• Exploring Progressive Hybrid-Degraded Image Processing for Homography Estimation, ICASSP. [Paper]
• Recurrent homography estimation using homography-guided image warping and focus transformer, CVPR. [Paper] [Code]
• Bilevel Progressive Homography Estimation Via Correlative Region-Focused Transformer, SSRN. [Paper]
• Coarse-to-Fine Homography Estimation for Infrared and Visible Images, Electronics. [Paper]
• Mask-Homo: Pseudo Plane Mask-Guided Unsupervised Multi-Homography Estimation, AAAI. [Paper] [Code]
• Unsupervised deep homography with multi‐scale global attention, IET Image Processing. [Paper]
• Homography Estimation in Complex Topological Scenes, arXiv. [Paper]
• Infrared and Visible Image Homography Estimation Based on Feature Correlation Transformers for Enhanced 6G Space–Air–Ground Integrated Network Perception, Remote Sensing. [Paper]
• Geometrized transformer for self-supervised homography estimation, ICCV. [Paper] [Code]

2022

• Iterative deep homography estimation, CVPR. [Paper] [Code]
• Unsupervised Homography Estimation with Coplanarity-Aware GAN, CVPR. [Paper] [Code]
  • keyword: unsupervised homography estimation
• Content-Aware Unsupervised Deep Homography Estimation and its Extensions, TPAMI. [Paper]
  • Keyword: journal version
• Learning to Generate High-Quality Images for Homography Estimation, ICIP. [Paper]
• Detail-Aware Deep Homography Estimation for Infrared and Visible Image, Electronics. [Paper]
• Towards a unified approach to homography estimation using image features and pixel intensities, arXiv. [Paper]

2021

• Motion Basis Learning for Unsupervised Deep Homography Estimation with Subspace Projection, ICCV. [Paper] [Code]
  • keyword: unsupervised homography estimation
• Deep Lucas-Kanade Homography for Multimodal Image Alignment, CVPR. [Paper] [Code]
  • keyword: supervised homography estimation
• Depth-aware multi-grid deep homography estimation with contextual correlation, TCSVT. [Paper] [Code]
• Deep Homography Estimation based on Attention Mechanism, ICSAI. [Paper]
• Perceptual loss for robust unsupervised homography estimation, CVPRw. [Paper]

2020

• Deep homography estimation for dynamic scenes, CVPR. [Paper] [Code]
• Content-aware unsupervised deep homography estimation, ECCV. [Paper] [Code]
  • keyword: small baseline dataset(CA-Unsupervised dataset)
• Homography Estimation with Convolutional Neural Networks Under Conditions of Variance, arXiv. [Paper]
• Robust Homography Estimation via Dual Principal Component Pursuit, CVPR. [Paper]
• Self-supervised deep homography estimation with invertibility constraints, PRL. [Paper]
• SRHEN: Stepwise-Refining Homography Estimation Network via Parsing Geometric Correspondences in Deep Latent Space, MM. [Paper]
• CorNet: Unsupervised Deep Homography Estimation for Agricultural Aerial Imagery, ECCV. [Paper]

2019

• STN-Homography: Direct estimation of homography parameters for image pairs, Applied Sciences. [Paper]
• Homography Estimation Based on Error Elliptical Distribution, ICASSP. [Paper]

2018

• Unsupervised deep homography: A fast and robust homography estimation model, RAL. [Paper]
  • Keyword: unsupervised homography estimation
• Rethinking Planar Homography Estimation Using Perspective Fields, ACCV. [Paper]

2017

• Homography estimation from image pairs with hierarchical convolutional networks, ICCVw. [Paper]

2016

• Deep image homography estimation, arXiv. [Paper] [Unofficial_Code1] [Unofficial_Code2]
  • Keyword: first learning-based supervised homography estimation method, realistic dataset generation

2014

• HEASK: Robust homography estimation based on appearance similarity and keypoint correspondences, PR. [Paper]

2009

• Homography estimation, [Paper]

Image Alignment

Date	Ref	Paper Title	Type	Code
2024	Access	MGHE-Net: A Transformer-Based Multi-Grid Homography Estimation Network for Image Stitching	Grid-based
2024	arXiv	Parallax-tolerant Image Stitching via Segmentation-guided Multi-homography Warping
2023	CVPR	PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment	Flow-based	Code
2023	ICCV	Parallax-Tolerant Unsupervised Deep Image Stitching		Code
2022	arXiv	Warped Convolutional Networks: Bridge Homography to sl(3) algebra by Group Convolution
2021	CICAI	Unsupervised Deep Plane-Aware Multi-homography Learning for Image Alignment
2021	CVPR	Localtrans: A multiscale local transformer network for cross-resolution homography estimation
2021	TIP	Unsupervised deep image stitching: Reconstructing stitched features to images
2020	TIP	Cross-Weather Image Alignment via Latent Generative Model With Intensity Consistency
2020	Journal of Visual Communication and Image Representation	A view-free image stitching network based on global homography		Code
2020	arXiv	Learning edge-preserved image stitching from large-baseline deep homography
2020	CVPR	Warping Residual Based Image Stitching for Large Parallax
2020	ECCV	Ransac-flow: generic two-stage image alignment	Flow-based	Code Project
2019	arXiv	DeepMeshFlow: Content adaptive mesh deformation for robust image registration	Grid-based
2018	ECCV	Multimodal image alignment through a multiscale chain of neural networks with application to re mote sensing
2017	CVPR	CLKN: Cascaded Lucas–Kanade networks for image alignment
2015	IJCV	Rationalizing Efficient Compositional Image Alignment
2014	CVPR	Parallax-tolerant Image Stitching
2007	Foundations and Trends® in Computer Graphics and Vision	Image alignment and stitching: A tutorial	Tutorial

Application

Date	Ref	Paper Title	Code
2024	AAAI	Deep Homography Estimation for Visual Place Recognition	Code
2024	arXiv	STHN: Deep Homography Estimation for UAV Thermal Geo-localization with Satellite Imagery	Code Project
2023	IV	Homography Estimation for Camera Calibration in Complex Topological Scenes
2022	arXiv	SSORN: Self-Supervised Outlier Removal Network for Robust Homography Estimation
2022	Symposium on Applied Computing	Semi-Supervised Learning for Image Alignment in Teach and Repeat navigation
2021	arXiv	Weather GAN: Multi-Domain Weather Translation Using Generative Adversarial Networks
2021	CVPR	Deep homography for efficient stereo image compression	Code