Is there a model for image pair duplicate detection?
Is there a model in hugging face for duplicate image pair detection?I have a dataset with millions of image pair with labelling that they are duplicate or not:image1, image2, duplicate
image3, image4, near-duplicate
image5, image1, not-duplicate
.........
.........
.........
image99999, image8383920, not duplicateIs there a model in hugging face that I could use? During inference the model would produce the following verdict:(imageX, imageY) = verdict?verdict=duplicateornot duplicateornear duplicate.
2022-05-21T04:27:37Z
You can consider using image similarity estimation using a siamese network. A couple of examples that are worth looking at:Siamese Networks for Duplicate Image detectionkaggle.comSiamese Networks for Duplicate Image detectionExplore and run machine learning code with Kaggle Notebooks | Using data from AirBnB Duplicate Image DatasetImage similarity estimation using a Siamese Network with a triplet losskeras.ioKeras documentation: Image similarity estimation using a Siamese Network with...Keras documentationDuplicate Query Detection using Siamese Networklinkedin.comDuplicate Query Detection using Siamese NetworkSIAMESE NEURAL NETWORKS INTRODUCTION It comprises of two identical neural networks each capable of learning the hidden representations of an input vector. This term is coined after Siamese twins.Reading time: 5 min readSiamese coding network and pair similarity prediction for near-duplicate image detectionSpringerLinkSiamese coding network and pair similarity prediction for near-duplicate...Near-duplicate detection in a dataset involves finding the elements that are closest to a new query element according to a given similarity function and proximity threshold. The brute force approach is very computationally intensive as it evaluates...Using Siamese Network for Duplicate Detection in MxNetMedium – 15 Aug 19Using Siamese Network for Duplicate Detection in MxNetThere are a ton of articles that talk about how to build a simple Siamese network for duplicate detection.Reading time: 8 min readA Scalable Solution to Detect Duplicate ImagesMedium – 3 Oct 21A Scalable Solution to Detect Duplicate ImagesRemoving duplicate data is a necessary step before training a model. The question is how to do it in a scalable way.Reading time: 9 min read
2022-05-21T11:33:03Z
You have shared some very useful examples. I have learned a lot while exploring all of these examples specifically from “A Scalable Solution to Detect Duplicate Images” and “Using Siamese Network for Duplicate Detection in MxNet”.