Pet recognition

[laurenspriem]

Automatically recognizing and grouping different pets, including the ability to name them for easy search.

[haritvsmurali]

Yes! recognizing faces and tagging it with names for easy search.

[wwahammy]

As a someone whose Yorkie daughter passed away last summer, Ente not recognizing her is perhaps the biggest thing missing compared to Google photos.

I wouldn't say machine learning is my area of expertise by any means but I'm willing to give it a try contributing: both for other users... and Penelope: 🙂

[KestrelWild]

Please add this. Definitely one of the things I am missing most from Google Photos.

[but-whythough]

I'd really love to see this feature

[primaleph]

I'm also missing this feature, as someone who recently moved from Google Photos. I've had 4 cats, and the ability to have Ente recognize them would be wonderful.

[kowtropic]

Agreed, this is the only thing I'm missing from Google photos

[primaleph]

I may have found some open source models that you could use or adapt. As
long as you don't mind a project that uses a MIT license or Apache
license.

https://github.com/blakeblackshear/frigate

https://levelup.gitconnected.com/detect-your-cats-face-with-opencv-21893210737e

https://github.com/GuillaumeMougeot/DogFaceNet

https://www.kaggle.com/datasets/wutheringwang/dog-face-recognition/data

https://github.com/MarQuisCheshire/Pets-Face-Recognition

Many of these links came from a discussion on the same issue, from users of
an app called Immich. In case reading that thread would be useful, here it
is:

immich-app/immich#7151

[lflender]

Any news on this? Ente not recognizing any face for most of my pet photos is killing me. Please either improve pet detection or give us the possibility to manually tag them.

Cheers.

[lflender]

What is weird is that if I search for "dog" or "spider" in my gallery, it will find plenty of results. However, almost all of them are not recognized as faces so I cannot add them to my pet profile.

[laurenspriem]

If at least one face of your pet is recognized then you could actually use manual tagging to add the rest of the photos already. It's a workaround for now, but it might work for you

[stevenhatfield]

Another +1 from me on this. I just switched to Ente and was appalled to find that I couldn't name my pets! What's going on here? This should have been included as a feature when you could name people.

[breezy-codes]

Is there any timeline on when we will get this?

[laurenspriem]

No timeline, but very high on our list!

[wwahammy]

@laurenspriem that's wonderful to hear. What can we as the community do to help this along? You've got a lot of nerds here that care about their furry friends 😄

[laurenspriem]

The challenging part is in getting a good face embedding model, that can analyze the pet facial features. There's no such open source model available, so we're looking to train our own. The hardest part of that is getting the right data: images of pets that are labeled with their identity, so the model can learn to separate different identities. There are some small datasets like this available online, but it's not a lot, so we might need to scrape from public sites that allow for it (like pet adoption sites). We had also considered crowd-sourcing the data within our community, but it'll be too many images and too much effort to coordinate effectively.

So right now, we're experimenting with the few available open datasets, seeing if we can bootstrap our way there. If you know of any datasets that we could use, please do let us know!

[CeVague]

+1 for me to... and don't forget people with exotic pets ! Like ginea pig or rabbit.
I'm not saying you should recognize all of them perfectly, but at least the category for the type of pet could be a great deal !