Extract and Verify Book Titles from Bookshelf Photos using GPT-4o and Google Books

Description

*Use Case: *
Analyze images with multiple subjects. In this use case I have a bookshelf and am extracting and verifying book titles/authors from a bookshelf photo.

*How it works: *
1) Webhook receives an image url from a front end in which a user can upload a picture.
In this use case, it is an image of a book shelf.
2) Edit Field (Set): Saves image in a consistent location so AI can find it.
3) Analyze Image: Image is analyzed.
Extracts titles from the book spines
4) Code: Splits extracted subjects to single item to be able to validate each item separately.
Books are individualized to their own entity
5) *HTTP Request *validates each subject.
Queries Google Books to validate books in case only partial titles were found.
6) Edit Field (Set): Tidies the result.
7) Code: Aggregates and deduplicates
Titles and authors are aggregate into a list
8) Respond to Webhook returns list to front end

How to use:
Use with a frontend that can capture images and receive back the result. For this use case Supabase was used to store images from which the image analyzer could reference.