Thanks @gferreira, I somehow completely missed that when going through the documentation. That's exactly what I need haha. I only have to go through through a single line of pixels, so hopefully the speed won't matter that much.

this should somehow already work for images: see ImageObject spotColor