How I was forced into AI engineering, and what I am learning along the way

Tue, 07 Jul 2026 17:32:00 +0530

I am a self-taught¹ full-stack developer for everything my company ships. For many years I have run a micro incubator — a handful of products and services that I build, deploy and own, all by myself. I write the code, the tests, and the deployment scripts; I run the servers. And I was quite content with that job description.

Then one of those products grew into a problem I could not keep up with.

What I learned running an AI verification pipeline over 20,000 publisher profiles

Tue, 07 Jul 2026 17:31:00 +0530

This is Part 2 of a three-part series. Part 1 tells the story of why this system exists. Part 3 collects the rules I now follow. This part is the engineering.

PublishersGlobal runs a verification pipeline over an active directory of ~20,000 publishers and service providers. Every profile needs to be continuously verified and re-verified, because data on the internet degrades very quickly. In the first few months we ran close to 30,000 verification passes. This post recounts some of what I learned building and running the verification system on open-weight models.

Publishing Technology on Jaiman.org

How I was forced into AI engineering, and what I am learning along the way

What I learned running an AI verification pipeline over 20,000 publisher profiles