7 Comments
User's avatar
Mitchell Kosowski's avatar

Consolidating five retrieval sources into one LLM-based system is elegant but I'd love to hear more about the failure modes. Five specialized systems gave you independent optimization surfaces and natural redundancy.

When the unified model regresses on something like cold-start or trending content, what's the rollback story?

Pawel Jozefiak's avatar

Consolidating five retrieval systems into one is the right call. Built a smaller version of this same consolidation problem on my AI agent task layer - started with three platform integrations, ended up with a 3,700-line custom API wrapper just to keep them in sync. Migration math eventually caught up: 21 commits to replace the whole thing with open-source (Fizzy) and a 94-line shim.

Breakdown of where the complexity actually lived: https://thoughts.jock.pl/p/wizboard-fizzy-ai-agent-interface-pivot-2026

For my setup at least, the lesson was that unified interfaces get expensive to maintain at roughly the same rate the underlying systems diverge. Curious how LinkedIn handles drift between the training distribution and live engagement patterns - seems like freshness and the embedding space need tight coupling.

Tommaso Maria Ricci's avatar

The two-stage ranking architecture is well-established at this scale, but what is interesting in LinkedIn’s case is the personalization layer sitting on top of graph data. Most ranking systems optimize for engagement. LinkedIn’s has to balance engagement, career relevance, and professional intent simultaneously. That is a harder multi-objective problem, and where the LLM integration creates real leverage: not in retrieval but in understanding user intent across contexts.

ToxSec's avatar

this was really interesting to read. thanks a ton for putting this together. i learned a ton of about the way linkedin works. really interesting to see they adopted LLMs.

Science is Political 2.0's avatar

Thank you, I sent that to my son who is https://csharpsamurai.com/ SOFTWARE ENGINEER and that is his field.. he mentioned something to me about Linked in..Negative.. but I didn't get what he meant until you pointed that out.. hmmf.. but I am not programmer.. I was DBA and did some programming. everyone did back in the day..Visual basic and C.. but John will be interested in that and I will keep my "subscription for now" but I am very unhappy w/ ALL A.I.. COPILOT IS A VIRUS and cannot be removed.. or turned off..and my smartphone is completely ruined by the so called "phone cleaner" which I also cannot remove. it is virus and I can't use the phone.. at all.. been really tough getting info out. I will just have to DRIVE IN PERSON.. for what I need to do.

Paper and Pencil stocks may go up dramatically.. I am super old school.. and still use checks and know the secret language of PENMEN-SHIP or CURSIVE.. English and AMERICAN.. and can read it and still write it. LINKED IN BIT OFF MORE THAN IT CHEW. I HAVE BEEN VERY UNHAPPY WITH IT.