Parallel Constrained Decoders (PCD) as a possible solution for Agents Mis-alignment?! Love to hear your thoughts on this...
linkedin.com/pulse/observabβ¦
I built a native PCD (Parallel Constrained Decoder) server that embeds llama.cpp and guarantees bounded JSON. Every field gets exactly one allowed value & the probability behind it π₯
MIT, local GGUF, macOS binary, Linux compliant π
I've tried using PCD (Parallel Contrained Decoder aka JEV) to decide which tools it should use during a @DevoxxGenie agentic loop. Results were not really different compared to what the LLM would decide. 1/2