Discussion about this post

User's avatar
adlrocha's avatar

I will repeat myself here, but I've been saying it for a while, "we are all converging to the same solutions", and best practices and design patterns will surface from all of this work.

Here's a nice link with an architecture that stores all context in the repo to ensure continuity between sessions: https://x.com/yoheinakajima/status/2085784422339768686

adlrocha's avatar

I just came across this paper that presents the "science" behind agent skills, and comes to a similar conclusion/design pattern to the one of the context bootloader (see the last bullet point of this note): https://arxiv.org/pdf/2608.14036

Some highlights from the paper:

* "scaling a skill catalog creates unexpected behaviors. Having too many skills degrades an agent's ability to pick the right one."

* "One of the key insights from the study is that "skills work when noisy trajectories become procedural anchors that stabilize execution." This means that the main focus of the skill should be on showing the agent the steps to solve a task instead of teaching it facts."

* "Takeaway for developers: Stop writing skills to teach your agents facts or generic algorithms. Format your skills as standardized, step-by-step runbooks that force the AI to follow a strict operational checklist."

* "While raw trajectories are valuable, you must make sure that the contain the right signals to distill skills from. You can use an LLM-as-a-judge to help you measure the quality of your trajectories.""

* Building a massive skill catalog introduces severe retrieval bottlenecks [...] To build reliable systems, developers can gate skills by domain buckets first, and use strict trigger conditions second.

No posts

Ready for more?