Dev tools must be opensourced thats why I build this
My framework will help you develop your agentic/AI systems, for now its only in beta. I already used it for my applications and it helped me but it is still not perfect thats why i still push updates and fixes. I want to build "Py test" for agents. For now agent detective helps you determine which of your agents broke, where and why check it out: https://github.com/Thomeras/agent_detective
Interesting, would be curious what your main uses cases for the tool are? Where does it solve a need that other tools cannot serve currently? On another note: Crazy how fast we can set up repos like this using AI these days
My main use case is for example in my market inteligence system, there are multiple agents, they scrap, they curate, they enrich but my output was missing big part of informations and i saw in logs that i scraped a lot of data but on the output there was almost nothing, so i needed to go inside the system to see what each agent exactly hand off, what tools did agents used and i found 2 things. First was that one agent didnt know what he got from one tool so he returned nothing and second was that plan agent didnt come up with correct plan to invoke whole system. So that was my use case although there is a lot of bugs etc it still helped me so i decided to publish it on github so anyone can like at least read about my problem and creat his own tool
How about OpenAI's agent SDK, do they provide what you envision? They say: "OpenAI's SDK offers built-in tracing that logs agent interactions, tool calls, and handoffs"
1 comments