Week 12 at new job, and here's what I'm thinking about: how can we leverage work other people are already doing to accelerate our understanding of agent experience?
Attending the internal agent summit this week gave me a lot of great glimpses into what other teams are working on. Some of it is directly relevant to problems I'm watching product teams struggle with, such as how do you set up a realistic environment to run evals, or how do you create a realistic task set? Other people are working on helping partners and enterprises answer these questions, so how can I leverage that work for our internal product teams?
I don't know the answer yet, but it's something I need to make time to dig into.
This is also somewhat related to how I keep up with what people across the industry are doing. I've been running an AI news gathering and filtering pipeline for my personal use since March. Last weekend, I started redesigning this to bring in more sources, drop some of the work I had envisioned that never materialized, and add lenses to help me focus on agent experience. This is going to involve extracting some of my topic analysis and tracking code to a shared library, which I'm hoping to release in the next few weeks.
As the industry keeps moving, I need to keep iterating on both how I can track that progress and how I can bring what applies into both my work and personal projects.
Also, time flies! I've been here nearly 90 days so I think I'll stop the "week number" and "new job" references but keep posting weekly what I'm thinking about. It has been useful for me in spurring conversations with folks, and I hope it's helping other people think about how we can shape a shared understanding of what agents need and how we can help them discover and use products more effectively.