Week 11 at New Job, and here's what Im thinking about: how do I scale myself and share learnings effectively across a company with hundreds of products and 40k+ employees?
I can't be everywhere all at once. I have a multi-year research backlog if I'm the only one doing it. It would probably take me 10 years to work with every product team individually to help them learn about agent experience. Since I can't clone myself, I've gotta figure out how to scale. Here's what I'm thinking so far:
- I'm putting together a 50-500 level course to help my colleagues go from 0 eval experience to performing ablations and other types of studies
- I'm preparing a newsletter strategy to share agent experience learnings from experiments we run
- I've been running a weekly forum for people to come together and share their learnings, which I am recording and planning to turn into reusable patterns and best practices
- I'm speaking at a summit next week to raise awareness of the specific eval shape we've seen product teams struggling with, partially to let people know they can be doing this and partially to solicit feedback on how we might help product teams upskill around this
- I'm drafting self-serve enablement materials which will live in our internal information-sharing spots, and may eventually turn into tooling or other artifacts to help teams upskill on their own time, without us having to be in the loop for teams that can't wait until we have capacity
- I'm working with my teammates to draft a landing page for this work with more details so people can learn about it without needing to have a meeting with us
- I've written down a running doc of research ideas, why they matter, and what the research methodology might look like, so people who are interested in any specific questions can pick up a task and run with it
What have I missed? For other folks who have run into this problem, I would welcome any tips you have!