How Many CTOs?

What is the role of an engineering manager in the age of AI coding agents?

Short answer

An engineering manager in the age of AI coding agents must act as a guide and evaluator, ensuring that AI tools are used effectively to enhance productivity. They are responsible for understanding the strengths and weaknesses of AI, directing its use, and maintaining oversight to ensure quality and alignment with business goals.

In the age of AI coding agents, the role of an engineering manager has evolved to focus on guiding and evaluating the use of AI tools to enhance team productivity. Engineering managers must understand the strengths and limitations of AI, direct its use effectively, and maintain oversight to ensure that the output aligns with business goals and quality standards.

### Embracing AI as a Tool, Not a Replacement

Paul Brown, a guest on our podcast, highlighted a common concern among engineers: the fear that AI might replace them. He argued that this fear is misplaced, stating, "You know, the resistance is due to a sense of, you know, disempowerment or some kind of hypothesis that the AI is going to somehow supplant, you know, the engineer." ▶ 0:00. Instead, AI should be seen as a tool that can magnify an engineer's impact. This perspective is crucial for engineering managers who must foster an environment where AI is used to complement human skills rather than compete with them.

### The Manager's Role in AI Integration

Brad discussed how the role of an engineering manager is akin to managing an engineer when working with AI coding agents. He described the process as ensuring that "the ticket is well enough described," understanding what the AI is good or bad at, and intervening when the AI starts to falter ▶ 11:44. This involves a deep understanding of both the AI's capabilities and the project requirements, allowing managers to guide the AI effectively and ensure its output meets the team's needs.

### Balancing Human Expertise and AI Capabilities

Scott raised a critical point about the need for human expertise in overseeing AI-generated work, especially when dealing with complex business logic. He noted, "AI-generated code isn't good enough yet for complex business logic" ▶ 25:58. This highlights the importance of having skilled engineers who can evaluate AI output and make necessary adjustments. Engineering managers must ensure their teams have the expertise to critique AI work and make informed decisions about its application.

### Encouraging Experimentation and Continuous Learning

Paul shared his personal journey of experimenting with AI tools, emphasizing the importance of having more tools to play with and the willingness to explore new possibilities ▶ 14:39. Engineering managers should encourage their teams to experiment with AI, fostering a culture of continuous learning and adaptation. This approach not only enhances the team's skills but also helps identify the most effective ways to integrate AI into their workflows.

### Navigating the Rapidly Evolving AI Landscape

The AI landscape is evolving rapidly, with new tools and capabilities emerging regularly. Brad advised against focusing too deeply on a single tool, suggesting instead that engineers should become proficient in working with various AI tools and understanding how to manage them effectively. He emphasized the importance of being able to describe problems and read implementation plans, skills that are crucial in the age of AI coding agents ▶ 20:00.

### Real-World Challenges and Solutions

Paul recounted a specific challenge where AI-generated code failed to meet expectations due to a lack of understanding of the project's nuances. He mentioned, "my code reviewers aren't going to accept it unless I give them a working example of forcing the race condition" ▶ 30:17. This anecdote underscores the necessity for engineering managers to ensure that AI tools are not only used but used correctly, with human oversight to catch and correct errors.

### Conclusion

In conclusion, the role of an engineering manager in the age of AI coding agents is multifaceted. It involves guiding the use of AI tools, ensuring quality and alignment with business goals, and fostering a culture of experimentation and continuous learning. By understanding the strengths and limitations of AI, engineering managers can effectively integrate these tools into their teams' workflows, enhancing productivity and innovation.