How Does a Scrum Master Coach a Team with More Experience Than Them?

Quickly add value, regardless of your experience level - How Does a Scrum Master Coach a Team with More Experience Than Them?

I’ve found myself in many different contexts throughout my career as a SAFe scrum master:

  • Multimedia 
  • Instructional design 
  • Marketing 
  • Globalization 
  • Data analytics

Make no mistake. I am neither an animation artist nor an instructional designer, nor a digital marketer, nor fluent in a second language, nor can I write SQL (or any code for that matter).

So how do I effectively work as a scrum master when I don’t share technical experience with my teammates? I’ll help you answer that common question by focusing on three areas: 

  • What does a scrum master do?
  • What if I’m a scrum master without experience?
  • Setting scrum master improvement areas

What does a scrum master do?

This sounds simplistic, but there’s a reason! Reviewing the basics, in this case the role of scrum master, can help reaffirm your role on the team you serve and help you clearly state it to others. 

Your goals are simple (not easy), and they often include:

SAFe® scrum master

  1. Helping the team navigate ART practices and processes. In doing so, the team can participate fully and have their interests, concerns, questions, ideas, and voices heard. This is especially true for new team members. Everyone will need time and support to adjust to a new way of working, no matter their experience level. Scrum masters are a little bit like the glue that holds cross-functional teams and ARTs together.
  2. Allowing teammates to focus on execution. As experts in their domain, your team members are usually deep in the trenches of value delivery. Most other team responsibilities are shared between you, the product owner, and the product manager. This means scrum masters need to be experts at supporting the PO, PM, and other team members at defining the why, gathering requirements, prioritizing work, and knocking on doors to unblock progress. Learn more about the role of scrum master vs product owner
  3. Being a champion of relentless improvement. You should help define success metrics, measure the team’s value delivery, and create a forum for the group to view and discuss the results. Teams might think they’ve defined value delivery well, but scrum masters are uniquely positioned to provide essential perspectives from the ART, customers, business owners, and other teams. Aside from objective metrics, you can also discuss qualitative experiences like team dynamics. In partnership with the product owner, you can create a system to start incrementally improving. The organizational value realized from increasing and sustaining employee participation is always significant.

The full SAFe® scrum master article has more extensive guidance to help you define role expectations and responsibilities. As a quick reference, the image below will help you visualize three core areas where any scrum master can immediately start to add value.

SAFe Scrum Master Areas of Focus: ART & team events, value delivery & team progress, flow & team dynamics

Does this work require you to know what the team is making and how? Yes, to an extent. But it often doesn’t require the depth of specialized knowledge needed to build end solutions. In fact, another voice with the same experience and biases might only add to a myopic perspective and goals.

What if I’m a scrum master without experience?

Starting as a scrum master without experience is a little overwhelming.

When it feels like too much, there are some foundational concepts you can use to stay grounded and help your team succeed.

Below are three key reminders for scrum masters that are new to their role or serving an experienced team in an unfamiliar domain.

SAFe® scrum master

1 | The team is expert in their way, you are expert in your way

To coach a team effectively, you need to understand and maintain focus on:

  • The team’s value flow
  • Typical bottlenecks
  • Impediments to high quality

The rest is simply nice to have. Understanding flow, bottlenecks, and quality will allow you to quickly grasp what holds the team back and how they achieve success. This will also help you relate to your team’s emotional dynamics, including what makes them personally frustrated or fulfilled. Empathy will break through differences in experience levels and foster lasting relationships.

If you’re still skeptical, think of it this way; the product owner is backlog and content authority for the team. They still do backlog refinement with the team. Why? Because team members are the experts! That’s their thing. That’s why they were hired.

A scrum master isn’t an expert in the same areas. That’s not their job. Their job is coaching and enhancing the PDCA cycle, customer centricity, flow, dependency visualization, bottleneck identification and removal, conflict management, and listening.

2 | Build initial trust levels with authenticity

The not-so-secret ingredient in serving any team is trust. If you share technical expertise with your teammates, building initial trust may be easier. Teammates will know that you understand their impediments and have insight into root causes because you may have experienced them before. Your coaching may be well received because “you know what you’re talking about,” and teammates can immediately talk shop with you.

There may be some initial distrust if you don’t share technical knowledge with your teammates and they don’t understand how you contribute. If this situation sounds familiar, it’s best to start with openness about your background and willingness to learn. Emphasize that you’re not a technical expert but you do fill many other roles that help them work better, including:

  • Servant leader
  • Live-in consultant
  • Advisor
  • Team protector

Your expertise starts with process, method, and people.

Trust is particularly key when your work environment prioritizes honesty, candid feedback, and personal responsibility. Technical competency is a must for most roles, but emotional intelligence and interpersonal skills are vital for helping teams and individuals thrive. Organizations using SAFe should create ample space for digging into messy issues, feedback, processes, and team performance. Scrum masters can build trust in these complex emotional environments in several critical ways: 

  • Help everyone approach discussions in good faith
  • Create a safe environment for all feedback
  • Find and equip team members with the right tools and methods to provide feedback
  • Encourage participation by all; not only the loudest or most persistent voices
  • Communicate feedback clearly to others, demonstrating advocacy for the team

3 | Promote self-organizing teams

A scrum master’s best tools are powerful questions and intentional listening. If you share deep technical expertise with your teammates, you may have a bias when determining problems and solutions.

You might make more assumptions and be more suggestive because you have so much familiarity with the team’s work. Scrum masters without technical experience have the benefit of an outsider’s perspective and have no choice but to truly listen, clarify, and guide the team to their own solutions.

Setting scrum master improvement areas

It’s helpful to build trust and develop personal relationships. But you’ll need concrete growth goals to gain competency and confidence.

The list of scrum master improvement areas below will give you a big head start in owning your role:

Rocky GIF

Identify the team’s value stream(s). The team might already have a value stream visualization. Maybe the product owner knows it well. Or maybe there’s a great opportunity for the team to work on identification. This will help both you and your team understand how work flows and the most essential tools and processes the team uses. You’ll likely find areas for immediate improvement!

Ask obvious questions. Though it might feel like you’re slowing the team down, asking foundational questions is actually beneficial for everyone. Here are just a few obvious benefits:

  • You need to learn more about team content
  • The teammate receiving the question needs to think about the purpose and processes behind their work
  • Other team members who aren’t involved in that work may have the same question 

Schedule one-on-one meetings. Learn team member’s professional goals and interests. Ask about their pain points, what keeps them up at night, dynamics within the team, dynamics with other teams, etc. Build empathy to help smooth over inevitable future difficulties. Also, if your teammate is comfortable with it, you can ask to shadow their work while they narrate and complete day-to-day tasks. 

Always have a Google tab open. Answers to technical questions are often difficult to grasp. You can’t expect to know everything your team does. Instead of scheduling an hour lecture with a teammate every time curiosity strikes, try checking internal directories, knowledge wikis, and even Google to find a quick answer. Continuous learning is imperative.

Use an assessment to measure your progress. The AgilityHealth Scrum Master Radar Assessment (or a similar tool) can help you understand your current performance and identify areas for improvement. 

Learn more about the team’s work. This shouldn’t necessarily be your first priority, but it’s definitely worth your time. Common examples include joining a lunch book club, attending a conference, creating content that requires you to learn new material, and reading technical articles. You’ll deepen your knowledge and show that you truly care about the team’s work.

Hone your craft. Consistently prioritizing professional development will demonstrate your growing expertise to the team. Whether you’re trying new approaches to retrospectives or diligently protecting and coaching team members, your efforts will earn trust.

If you’re still unsure about exactly where to spend your time, the graphic below breaks down how real scrum masters (in our company) spend a typical week. You can use this tool as a gut check for balancing priorities, assessing your time management skills, and planning for a productive iteration.

SAFe® scrum master

More Resources for You, Scrum Masters!

Even with prior scrum master work experience, serving a team with technical expertise that you don’t have can feel daunting. But a skilled scrum master can quickly bring significant value. By clarifying how you serve the team, building trust, and continuously learning, you and your teammates can work together to build a self-organizing, high-performing team.

Here are some additional resources to help you learn more about how scrum masters of all experience levels can continue improving and serving well:

About Emma Ropski

Emma is a Certified SPC and scrum master at Scaled Agile

Emma is a Certified SPC and scrum master at Scaled Agile, Inc. As a lifelong learner and teacher, she loves to illustrate, clarify, and simplify to keep all teammates and SAFe learners engaged. Connect with Emma on LinkedIn.

View all posts by Emma Ropski

Facilitation Tips to Excel at the RTE Role – Agility Planning

Release Train Engineer

I spend most of my time in the Release Train Engineer (RTE) role facilitating groups from all levels of the organization.

When I facilitate poorly, people notice, and the Agile Release Train (ART) struggles to align on objectives and mitigate risks.

When I facilitate well, meetings blend into daily work, and the ART runs smoothly.

In this blog post, I focus on facilitation tips and tools that have worked for me in agility planning with three ceremonies that RTEs facilitate:

  • PI Planning
  • Scrum of Scrums (SoS)
  • System Demo

Let’s take a look at how I prepare for and facilitate each.

Release Train Engineer

Prepare for the RTE Role in PI Planning

PI Planning is the most important event the RTE role facilitates. A well-run PI Planning aligns the ART to:

  • strategy
  • business context
  • priorities

It creates the space for tough conversations about dependencies and tradeoffs. Teams have the autonomy to plan to achieve the desired value delivery within their capacity.

How to prepare for a successful PI Planning

It’s helpful for me to think about PI Planning preparation in the following sections.

Organization

This includes the tools and tips I use to stay organized before and during PI Planning.

Book calendars in advance

If you want 125 people available at the same time in the same location, you need to get dates on the calendar a year ahead of PI Planning. When I have not met this criterion, key stakeholders miss the event due to scheduling conflicts.

ART Readiness Workbook

We use an updated version of the readiness checklist in the ART Readiness Workbook. The SAFe® PI Planning Toolkit on the SAFe Community Platform includes this checklist.

It includes everything we need to prepare our teams and ARTs for PI Planning, from the program backlog to video call links. We’ve started calling it “the dream” because it keeps us so organized that the event runs like a dream.

Content

This is how I think about the information I want to convey during PI Planning.

Business context

Work with leaders to prepare a strong business context presentation. As a facilitator, it’s my job to ensure the connection from strategy to execution is clear. That connection starts with the business context.

As an RTE, I work with our leaders to paint the picture of:

  • Our progress so far
  • Our priorities moving forward
  • What we want to do with those priorities
  • Why it matters

A motivating message will resonate with people and set the tone for the event.

Note: Leaders can be your GM for the business unit or CEO for smaller organizations.

Product strategy

The product strategy connects the business context to the prioritized backlog. It shows the research, customer feedback, and PI roadmap that will achieve our strategic themes.

This means RTEs work with the head of product to create a presentation that encourages engagement with the content. It should also include plenty of time for Q&A.

I know I’m successful when, in the Q&A, team members make clear connections between the product strategy and top features in the program backlog.

Prioritized program backlog

Our product team prepares early for the upcoming PI by:

  • Understanding customer needs and desired outcomes
  • Defining, sizing, and prioritizing features

This process gives teams plenty of time to understand priorities. It also helps them understand how to do the work and which features to pull first. If I have done a good job of facilitating through the business context and product strategy, the teams will have confidence in the backlog. They’ll also understand how to engage with it to achieve the most value in the PI.

Space

How you set up impacts how your teams engage and where they focus during planning.

Virtual

Release Train Engineer

We use the Virtual PI Planning Collaborate template for virtual PI planning. This template allows us to set up all the things we would have on the walls if we were in person in one easy-to-use online location. It cuts down on logistical questions during PI Planning and allows people to focus on their tasks.

In-person

We spend a lot of time thinking about tables, breakout rooms, and supplies:

  • Does all the in-room tech work?
  • Are there clear instructions for how to use it in the room?
  • Are there snacks and fidget toys on the table for idle hands?
  • Plenty of sticky notes in different colors with pens and markers?

The less time people spend looking for supplies or troubleshooting tech, the more engaged and focused they will be.

Snacks and fun

Whether in person or virtual, planning for snacks and fun is crucial. We send out a theme for planning in advance. We also provide engagement ideas like:

  • costumes
  • virtual backgrounds
  • table decorations

In-person, we plan for snacks and catering; virtually, we send meal kits or snack boxes to people’s homes. Themes bring fun and create camaraderie and empathy that make difficult conversations easier. Snacks keep people focused and stave off the hangry moments.

How to facilitate a successful PI Planning

No matter how well you prepare and set up, facilitation will be tricky, and there will be many twists and turns. Here are my top tips for facilitating successful PI Planning.

Use a detailed facilitator’s agenda

We write a script and annotate every transition, timebox, and tool used. As a facilitator, I plan out:

  • How long to give each team for read-out, Q&A, and transition to the next team
  • Who will present on which screen and from where, and so on

Scripting this prevents worry in the moment and allows us to focus on active facilitation.

Know your end goal so you can pivot

These down-to-the-minute agendas will go off the rails at some point. It may be because a meaningful conversation runs past the timebox. Or we need to discuss a risk or de-scoping in real-time. With a detailed facilitator’s plan, we can adjust in the moment and still achieve our goal.

Embrace crucial conversations

PI Planning includes difficult trade-offs, scoping conversations, and cross-team dependencies and risks. Emotions are high, and the content is high stakes. We must model and facilitate embracing these conversations in productive ways. As a facilitator, I ensure these conversations are happening by coaching people through them.

When people come to me with problems and risks they want me to solve, it is often something they can solve themselves with a crucial conversation. I coach them to use:

  • “I” statements
  • Clear, transparent communication

The pain caused by avoidance or indirect communication is always worth this time and effort. For more detailed PI Planning facilitation guides and templates, check out the SAFe PI Planning toolkit. Find it on the PI Planning SAFe Community Platform page.

Release Train Engineer

Prepare for the RTE Role in Scrum of Scrums

After PI Planning, it’s essential to manage dependencies in a clear and consistent way. The RTE role helps create clear visibility on impediments to and progress toward our objectives.

For the ART, Scrum of Scrums (SoS) acts like a train-level stand-up. As an RTE, preparing well for SoS ensures we get the right outcomes. Facilitating well ensures it does not become a status meeting.

How to prepare for a successful SoS

Here are my tips and tricks for preparing a successful SoS in the RTE role.

Agenda and purpose

It’s important to provide a clear and visible agenda and purpose for SoS. This enables all the teams in the ART to prepare and show up with the right information to work dependencies and remove impediments.

Visuals to help review dependencies and progress toward objectives

We use the program board we built in SAFe Collaborate at PI Planning during SoS. We also use an iteration-by-iteration cross-team dependency board in our ALM tool.

Knowing we will use these in advance gives a clear place for everyone to prepare for the event. It also creates a visible place for dependencies and risks.

Representation from every team

Schedules can make it hard for every Scrum Master or team representative to attend SoS, but it must be a priority.

When Scrum Masters don’t represent their teams at SoS, questions go unanswered, and dependencies are harder to manage or make visible.

How to facilitate a successful SoS

Once I’ve prepared for SoS, here’s how I facilitate smoothly in the RTE role.

Pre-fill items in shared notes so you can spend time discussing risks, dependencies, and releases

A single, visible place for all SoS notes allows teams to add updates before the meeting. It allows others to review and show up to SoS ready to ask questions or share related information.

Ask questions that go beyond status updates to uncover dependencies

Ask clarifying questions about the work and related data in the ALM tool. Asking for visuals or links to related documents ensures everyone understands.

Mix up your questions each time. This prevents automatic responses and encourages thinking about the work from new angles.

Invite guests and people new to the company

This orients new people to your organization to your process for managing dependencies and risks. It also shows them where to find the information they may need about other teams’ work.

Check out the SoS Facilitator’s guide on the ART Events page of the SAFe Community Platform to improve your SoS facilitation.

Release Train Engineer

Prepare for the RTE Role in System Demo

The System Demo is the flashiest of ceremonies the RTE role facilitates. It’s when the teams get to show off the work they’ve completed during the iteration (or PI if it’s the PI system demo).

How to prepare for a successful system demo

Because System Demo is about showing off the work of the ARTs, it’s important that I prepare them for a smooth experience.

Prepare presenters in advance

I provide a timebox and share my agenda deck two days before the demo. Participants to leave a “live demo” slide if they plan to share their screens during the event.

Then I meet with speakers half an hour before the demo. We test the timing of presentations, handoffs, and technology. This ensures a smooth delivery.

Create a reusable template

Using a template that follows the same pattern makes it easy to prepare topics. The topics I select show the progress toward our objectives and strategic themes.

A familiar template and standard format will make preparations easy and calm the nerves of those not used to presenting.

Build in time for Q&A and space for the conversation to continue past the timebox

While the demo of the end-to-end solution is critical, it is as important that stakeholders have the opportunity to ask questions and provide feedback.

We often only have time for a few questions, so we create a thread in our company messaging app for more questions and discussions.

How to facilitate a successful system demo

Once I prepare everyone, facilitating a successful system demo is pretty straightforward. Here are a few essential tips.

Open the meeting with purpose and expectations

I always take the first few minutes of the system demo to remind everyone why we are there. I also remind them of their role in ensuring we meet the purpose:

  • Paying close attention
  • Asking questions
  • Giving feedback
  • Looking for ways what they saw affects or improves their work

Connect demo topics to objectives and strategic themes

I structure the agenda by grouping demos by strategic theme. As part of the agenda overview, I discuss each theme and how each demo will connect to the theme and the team’s objective.

Embrace silence

The group often hesitates to speak up when there are over 100 people on a call or in a room, including key stakeholders and customers.

As a facilitator, I open the floor to questions and feedback. Or I ask questions and then count to 10 in my head. This can feel like an eternity of silence that you want to fill. But nine times out of ten, right toward the end of the silence, someone will come forward with a question. If you don’t allow for silence, you will lose much of that engagement.

Looking for more tips and tricks? Check out:

Conclusion and Additional Resources

The RTE role of preparing for and facilitating ART-level events impacts the ART’s ability to:

  • Connect strategy to execution
  • Manage risks and dependencies
  • Understand the end-to-end value delivered during the PI

Preparing ourselves and others in advance removes in-the-moment confusion. It also increases understanding and transparency.

We create space to pivot and shift in the moment while achieving desired outcomes.

Coaching and modeling crucial conversations means more productive team engagement and outcomes.

I hope this blog post has inspired you to explore new ways to approach facilitating your events. To help you on your journey:

About Lieschen Gargano Quilling

Lieschen Gargano is a Release Train Engineer

Lieschen Gargano is a Release Train Engineer and conflict guru – thanks in part to her master’s degree in conflict resolution. As the RTE for the development value stream at Scaled Agile, Lieschen loves cultivating new ideas and approaches to Agile to keep things fresh and engaging. She also has a passion for developing practices for happy teams of teams across the full business value stream.

View all posts by Lieschen Gargano Quilling

How to Measure Team Performance: A Scrum Master Q+A

Assessing your team’s agility is an important step on the path to continuous improvement. After all, you can’t get where you want to go if you don’t know where you are. But you probably have questions: How do you measure a team’s agility, anyway? Who should do it, and when? What happens with the data you collect, and what should you do afterwards?

To bring you the answers, we interviewed two of our experienced scrum masters, Lieschen Gargano and Sam Ervin. Keep reading to learn their recommendations for running a Team successfully and Technical Agility Assessment.

Q: How does SAFe help teams measure their agility, and why should I care? 

Measure and Grow is the Scaled Agile Framework’s approach to evaluating agility and determining what actions to take next. Measure and Grow assessment tools and recommendation actions help organizations and teams reflect on where they are and know how to improve. 

The SAFe® Business Agility Assessment measures an organization’s overall agility across seven core competencies: team and technical agility, agile product delivery, enterprise solution delivery, Lean portfolio management, Lean-agile leadership, organizational agility, and continuous learning culture. 

business agility assessment

The SAFe Core Competency Assessments measure each of these core competencies on a deeper level. For example, the Team and Technical Agility (TTA) Core Competency Assessment helps teams identify areas for improvement, highlight strengths worth celebrating, and baseline performance against future growth. It asks questions about how your team operates. Do team members have cross-functional skills? Do you have a dedicated PO? How are teams of teams organized in your agile release trains (ARTs)? Do you use technical practices like test-driven development and peer review? How does your team tackle technical debt?

For facilitators, including scrum masters, the Team and Technical Agility Assessment is a great way to create space for team reflection beyond a typical retrospective. It can also increase engagement and buy-in for the team to take on actionable improvement items.

Q: Who should run a Team and Technical Agility Assessment? 

Running assessments can be tricky. Teams might feel defensive about being “measured.” Self-reported data isn’t always objective or accurate. Emotions and framing can impact the results. That’s why SAFe recommends that a scrum master or other trained facilitator run the assessment. A scrum master, SPC, or agile coach can help ensure that teams understand their performance and know where to focus their improvement efforts. 

Q: When should I do this assessment?

It’s never too early or too late to know where you stand. Running the assessment for your team when you’re first getting started with an agile transformation will help you target the areas where you most need to improve, but you can assess team performance at any time. 

As for how frequently you should run it … it’s probably more valuable to do it on a cadence—either once a PI or once a year, depending on the team’s goals and appetite for it. There’s a lot of energy in seeing how you grow and progress as a team, and it’s easier to celebrate wins that are demonstrated through documented change over time than through general sentiment.

Q: Okay, how do I prepare for and run it?

The agility assessment tools are available free to SAFe members and customers at the Measure and Grow page on the SAFe Community Platform. There you can choose from tools created for us by our partners, AgilityHealth and Comparative Agility.

Before you start the Team and Technical Agility Assessment, define your team’s shared purpose. This will help you generate buy-in and excitement. If the team feels like they’re just doing the assessment because the scrum master said so, it won’t be successful. They have to see value in it for them, both as individuals and as a team. 

Some questions we like to ask to set this purpose include, “What do we want it to feel like to be part of this team, two PIs from now?” And, “How will our work lives be improved when we check in one year from now?”

There are two ways you can approach running this assessment. Option #1 is to have team members take the assessment individually, and then get together to discuss their results as a group. Option #2 is to discuss the assessment questions together and come to a consensus on the group’s answers.

When we’ve run this assessment we’ve had team members do it individually, so we could focus our time together on review and actions. If you do decide to run it asynchronously it’s important as a facilitator to be available to team members, in case they have questions before you review your answers as a team.

Q: What else should I keep in mind?

We like to kick off the assessment with a meeting invitation that includes a draft agenda. Sending this ahead of time gives everyone a chance to prepare. You can keep the agenda loose so you have flexibility to spend more or less time discussing particular areas, depending on how your team chooses to engage with each question.

Q: Is the assessment anonymous? 

Keeping the answers anonymous is really helpful if you want to get more accurate results. We like to be very clear upfront that the assessment will be anonymous, so that team members can feel confident about being honest in their answers. 

For example, with our teams, we not only explained the confidentiality of individuals’ answers but demonstrated in real-time how the tool itself works so that the process would feel open and transparent. We also made it clear that we would not be using the data to compare teams to each other, or for any purpose other than to gain a shared understanding of where we are selecting improvement items based on the team’s stated goals.

Q: Then what? What do I do with the results?

Once you’ve completed the assessment using one of the two approaches, you’ll want to review the sections one by one, showing the aggregate results and allowing the team to notice their top strengths and top areas for improvement. Your job as facilitator is NOT to tell them what you think based on the results; it’s to help guide the team’s own discussion as they explore the answers. This yields much more effective outcomes!

One thing one of us learned in doing the assessment was how much we disagreed on some things. For example, even with a statement as simple as, “Teams execute standard iteration events,” some team members scored us a five (out of five) while others scored us a one. We treated every score as valid and sought to understand why some team members scored high and others low, just like we do when estimating the size of a user story. During this conversation, we learned an important fact. The product owner thought the iteration was executed in a standard way because she was the one executing it. But team members gave that statement a low score because they weren’t included in much of the decision-making. There was no consensus understanding for what “standard iteration events” meant to the team. 

This prompted a conversation about why the team isn’t always included in how the iteration was executed. We talked about the challenge of aligning schedules to share responsibility for decision-making in meetings. And we talked about the impact of team members not having the opportunity to contribute. 

As a result, the assessment did more than help us see where we needed to improve; it showed us where we had completely different perspectives about how we were doing. It prompted rich conversations that led to meaningful progress.

Q: Okay, I ran the assessment; now what? What are the next steps?

With your assessment results in hand, it’s now time to take actions that help you improve. For each dimension of the Team and Technical Agility Assessment, SAFe provides growth recommendations to help teams focus on the areas that matter most and prioritize their next steps. You should: 

  • Review the team growth recommendations together to generate ideas
  • Select your preferred actions (you can use dot voting or WSJF calculations for this; SAFe® Collaborate has ready-made templates you can use)
  • Capture your team’s next steps in writing: “Our team decided to do X, Y, and Z.” 
  • Follow through on your actions, so that you’re connecting them to the desired outcome
  • Check in on your progress at the beginning of iteration retrospectives

Finally, you’ll want to use these actions to set a focus for the team throughout the PI, and check in with business owners at PI planning on how these improvements have helped the organization make progress toward its goals.

Q: I’m ready! How do I get started? 

Fantastic. Just visit the Measure and Grow page at the SAFe Community Platform to choose your assessment tool. While you’re there, you can watch the video for tips or download the Measure and Grow Toolkit for play-by-play guidance. As you’re running the assessment, use the SAFe Collaborate templates to guide the discussion and identify actions and next steps. 

Have fun!

About the authors

Lieschen is a product owner and former scrum master at Scaled Agile.

Lieschen is a product owner and former scrum master at Scaled Agile. She’s also an agile coach and conflict guru—thanks in part to her master’s degree in conflict resolution. Lieschen loves cultivating new ideas and approaches to agile to keep things fresh and exciting. And she’s passionate about developing best practices for happy teams to deliver value in both development and non-technical environments. Fun fact? “I’m the only person I know of who’s been a scrum master and a scrum-half on a rugby team.”

Blog author Sam Ervin headshot

Sam is a certified SAFe® 5.0 Program Consultant (SPC) and serves as the scrum master for several teams at Scaled Agile. His recent career highlights include entertaining the crowd as the co-host of the 2019 and 2020 Global SAFe® Summits. A native of Columbia, South Carolina, Sam lives in Denver, CO, where he enjoys CrossFit and Olympic weightlifting.

Share:

Back to: All Blog Posts

Next: The Unparalleled Value of Emotional Intelligence, Part Two

To Accelerate Impact, Measure Team Performance and Cohesion

This post is part of an ongoing blog series where Scaled Agile Partners share stories from the field about using Measure and Grow assessments with customers to evaluate progress and identify improvement opportunities.

As organizations move from team-level agile to enterprise agility, predictive analytics and statistical insights play an increasingly important role in improving how organizations operate. Gartner predicts that this year, AI will create 6.2 billion hours of worker productivity globally, resulting in $2.9 trillion of business value. The rationale for this increased focus on data-driven insights is clear: while business environments continue to grow more complex and uncertain, the need for fast decision-making and agility has never been greater. 

By identifying potential problems before they become organizational challenges and applying proprietary algorithms to large amounts of data, we can identify patterns and direct organizational attention where it matters. But the insights must be shared in a way that helps change leaders improve their decision-making. 

To make complex statistical analysis useful, it should be presented in a way that inspires action.

The Impact Matrix: Measuring performance and cohesion

This challenge is the motivation behind the Impact Matrix, a canvas that immediately identifies how teams are doing based on two essential vectors of team potency: performance and cohesion. Getting an understanding of teams helps change leaders quickly recognize challenges, prioritize efforts, and develop improvements.

Let’s take a closer look at a sample Impact Matrix report and explore how it can accelerate an organization’s transformation efforts.

The Impact Matrix

As illustrated in this example, the teams (represented as dots) in an organization’s portfolio are positioned on the canvas based on their relative score across two vectors; performance and cohesion.

Depending on a respective team’s score and relative position, we can quickly identify a theme of focus, categorize a strategic approach, and pinpoint essential questions that leaders should consider when deciding next steps. 

Amplify: High performance, high cohesion (green zone)

Teams in the Amplify quadrant are performing at a relatively high level and there are no major disconnects between the team members. Organizations benefit from observing these teams, understanding what makes them perform consistently, and trying to amplify these norms across the broader organization. Some helpful questions to ask include, “To what degree is the environment enabling teams to perform at this level?” “What role does management play in empowering these teams to do so well?” and, “How can coaching help these teams sustain—and even exceed—their current levels?”

Align: High performance, low cohesion (yellow zone)

When teams are in the Align quadrant they are performing well, but there are significant disagreements and disconnects between team members. Organizations benefit from keeping a close eye on teams in this quadrant, as a lack of team cohesion is a leading indicator of deteriorating performance. Questions to consider for teams in this context include, “Are certain team members dominating conversations?” “Is there sufficient psychological safety so all team members can feel comfortable speaking up?” and, “Is there a clear purpose that team members can rally around?”

Mitigate: Low performance, low cohesion (red zone)

Teams in the Mitigate quadrant are indicating they need help: they’re not only performing poorly, but they’re also disconnected. Organizations benefit from listening to and engaging with these teams to help alleviate their challenges. Questions that may be helpful in this context include, “What are immediate actions we can take to ease the current situation?” “How can we better understand why the team feels challenged?” and “How can the organization give the team a safe environment to work out challenges?”

Improve: Low performance, high cohesion (yellow zone)

Teams in the Improve quadrant usually don’t remain there for long. These teams are performing relatively poorly, but they’re aware of their challenges—and typically, they take steps to improve their situation. Organizations benefit by helping these teams accelerate their improvement efforts and providing them with the necessary resources. Questions these teams should ask include, “What steps can the team take to start alleviating current challenges?” “How can the organization help?” and, “What insights do the data give us about where to start?”

Conclusion

By leveraging data and sophisticated analytics, the Impact Matrix helps change leaders accelerate their transformation efforts by focusing their work where it matters, pointing them in the right direction, and ultimately supercharging their ability to lead organizational change. Although data and meaningful analytics are insufficient to give you all the answers you need, they can help you ask better questions and complement your overall transformation strategy.

Do it yourself: Run the Impact Matrix on your release train or portfolio today to get a comprehensive picture of how teams are performing, and find out immediately where you can provide the most value to your organization. Activate your free Comparative Agility account on the SAFe Community Platform.

Matthew Haubrich is the Director of Data Science at Comparative Agility.

Matthew Haubrich is the Director of Data Science at Comparative Agility. Passionate about discovering the story behind the data, Matt has more than 25 years of experience in data analytics, survey research, and assessment design. Matt is a frequent speaker at numerous national and international conferences and brings a broad perspective of analytics from both public and private sectors.

Share:

Back to: All Blog Posts

Next: How 90 Teams Used Measure and Grow to Improve Performance by 134 Percent


Three Lessons I Learned in My First Year as a Product Owner – Agility Planning

My First Year as a Product Owner

I had managed marketing teams before, but being a product owner (PO) of an Agile marketing team was a completely new concept. As a team member, I was fortunate to spend a year watching POs do the job, which gave me a leg up. But I never really appreciated the intricacy of the position until I became one. Looking back at a year in the role, here are three key lessons I’ve taken from this experience.

The Scrum Master Is a PO’s Best Friend

Stop trying to do it all by yourself. You can’t, and you don’t have to. The scrum master is your co-leader. They don’t just run retros; they’re your sounding board and partner.  

Consider this: scrum masters spend their entire day thinking about how to support the team. Not the customer, not the executives—the team. So, listen to them. When they give you constructive criticism, listen. If they give you advice, listen. Scrum masters are often the ones at the back of the room watching everyone’s body language and unspoken communication while you’re busy thinking about the stories and features. They can catch things you don’t, so listen to them.

Planning Is Hard but Don’t Give Up

A year ago, you would find me crying after each iteration planning. Somehow we would start with 270 percent of capacity and be lucky if we got down to 170 percent—almost twice as much work planned than we could ever physically complete. If our planned capacity was ridiculous, our predictability was nonexistent. One iteration, we’d complete 120 percent, the next 50 percent—who knew what you were going to get from us.  

But we stuck with it.

We invested in iteration planning and backlog refinement. We went back to basics, agreeing on the definition of a “1” so we could do relative sizing. We started planning poker, where everyone on the team had a say in how to size stories, even if they personally were not doing the work.  And we started getting more serious and explicit about what we could and couldn’t accomplish inside two weeks.

A year later, I beam with pride. We’re a predictable and high-performing team. When we tell another team we can deliver something within an iteration; it’s the truth. Not a gut check, and employees don’t have to work insane hours to make it happen.

Pro Tip: If you’re struggling with iteration planning, I strongly recommend downloading the Iteration Planning Facilitator Checklist on the SAFe Community Platform. There’s also a good instructional video on the Team Events page.

iteration planning

PI Planning Is Not A Drill

I usually start thinking about PI Planning in iteration four. I don’t have features, I don’t know what the pivots will be, but I’m already thinking about what conversations I have to have to get my team ready. I’ve already got my finger in the air to sense the direction of the proverbial wind. My scrum master and I spend a lot of time thinking about preparing the team for PI Planning, creating space for exploration, and making sure we discuss every possible dependency, so there aren’t surprises later.

Virtual PI Planning offers another level of complexity. It’s absolutely critical that I have everything organized for my team and me, documented, and ready to go before we log in. The team knows where to find information, what the marketing objectives are, and what teams we need to sync with to plan our work.

Are you a PO? What lessons have you learned? What do you wish you knew when you started? Join the conversation in the SAFe Product Owners/Managers Forum on the SAFe Community Platform.

About Hannah Bink

Hannah Bink heads the Marketing Success team at Scaled Agile

Hannah Bink heads the Marketing Success team at Scaled Agile. She has nearly 15 years of B2B marketing experience and studied business at Pennsylvania State University. Prior to Scaled Agile, Hannah spent the majority of her career in telecommunications and healthcare sectors, running global marketing divisions. She is also author of the “Musings of a Marketeer” blog, and lives in Denver, Colorado.

View all posts by Hannah Bink

Share:

Back to: All Blog Posts

Next: How Vendors Can Apply Customer Centricity When Organizing Around Value

Winning the Customer with Experience Architecture – Agility Planning

 Experience Architecture

As the post-digital economy begins to boom and the worlds of business process and technology come together, it’s time to think about how we optimize the whole from a unified, customer-centric perspective. Some organizations have begun to master the idea of experience architecture, whereas others are just beginning.

During my years consulting, I’ve had the opportunity to work with complex system architecture. Such as the APIs and data structures across multiple federal agencies that manage annual earnings and death records for every person in the United States. I’ve also experienced complex business architectures responsible for moving passengers, aircraft, and cargo around the world in a safe and predictable manner.

What was obvious to me in these and other scenarios was that there was no way we could treat the disciplines of business architecture and technical architecture as independent variables. Especially if these organizations hoped to keep up with the speed of innovation. In early experiments, I hypothesized that by pairing business architects with their peer application architects, we could better design experiments to achieve business outcomes that were efficient and technically sound. My hypothesis was partially proven. There were still missing pieces of the equation.

In later experiments, I treated the various architects in the value stream as an Agile team composed of all architectural perspectives that we needed to deliver the solution. Those perspectives included business architecture, application architecture, systems architecture, data architecture, information security, and even Lean Six Sigma Black Belts to help keep the group focused on flow efficiency. That experiment had some cool outcomes, though I had come to realize one obvious hole: the lack of consideration for the people in the system. We needed a different skill set. We needed experience in architecture.

Curated Experiences and Powerful Moments

In their book The Power of Moments, Chip and Dan Heath give many examples of how people remember exceptionally good and exceptionally poor experiences. The authors illustrate how average experiences are largely forgettable. Conversely, experiences that are repeated merge together so that customers develop a general perception of the experiences, but don’t remember any experience in particular.

My family visits Disney. A lot.

Before I met my wife, I’d been to Disney World twice in my life. Once when I was eight and again as a teenager. I have fond memories of each trip and can remember specific moments. These were positive experiences and here’s why.

Since having met my wife, I’ve been to Disney an average of twice annually and as many as four times in a single year. Each of those experiences has been positive, but I can’t articulate why. I know that I enjoy Animal Kingdom and the Avatar ride in Pandora. I know that the Magic Kingdom gives me anxiety and that you can get prosecco at Epcot. Unlike the trips of my youth which are memorable, not a single visit as an adult stands out. The experiences have merged.

 Experience Architecture

My Disney experience is what most customers experience as they interact with our value streams. The customer will form a general feeling and only talk about the experience: if it was exceptionally good or exceptionally bad.

Need proof? Check out the reviews on Amazon or Google. You’re likely to see mostly very positive and very negative reviews without much in the middle. There is power in moments. The moments are what we remember and they can be curated when an organization makes investments in experience architecture.

Map Value Streams and Understand the Experience

Similar to the steps of value stream identification and business architecture, the first step in articulating a customer experience is to map the operational value stream. With alignment on how the business operates, the next step in understanding the customer experience is to visualize the technology that supports the operation and the development value streams that maintain the technology. Speaking of value streams, check out this cool webinar where I talk about them with Danny Presten.

With the value streams mapped, the next step is to embark on a journey to optimize the whole by eliminating technical and operational debt. With the help of business architecture, we can leverage the time focused on improvement to begin identifying opportunities for large-scale improvement in operational throughput. Additionally, the organization can begin investing in capability modeling with the goal of running more experiments for strategy implementation, faster.

With the operational value stream mapped, the underlying architecture understood, and a commitment made to relentless improvement, we can now begin exploring the customer experience.

Map the Experience

Now that we’re ready to map the customer experience, we begin by seeking to better understand the customer. SAFe® advocates using design thinking as a framework for customer centricity to best use personas, empathy maps, and experience maps. The art of experience mapping follows similar best practices used in other forms of value stream mapping. The distinct difference is that we engage with customers to understand their journey from their perspective.

Below is an example of an experience map that depicts the experience of an online public learner in the SAFe ecosystem. At the top, you’ll notice the phases of the customer journey, followed by the operational value stream. We continue by seeking to understand the customer’s goal within each component of the value stream, the touchpoints that Scaled Agile has with the customer, and finally, the customer’s happiness after having completed the operational component.

Similar to other types of value stream mapping, with the customer experience articulated, we can now start on a path to relentlessly improve the customer experience and curate memorable moments.

 Experience Architecture

Curate Unforgettable Moments

The Heath brothers explain the power of moments as a key theme in their book. For me, the true power of moments became evident when I purchased a new home in July of 2020. Veterans United Home Loans has made a significant investment in its customer experience and has taken advantage of the power of moments. The proof? The fact that nearly a year later I am blogging about my mortgage experience.

If you’ve ever bought a home, you can probably empathize when I say that it’s a stressful experience. In any mortgage transaction there are two particularly stressful phases for future homeowners: approval, and more notably, underwriting. Through their work in experience mapping, Veterans United was able to recognize this and curate moments to help ease the stress a little. When I received the approval for my home, my mortgage broker, Molly (do you remember the name of your mortgage broker?), sent me a pair of Veterans United socks.

 Experience Architecture

Yes, socks. They weren’t the best quality, they were kind of corny, but they made me smile and I’m still talking about them. Moment curated. 

When I closed underwriting, the curated moment was a little more personal. Molly had done her homework and knew that I liked to barbecue. So, she sent me a nice set of outdoor cooking utensils. As you sit there and ponder the ROI on socks and cooking tools, remember that you now know about Molly and Veterans United. ROI achieved. 

What low-cost, high-impact moments can you curate for your customers? How can you turn an otherwise forgettable experience into something that people remember for years to come? These actions are key to winning in the post-digital economy. Consumers want to know your organization is human. They want to know that you care. What can you do to help make that connection?

Experience Architecture: Conclusion

Success in the post-digital economy will require business agility and a clear focus on the customer. Experience architecture is something organizations should employ to better understand the customer so they can release on demand, as determined by the market and customer.

If you’re an experienced experience architect, consider sharing your stories in our General SAFe Discussion Group on the SAFe Community Platform. To learn more about working with varying architectural disciplines, while maximizing the amount of work not done, and embracing a just enough, just-in-time approach, check out these architectural runway articles.

About Adam Mattis

Adam Mattis headshot

Adam Mattis is a SAFe Program Consultant Trainer (SPCT) at Scaled Agile with many years of experience overseeing SAFe implementations across a wide range of industries. He’s also an experienced transformation architect, engaging speaker, energetic trainer, and a regular contributor to the broader Lean-Agile and educational communities. Learn more about Adam at adammattis.com.

View all posts by Adam Mattis

Share:

Back to: All Blog Posts

Next: Aligning Global Teams Through Agile Program Management: A Case Study

Measuring Agile Maturity with Assessments – Agile Adoption

Stephen Gristock is a PMO Leader and Lean Agile Advisory Consultant for Eliassen Group, a Scaled Agile Partner. In this blog, he explores both the rationale and potential approaches for assessing levels of Agility within an organization.

A Quick Preamble

Measuring Agile Maturity with Assessments

For every organization that embarks upon it, the road to Agile adoption can be long and fraught with challenges. Depending on the scope of the effort, it can be run as a slow-burn initiative or a more frenetic and rapid attempt to change the way we work. Either way, like any real journey, unless you know where you’re starting from, you can’t really be sure where you’re going.

Unfortunately, it’s also true that we see many organizations go through multiple attempts to “be Agile” and fail. Often, this is caused by a lack of understanding of the current state or a conviction that “we can get Agile out of a box.” This is where an Agile Assessment can really help, by providing a new baseline that can act as a starting point for Agile planning or even just provide sufficient information to adjust our course.

What’s in a Word?

We often hear the refrain that “words matter.” Clearly, that is true. But sometimes humans have a tendency to over complicate matters by relabeling things that they aren’t comfortable with. One example of this within the Agile community is our reluctance to use the term “Assessment.” To many Agilists, this simple word has a negative connotation. As a result, we often see alternative phrases used such as “Discovery,” “Health-check,” or “Review.” Perhaps it’s the uncomfortable proximity to the word “Audit” that sends shivers down our spines! Regardless, the Merriam-Webster dictionary defines “assessment” as:

“the act of making a judgment about something”

What’s so negative about that? Isn’t that exactly what we’re striving to do? By providing a snapshot of how the existing organization compares against an industry-standard Agile framework, an Assessment can provide valuable insight into what is working well, and what needs to change.

The Influence of the Agile Manifesto

When the Agile movement was in its infancy, thought leaders sought to encapsulate the key traits of true agility within the Agile Manifesto. One of the principles of the manifesto places emphasis on the importance of favoring:

“At regular intervals, the Team reflects on how to become more effective, then tunes and adjusts its behavior accordingly”

Of course, this is key to driving a persistent focus on improvement. In Scrum this most obviously manifests itself in the Retrospective event. But improvement should span all our activities. If used appropriately, an Agile Assessment may be a very effective way of providing us with a platform to identify broad sets of opportunities and improvements.

Establishing a Frame of Reference

Just like Agile Transformations themselves, all Assessments need to start with a frame of reference upon which to shape the associated steps of scoping, exploration, analysis, and findings. Otherwise, the whole endeavor is just likely to reflect the subjective views and perspectives of Assessor(s), rather than a representation of the organization’s maturity against a collection of proven best practices. We need to ensure that our Assessments leverage an accepted framework against which to measure our target organization. So, the selected framework provides us with a common set of concepts, practices, roles, and terminology that everyone within the organization understands. Simply put, we need a benchmark model against which to gauge maturity.

Assessment Principles

In the world of Lean and Agile, intent is everything. To realize its true purpose, an Assessment should be conducted in observance with the following overriding core principles:

  • Confidentiality: all results are owned by the target organization
  • Non-attribution: findings are aggregated at an organizational level, avoiding reference to individuals or sub-groups
  • Collaboration: the event will be imbued with a spirit of openness and partnership- this is not an audit
  • Action-oriented: the results should provide actionable items that contribute toward building a roadmap for change

Also, in order to minimize distraction and disruption, they are often intended to be lightweight and minimally invasive.

Measuring Agile Maturity with Assessments

Assessment Approaches

It goes without saying that Assessments need to be tailored to fit the needs of the organization. In general, there are some common themes and patterns that we use to plan and perform them. The process for an archetypal Assessment event will often encompass these main activities:

  • Scoping and planning (sampling, scheduling)
  • Discovery/Info gathering (reviewing artifacts, observing events, interviews)
  • Analysis/Findings (synthesizing observations into findings)
  • Recommendations (heatmap, report, debrief)
  • Actions/Roadmap

Overall, the event focuses on taking a sample-based snapshot of an organization to establish its level of Agile Maturity relative to a predefined (Agile) scale. Often, findings and observations are collected or presented in a Maturity Matrix which acts as a tool for generating an Agile heatmap. Along with a detailed Report and Executive Summary, this is often one of the key deliverables which is used as a primary input to feed the organization’s transformation Roadmap.

Modes of Assessment

Not all Assessments need to be big affairs that require major planning and scheduling. In fact, once a robust baseline has been established, it often makes more sense to institute periodic cycles of lighter-weight snapshots. Here are some simple examples of the three primary Assessment modes:

  • Self-Assessment: have teams perform periodic self-assessments to track progress against goals
  • Peer Assessments: institute reciprocal peer reviews across teams to provide objective snapshots
  • Full Assessment: establish a baseline profile and/or deeper interim progress measurement

Focus on People—Not Process and Tools

Measuring Agile Maturity with Assessments

Many organizations can get seduced into thinking that off-the-shelf solutions are the answer to all our Agile needs. However, even though a plethora of methods, techniques, and tools exist for assessing, one of the most important components is the Assessor. Given the complexities of human organizations, the key to any successful assessment is the ability to discern patterns, analyze, and make appropriate observations and recommendations. This requires that our Assessor is technically experienced, knowledgeable, objective, collaborative, and above all, exercises common sense. Like almost everything else in Agile, the required skills are acquired through experience. So, choosing the right Assessor is a major consideration.

Go Forth and Assess!­

In closing, most organizations that are undergoing an Agile transformation recognize the value of performing a snapshot assessment of their organization against their chosen model or framework. By providing a repeatable and consistent measurement capability, an Assessment complements and supports ongoing Continuous Improvement, while also acting as a mechanism for the exchange and promotion of best practices.

We hope that this simple tour of Assessments has got you thinking. So what are you waiting for? Get out there and assess!

For more information on assessments in the SAFe world, we recommend checking out the Measure and Grow article.

About Stephen Gristock

Stephen Gristock - Specializing in Agile-based transformation techniques

Specializing in Agile-based transformation techniques, Stephen has a background in technology, project delivery and strategic transformations acquired as a consultant, coach, practitioner, and implementation leader. Having managed several large Agile transformation initiatives (with the scars to prove it), he firmly believes in the ethos of “doing it, before you teach/coach it.” He currently leads Eliassen Group’s Agile advisory and training services in the NY Metro region.

View all posts by Stephen Gristock

Share:

Back to: All Blog Posts

Next: How I Prepared to Teach My First Remote Class

How We Used DevOps to Rework Our SAFe® DevOps Course – The SAFe Approach

There’s no faster way to kill a conversation among a non-technical crowd than to begin discussing DevOps. For many, DevOps is that “technical thing” that IT teams do to automate testing. Or, to paraphrase an actual conversation I once had with a client:

“Doesn’t DevOps use that guy Jenkins to monitor something called technical debt so that we can have a cleaner Git, which somehow allows our Kubernetes to Docker? All I know is that our operations people don’t like it when we release on demand, and our annual software releases just deliver last year’s trends too late.”

There are many of us who probably own a small share of the responsibility that has brought about that sort of (mis)understanding. Part of creating an environment that will help a business survive and thrive in the post-digital economy is to do better at explaining the “why” as much as the “what.” To begin making amends for my previous DevOps shortcomings, let’s focus on the “why” of DevOps, and how it led to the recent refactoring of the SAFe® DevOps courseware. 

The SAFe Approach to DevOps

SAFe Approach to DevOps

After more than a decade of experimenting and learning, the DevOps community has discovered that effective DevOps entails a deep appreciation for culture, automation, Lean flow, measurement, and sharing (CALMS). In other words, DevOps requires that energy be directed toward each of these areas—not necessarily equally, but in balance—to achieve desired outcomes. SAFe echoes this belief, with one modification: sharing is a natural component of culture, which makes room for ‘recovery’ as a new element. Hence, SAFe’s CALMR approach to DevOps. What’s more, we aim to explore the notion that DevOps only applies to technology. In fact, we’ve found great success applying the CALMR approach throughout our business.

Culture. In SAFe, DevOps leverages the culture created by adopting the Lean-Agile values, principles, and practices of the entire Framework. Nearly every principle of SAFe, from Principle #1, take an economic view, to Principle #10, organize around value, applies to DevOps. DevOps enables shifting some operating responsibilities upstream, while following development work downstream into deployment, and operating and monitoring the solution in production.

Automation. DevOps recognizes that manual processes are the enemy of fast value delivery, high productivity, and safety. This is because manual processes tend to increase the probability of errors in the delivery pipeline, particularly at scale. These errors in turn cause rework, which delays desired outcomes. Automating the Continuous Delivery Pipeline via an integrated ‘toolchain’ accelerates processing time and shrinks feedback cycles. It’s this feedback—from customers, stakeholders, solutions, infrastructure, and the pipeline itself—that provides objective evidence that solutions are (or aren’t) delivering the expected value.

Lean flow. Agile teams and trains strive to achieve a state of continuous flow, enabling new features to move quickly from concept to cash. The three keys to accelerating flow are reflected in Principle #6, visualize and limit WIP, reduce batch sizes, and manage queue lengths. All three are integral to the ongoing optimization of the Continuous Delivery Pipeline. I describe each one below in the context of DevOps.

Measurement. Achieving extraordinary business outcomes with DevOps requires optimizing the Continuous Delivery Pipeline. Solutions, the systems on which they run, and the processes by which they are delivered and supported must be frequently fine-tuned for maximum performance and value. What to optimize, how to optimize it, and by how much are decisions that need to be made on a near-constant basis. These decisions are rooted in Principle #1, take an economic view, and Principle #5, base milestones on an objective evaluation of working systems—not merely on intuition. Thus, the ability to accurately measure delivery effectiveness and feed that information back into relentless improvement efforts is critical to DevOps success.

RecoveryTo support frequent and sustained value delivery, the Continuous Delivery Pipeline must be designed for low-risk releases and fast recovery from operational failure. Techniques to achieve a more flexible release process are described in the Release on Demand article.

Refactoring DevOps with DevOps

At Scaled Agile, we do our best to “Be SAFe.” With that directive, we constantly seek ways to apply the mindset, values, and principles behind the Framework to our daily work. During the continuous exploration cycle within our last PI, Product Management discovered an opportunity to improve our DevOps course to better suit the post-pandemic way of learning. Leveraging our culture, we were able to successfully DevOps DevOps in the PI that followed. Here’s what we did.

How We Used DevOps

MeasurementBy investing in and monitoring measurement, the team was able to identify an abnormality in the system before it materialized into something larger.

Culture of shared ownershipInstead of figuring out who was to blame for the findings, the team focused on figuring out what was taking place in the system and what we could do to resolve it. We conducted customer research, market research, member interviews, and instructor interviews. And we discovered that the reason why people weren’t teaching the DevOps course was that we hadn’t prioritized it for online learning enablement. In short, DevOps was not one of our most taught courses, so economics hadn’t yet dictated that enabling that courseware was the most important job to be done. The people who worked on the refactor were a truly cross-functional group. There were technical team members, such as the Framework SME, design experts and exam designers, and non-technical members, including the Product Owner, Product Manager, operations, business development, and legal. 

Lean flowWith the work identified, we broke down the DevOps course update into stories and managed everything based on the cross-functional capability of the dev team. We prioritized the work based on the economies of job bundling, sequenced it based on dependency, and ranked it based on need. We focused first on updating course content based on known defects and 5.1 updates: a shippable unit of value. We based redeveloping the course storyline on new team capabilities and market feedback: another shippable increment of value. Next, we focused on developing, deploying, and validating the digital classroom based on the newly created assets and the capabilities of SAFe® Collaborate—yet another shippable increment of value. Finally, with all the assets live through a dark launch, we were able to release on-demand based on optimal timing for our training partners.

RecoveryAs mentioned, we released the SAFe® DevOps course update and digital classroom via a dark launch. Meaning that the assets were live and ready to use but available only to a small number of test instructors. As these instructors delivered the updated training via the virtual classroom, team members could note improvement opportunities, correct defects in real time, and in the event of a catastrophic failure, revert the class to an alternate learning environment at a moment’s notice. 

Room for growth: automationAs the team worked through the DevOps update, it became apparent that we overlooked a particular aspect of CALMR in our own adoption: automation. As an organization that creates many digital and print assets with a varying degree of content redundancy, we noticed that we missed an opportunity to save time and better ensure quality through automation. In its most simplistic form, we recognized the benefit of managing a repository for commonly used assets. In a more advanced state of automation, we thought it would be cool to leverage a content management system that would allow us to update all instances of an artefact across all assets from a single repository.

Relentless Improvement

DevOps, like SAFe, Agile, or Lean, is a never-ending pursuit of relentless improvement. Our team was again reminded that no matter how good you are, even if you’re the people writing the playbook, that there are always ways to do things better. DevOps was developed to bridge the gap between software project teams and operations teams to better assure quality and speed within delivery cycles. DevOps comes from the same software-centric roots as Agile, and we’re learning that applying DevOps also extends beyond the problems which it was initially designed to solve.

How may the concepts of CALMR support the type of work you do? Join the conversation and share your experience in the forums on the SAFe® Community Platform (login required).

About Adam Mattis

Adam Mattis headshot

Adam Mattis is a SAFe Program Consultant Trainer (SPCT) at Scaled Agile with many years of experience overseeing SAFe implementations across a wide range of industries. He’s also an experienced transformation architect, engaging speaker, energetic trainer, and a regular contributor to the broader Lean-Agile and educational communities. Learn more about Adam at adammattis.com.

View all posts by Adam Mattis

Share:

Back to: All Blog Posts

Next: Why the Most Successful PMs and POs Share a Brain

Why the Most Successful PMs and POs Share a Brain – Implementing SAFe Successfully

In SAFe®, the Product Owner (PO) and Product Manager (PM) roles are critical for many reasons. We’ll start with the basics, the why, and the roles and responsibilities of each.

Product Owner (PO) and Product Manager (PM) roles

POs and PMs are essential to the success of SAFe. While they share areas of concern, both have their own focus. They both care about the Continuous Delivery Pipeline, they both iterate, and they both have content authority around their backlogs. They’re both responsible for continuous improvement, ensuring capacity for the architectural runway, communicating and collaborating on the vision and roadmaps, and much more.

And, they both focus on execution.

The PM leverages Customer Centricity and Design Thinking to reason about product enhancements, new product ideas, as well as innovation. The PO focuses on flow for development, release execution, and incremental delivery. And, they both embrace the Continuous Delivery Pipeline and the DevOps mindset. 

But there’s another element to the importance of their roles: their relationship with each other. The most successful POs and PMs share a brain.

There are many aspects to why this matters, so let’s synthesize them into three main “whys.”

Product Owner (PO) and Product Manager (PM) roles

Knowledge transfer, information coherence, and flow

OK, that’s actually three in one, but I put them together for a reason. These roles share a common goal. To inspire and transfer knowledge from the brains of who’s closest to the customer (PMs, Business Owners, etc.), into the brains of those responsible for execution (POs and teams). And, they need to do this with the highest possible level of information coherence, while removing delays and achieving flow.

Here’s an example from a recent PI Planning event I attended. The first day went swimmingly. The management problem solving workshop resulted in six adjustments to planning that were designed to help the teams. The PM spent 30 minutes kicking off day two talking about the adjustments and not too many people asked questions. But during the breakouts, all hell broke loose. The PM texted me saying, “I don’t think they heard a word I said!” The teams and POs argued about the changes, and this caused total chaos. All of which resulted in a huge “flow stoppage” to the entire PI Planning event. Looking back, I realized that the PM didn’t socialize the changes with the POs before day two kicked off, and the POs hadn’t bought into the shift. This completely interrupted any knowledge transfer and information coherence. Why did this happen? Because the PM and POs didn’t share a brain around the changes.

Transparency, content authority around their respective backlogs, and decentralized decision making

SAFe is a series of connected work items, some represented in Kanban, and others represented simply as backlogs. The Team backlogs are a combination of work being pulled from the Program Backlog with work from the local context. With that content, authority comes great responsibility to the product or solution, as well as the enterprise. The Program Backlog comes into PI Planning in the form of economically prioritized work items (Features).

Product Management leveraged their stakeholder management network as input to prioritize the work so that the teams can pull work for the PI that has the highest value to the business. The team backlog comes into PI Planning in the form of capacity allocated for other work items (maintenance, exploration, etc.), and is also prioritized, but slightly differently. The team backlogs are prioritized mostly for flow and execution of the value being pulled, which doesn’t necessarily align directly to the actual WSJF of the Program Backlog. 

For this to work, POs and PMs need early transparency into both sets of backlogs so they can make Lean and Agile decisions around the work, and maintain content authority around their respective backlogs. In other words, they need to share a brain around all of the work. Specifically, what capacity allocation are we recommending for maintenance? For refactoring? For exploration? And for new Feature development? What if something happens? What are our working agreements? By sharing a brain around these aspects and working agreements, POs and PMs can make real-time decisions as well as decisions around the backlog in which they have content authority.

Sharing a brain builds trust

We know that an environment that has trust creates a sense of safety for everyone involved. When PMs and POs really start sharing a brain and trusting each other to make decisions, magic happens. This is probably last on our list, as it’s the foundation for the previous two “whys.” 

I’ve been fortunate enough to have shared a brain with a few awesome PMs. And the impact of these relationships had real quantitative value. For example, literally anyone on the train could ask either of us a question and they’d get the same answer. This was so incredibly powerful. No more delays in answers or direction. No deviation from the vision. While of course we always want to encourage divergent thinking, there are always aspects of the backlog that have a strong answer (and direction), and others that could use a more collaborative approach. Knowing that both of us could be trusted to have the same answer controlled any backlash, but also created that sense of trust. The teams literally saw us as one, and whether the answer was: “I need to collaborate with my PM,” or a “specific answer,” they trusted us both implicitly. Just as we trusted the teams to deliver, they became extremely predictable in delivering against their objectives. This bi-directional trust not only helped us achieve our highest value in the shortest amount of time, but it created behavior models for others throughout the enterprise to follow. 

Product Owner (PO) and Product Manager (PM) roles

The How

Now that we’ve discussed the why, let’s look at the how. How the heck do PMs and POs actually share a brain? 

Well, it starts with some “symbiotic-ness,” First, having a common passion around the work creates some synchronicity as well as symbiosis. Then, learn to like each other, evolve, and explore common interests. Eventually, if enough time, emotional intelligence, and willingness occur, the PM and PO grow to love each other. This creates the ability to have extremely healthy dialogue, heated debate with no attachments to preconceived outcomes, and of course, that brain sharing.

Start with something simple. Get to know each other. Ask about each other’s family, their values, and their personal aspirations. Make lunch dates and keep them. Share food, common interests, and personal time. Realize that a successful relationship relies on true personal connections, not just what happens at work.

Here’s another example. After working with one particular PM for some time, her house burned down. The CEO of the company called me to let me know, and specifically asked that I didn’t call her. Well, at that point, we had shared such a deep relationship that I asked myself, “What would she want me to do?” She would want me to call her. So, I did. Together, we cried. She shared what she was going through. Of course, I offered to help in any way I could. She said that just the kindness of the gesture was enough for now, and that she promised she would ask for help when she got through the trauma and devastation at hand. 

None of that could have happened without the power and evolution of our POPM relationship. Sharing a brain. Getting to know each other. Sharing knowledge and understanding. Being transparent, while playing our own roles on the train. Creating trust within the organization that anyone could ask either of us a question and get the same answers. All this may seem like the soft stuff, but it’s how we grow our social networks, our relationships, and open up to share ideas, values, and opinions on how to deliver the highest value to our customers and society. 

After all, who doesn’t want that?

Check out these articles to get different perspectives about PO and PM roles, responsibilities, and relationships:

About Jennifer Fawcett

Jennifer Fawcett - a retired, empathetic Lean and Agile leader

Jennifer is a retired, empathetic Lean and Agile leader, practitioner, coach, speaker, and consultant. A SAFe Fellow, she has contributed to and helped develop SAFe content and courseware. Her passion and focus has been in delivering value in the workplace and by creating communities and culture through effective product management, product ownership, executive portfolio coaching, and leadership. She has provided dedicated service in these areas to technology companies for over 35 years.

View all posts by Jennifer Fawcett

Share:

Back to: All Blog Posts

Next: SAFe and Business Architecture

SAFe and Business Architecture – Lean and Agile Journey with SAFe

SAFe and Business Architecture

As organizations begin their Lean and Agile journey with SAFe®, SPCs will introduce a tool designed to help organizations determine the best, most logical place to launch their first Agile Release Train (ART). The Value Stream and ART Identification Workshop are designed to help organizations identify the sweet spot where an opportunity to deliver value intersects with a clear problem to solve, leadership support, a clear product or solution, and collaborating teams.

It’s challenging to meet the criteria mentioned above, which is why many are tempted to launch ARTs within easier-to-identify constructs such as organizational silos. This rarely works. As we know, value often does not follow the organizational hierarchy. However, it’s important to understand that value stream identification is the first step in an ongoing practice of flow management to optimize the speed of delivery, quality, and customer delight. 

Why we perform value stream identification

Words matter, and there’s a clear distinction between value stream identification and value stream mapping. We advocate identifying value streams as you get started with SAFe. Value stream mapping is an ongoing practice of understanding, tuning, and planning how the organization will deliver value against its strategy in the long term. 

  • Value stream identification is something we seek to accomplish in a day or two
  • Value stream mapping is a practice that we sustain indefinitely 

Depending on an organization’s state of maturity in the realm of business architecture, one can inform the other, and neither is independent of the other. 

The role of business architecture

The role of business architecture is to provide clarity of how an organization’s capabilities and infrastructure come together to deliver business outcomes. The business architect is responsible for developing artifacts that help the organization operationalize strategy and assure the operational and technological enablement of core capabilities across value streams. In the context of this post, it’s important to understand the difference between how business architecture and SAFe use the word “capability.”

Capability, as defined by SAFe: Artifacts that may originate in the local context of the solution or occur as a result of splitting portfolio Epics that may cut across more than one value stream. Another potential source of capabilities is the Solution Context, where some aspect of the environment may require new solution functionality. In a SAFe context, the delivery of a capability requires collaboration between more than one ART. 

Capability, as defined in business architecture: An expression of what a business does and can do.

Though when exploring the discipline of capability modeling, the nuance between the two definitions disappears, the terms in common usage may cause confusion early on. It’s likely that we’ll dive deeper into the relationship between SAFe and business architecture and provide more clarity of how the two disciples come together on a midterm horizon. To provide additional understanding of how these words may come together, consider the context of a shipping services provider.

Capability: Package tracking.

Process: Generate tracking number.

Value stream: From order received to package delivered.

System: System ‘X’ is the system used to realize the tracking capability.

Service-oriented architecture (SOA) or microservice: Tracking could be an SOA service or microservice depending on the architecture of the system. But either instance refers to the specific mechanisms that deliver the intent of the capability.

Capability (as used in SAFe): Real-time package tracking.

Notice how capability, as defined in SAFe, extends the functionality of how capability is defined in the context of the business architecture discipline. This may give an indication of how future guidance could evolve.

Value stream mapping

The goal of value stream mapping, as defined in business architecture communities, is to map value delivery processes from concept to cash within a business. The SAFe definition of an operational value stream, the sequence of activities needed to deliver a product or service to a customer, aligns with most other common definitions of the term. SAFe also provides distinction and guidance for interacting with different types of operational value streams to include fulfillment, manufacturing, software production, and supporting value streams. Depending on the altitude of your perspective within an organization, these categories of value delivery may seem too granular, too broad, or just right. 

In the discipline of business architecture, architects are responsible for mapping an organization’s value streams from macro to micro. For example, a top-level value stream map for a shipping services provider may look something like this.

SAFe and Business Architecture
Example: top-level operational value stream

This simplistic view likely represents thousands of integrated software systems, multiple complex distribution hubs, scores of human hands, and millions of packages each day. Through the discipline of value stream mapping, business architects have the responsibility to understand and map how an organization does business. It starts with the macro perspective illustrated above. And continues to the micro level of how, within the context of the routing box above, shipping crates are planned, packaged, and sequentially loaded into trucks or aircraft given the specific weights, classes of service, and destinations of parcels on any given day.

SAFe and Business Architecture
Example: routing value stream

SAFe seeks to optimize the operational and development value streams that make the top-level run. In the example above, there are likely operational value streams within the distribution centers that physically move packages, others that control the movement of vehicles, and still others that produce the technology to seamlessly coordinate those events, which is typically where we operate in SAFe. 

SAFe focuses primarily on the development and management of development value streams, with the intent of optimizing the design/validate/deploy activities that make an operation run. Though as the world becomes more digitally integrated, the conversation is likely to evolve.

Many organizations seeking to embrace the methods outlined in SAFe lack an existing value stream body of knowledge. And one of the first steps to take to achieve a successful transformation is to begin focusing on value. The Value Stream and ART Identification Workshop helps provide the value perspective, and will likely surface organizational challenges that have historically served as a barrier to a value focus. These include communication barriers, duplicative technology systems, and business processes, and a lack of alignment within the organization. These challenges are not because of SAFe, but because the organization seeks to optimize for speed of delivery, solution quality, and customer satisfaction. You must address the problems that surfaced in value stream identification to achieve the desired outcomes. 

Once an ART is launched, the work of optimizing for value delivery continues. Launching an ART will lead the organization with a powerful step forward. But to truly optimize the entire system, you’ll likely need to invest in value stream mapping through and by embracing business architecture practices.

Capability mapping

With the value stream identified, an evolution to business architecture seeks to understand the capabilities of an organization. Simply put, knowing how each of the processes on the value stream map incrementally supports the delivery of value. Capabilities provide the organization with an as-is view of how the organization operates.

For example, the ultimate goal of someone who ships a package is for that package to arrive at its intended destination on time. The capability of tracking intends to provide the customer with the assurance that their goal, the aim of the value stream, will be fulfilled as expected. Additionally, it provides transparency should the service expectations fall short.

SAFe and Business Architecture
Example: Business capability

Capability modeling

Capability modeling is an extension of capability mapping that helps inform how the business may need to alter its capabilities to achieve some sort of strategic intent. That could include improved customer satisfaction, more transparency, or even the expansion or contraction of the organization.

SAFe and Business Architecture
Example: Implementing strategy with capability modeling 

For organizations that want to compete in the digital age, the ability to leverage business architecture and capability modeling when testing an Epic’s hypothesis is the ultimate fuel to feed ARTs. Effective Lean Portfolio Management helps provide the objective clarity to understand the impacts of strategy and validate hypotheses. That vision clarifies how business architecture and capability mapping investments work along your journey to business agility and thriving in the digital age.

Where to start

Some level of business architecture capability exists in many organizations at some level. The best place to check if your organization has existing value stream or capability maps is with the office of the chief strategy officer. 

If your organization doesn’t have existing artifacts, the SAFe Value Stream and ART Identification Workshop is a great tool to continue the conversation beyond informing the launch of the first ART. You can use the guidance in the toolkit to identify the operational value stream and apply it to your altitude of influence to fully articulate how the business area delivers value. You can reinforce your map by fully identifying the people who work within the value stream, the systems that support the value stream, and the people who work on those systems—all as guided by the workshop. The main differentiator between this effort and the initial Value Stream and ART Identification Workshop is the intent of mapping with more precision for the purpose of developing a deeper artifact, versus the initial conversation which is focused on finding the best place to launch an ART. 

After you’ve articulated the value stream, you can reinforce it by considering guidance in the SAFe® DevOps course, which helps provide visibility into lead time, process time, and cycle time. Then, with the value stream articulated and the flow metrics in hand, the organization will be able to make informed decisions on how to best improve the rate of flow within the value stream. From there, opportunities will likely emerge to expand the work into other areas of the business, explore capability mapping, expand to experience architecture, and more. 

If there’s one thing I’ve learned from my years of working with Lean, Agile, and SAFe tools, it’s that well-intended, value-add work to better the organization and customer experience always yields new opportunities.

Good luck!

About Adam Mattis

Adam Mattis headshot

Adam Mattis is a SAFe Program Consultant Trainer (SPCT) at Scaled Agile with many years of experience overseeing SAFe implementations across a wide range of industries. He’s also an experienced transformation architect, engaging speaker, energetic trainer, and a regular contributor to the broader Lean-Agile and educational communities. Learn more about Adam at adammattis.com.

View all posts by Adam Mattis

Share:

Back to: All Blog Posts

Next: The Challenge of Economic Prioritization