Teams at Travelport benefit from practicing SAFe’s main event, PI Planning
Share:
Back to: Customer Stories
Next: Travelport: PI Planning with Distributed Teams Customer Story
Travelport’s winning recipe for PI Planning across India, the UK, and US
Back to: Customer Stories
Next: Lockheed Martin Customer Story
Lockheed Flying the F-16 into the Future with SAFe: Evolving the Falcon Factory
Presented at the 2019 Global SAFe Summit, San Diego Oct. 2, 2019, The F-16 Fighting Falcon is the world’s most successful, combat-proven multirole fighter with approximately 3,000 operational F-16s in service today in 25 countries. In 2014, new production orders were drying out, and the F-16 production line was in danger of shutting down. Our solution to that problem was the adoption of SAFe to streamline the F-16 Product Development and Engineering in 2015. We overcame a lot of challenges along the way, and made rapid progress initially, but have plateaued. That should come as no surprise though. Our limited SAFe implementation showed us limited results. But we are turning this ship around! This year we have really taken stock of our Agile Transformation and implemented several ground-breaking initiatives that are changing our landscape. Lockheed has now started a new F-16 production facility in Greenville, South Carolina that is producing F-16s expected to operate to 2070 and beyond!
Back to: Customer Stories
Next: Bosch/ETAS Customer Story
Presented at 2019 Global SAFe Summit, San Diego Oct. 2, 2019
For over 130 years the name “Bosch” has been associated with forward-looking technology and trailblazing inventions that have made history. Bosch does business all over the world and is active in the most wide-ranging sectors. In particular, BOSCH is the largest supplier for the global automotive industry.
Dr Volkmar Denner, CEO of Bosch; “For Bosch agility is crucial, it allows us to adjust to the increasing speed of change around us. Agility allows us to remain in a position as an innovation leader.”
This video tells the story of how an enterprise of more than 70,000 knowledge workers and traditionally independent business areas have faced the challenge of an agile transformation and started an alignment to common a strategy for mobility solutions and the SAFe journey. It provides a deep dive into one of Bosch`s Business Units, ETAS, and shows what was already achieved by introducing the SAFe and focusing on current activities in Lean Portfolio Management and how the company organizational structure is being adopted as a consequence of the SAFe transformation.
Back to: Customer Stories
Next: PepsiCo Customer Story
Presented at 2019 Global SAFe Summit, San Diego Oct. 2, 2019
How do the User Design (UX) principles of Simple, Human and Connected guide an ART to interpret and incorporate user-centric design (UCD)? What is the ideal operating model for UX design that includes discovery, design and delivery tracks? This talk will provide an overview of the hypotheses applied to deliver user-centric design within the Scaled Agile Framework® at PepsiCo.
Back to: Customer Stories
Next: Anthem Customer Story
Anthem Agile Transformation Journey
Anthem chose to apply the Scaled Agile Framework incrementally, rather than a big bang rollout. Approaching the problem from both top-down and bottom-up, the SAFe transformation for the enterprise concentrated on one vertical slice at a time working with both Business and IT leaders in an area to enable Lean-Agile practices and provide hands-on coaching and education to drive the adoption of the Agile mindset.
They chose to apply the Scaled Agile Framework incrementally, rather than a big bang rollout. Approaching the problem from both top-down and bottoms-up, the transformation for the enterprise concentrated on one vertical slice at a time working with both Business and IT leaders in an area to enable Lean Agile practices and provide hands-on coaching and education to drive the adoption of the Agile mindset.
They worked closely with their partners to go beyond just the mechanics of training and coaching with a focus on sustaining the change and moving towards true enterprise business agility.
Back to: Customer Stories
Next: Easterseals Customer Story
Nearly 140 million Americans rely on Medicare, Medicaid, the Children’s Health Insurance Program, and the health insurance exchanges—all programs administered by the Centers for Medicare & Medicaid Services (CMS). The agency pays out approximately $767 billion in benefits annually and employs 4,100 people to administer programs in partnership with state governments.
Isolated Scrum teams didn’t make much progress within a deeply ingrained waterfall culture and against long-range planning and budgeting.
Government, Healthcare
Amid the pressures of increasing citizen expectations, the CMS environment is complex and ever-changing as budgets and legislation fluctuate—making for a perfect setting to introduce Lean-Agile principles. A few isolated programs had begun using Scrum practices, but given the size and complexity of programs at CMS, Scrum did not lend itself well to longer-range planning and the identification and mitigation of dependencies among the Scrum teams. In addition, the organization still had cultural battles to overcome.
“We were still suffering from a ‘throw-everything-over-the-wall’ mentality,’” explained Brent Weaver, Director of Systems Implementation at CMS. “The few Agile teams were requiring more of programs and that created more frustration on both sides. There was no vision or framework where everyone saw how they fit together. As a result, what they delivered was late, with defects—and not what the market needed.”
In 2017, Weaver arrived with the charge of improving the Agile transformation for the Center of Clinical Standards and Quality (CCSQ) within CMS. In the search for a new approach, the Scaled Agile Framework® (SAFe®) resonated as the right option.
“SAFe brought a much-needed approach to scaling Agile and systems thinking that was critical to an organization of our size and complexity,” Weaver said.
In preparation to obtain buy-in and funding, Weaver built his knowledge of SAFe by taking some initial courses: Leading SAFe®, and later, Implementing SAFe®. Following the Leading SAFe® course, he made the case for the Framework for leadership and earned the full support of Steve Davidson and Mark Plaugher, Directors of the Information Systems Group within CCSQ. Additionally, Debra Santos, Director of Hospitals, ASC, and QIO Systems was also willing to support the SAFe adoption for one of her systems.
For help, Weaver tapped Scaled Agile Partner, Agile Six Applications, Inc. With Agile Six, CMS decided to implement SAFe first in a group brand-new to Lean-Agile concepts, rather than with those already using Scrum, for a chance to start from scratch. The first teams on SAFe would be those working on CMS’s Hospital Quality Reporting (HQR) system, which healthcare facilities use to report data to CMS.
With leadership backing, they secured the budget and marked the calendar for the first face-to-face Program Increment (PI) planning event—to take place just six weeks in the future.
To meet the timeframe, CMS decided to shortcut the recommendations from the SAFe Implementation Roadmap and skip SAFe training—a decision that created significant challenges and that, in hindsight, they wouldn’t recommend to other organizations. The fact that many team members were located outside the area, and many were contractors, played into that decision.
To help prepare for PI planning, HQR conducted a four-hour, half-day mock PI session with about 20 percent of team members to give them an idea of what to expect.
For the actual PI Planning event, CMS brought together more than 120 people, with approximately a quarter of them coming from out of town. The first day, unfortunately, proved to be chaotic and more challenging than expected for several reasons, according to Weaver and Ernie Ramirez, President of Agile Six Applications:
“It cannot be overstated how horrible day one of that PI went,” Ramirez said. “We didn’t lay out an implementation plan as well as we should have, and the development contractor didn’t have the resources or roles we thought they did.”
Day two, however, could not have played out more differently. “At the end of day one, rather than throw in the towel, we rolled up our sleeves, and resolved to do better in day 2. We came out of day two with a plan that the teams would ultimately deliver on over the next 12 weeks,” Ramirez said.
Ramirez points to a few reasons for the turnaround. After the first day, people returned knowing more of what to expect and came more prepared. Also, the two-day format created a sense of urgency to make progress. Additionally, Ramirez walked around troubleshooting any issues immediately as they arose.
“After the first day, everyone had an opportunity to ‘sleep on it,’” he said. “A lot of the frustration at the end of the first day kind of washed out and everyone came back with a renewed focus and commitment to get the plan done,” Ramirez said.
Team members and program managers alike left the event more hopeful than ever before, believing they could actually hit the plan’s targets. Most promising, Weaver and Ramirez noticed productive discussions happening throughout the room—often between people who had worked together for several years, but had never actually met one another in person.
“We witnessed a lot of team and cross-team bonding that just cannot be replicated over WebEx, Hangouts or Zoom,” Ramirez said. “There is something immeasurably valuable about being in the same room with someone, laughing, joking and yes, respectfully arguing. A lot of trust was earned and built on day two.”
“Quarter-million-dollar conversations were happening all over the place,” Weaver said. “That’s what it would have cost to fix problems down the road if those conversations had not happened.”
Following that first PI, CMS began adhering to the SAFe Implementation Roadmap. They delivered Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager training. Unlike the first PI, they identified Value Streams.
“For the second PI, we found a lot of value in identifying Value Streams and ARTs, which helped people understand where they fit in and how teams fit together,” Ramirez said.
Agile Six also delivered training to external contractors, including Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager. Several people at contractor organizations earned their SAFe® Program Consultant (SPC) certification and began training their own people—knowing that it is likely to give them one more strength to promote as they seek to win future contracts with CMS.
During RFPs, contract organizations routinely compete against each other. However, once on contract, they must work with team members from competing firms. As an unexpected benefit, SAFe helped unify CMS team members and contractors, as well as contractors from various companies. Face-to-face, they collaborate more effectively and come to personally know the people behind the roles, developing comfortable working relationships with each other.
“It’s fundamentally better for American taxpayers that teams work together and break those walls down,” Weaver said. “I’m really proud of contractors’ ability to collaborate, share information, and work as a single team. Doing so has helped us reduce trouble tickets, so we know we’re delivering higher-quality solutions.
Because of CMS’s heavy use of contractors, each ART is comprised of people from numerous organizations. That required transformation leaders to be sensitive to job functions and responsibilities across the different companies on a single ART to foster trust and teamwork instead of competition. Having a single backlog for an ART creates further harmony among diverse team members.
So far, CMS has trained more than 200 people, including 25 – 30 Certified SAFe® Program Consultants (SPCs). The agency has also since launched four more Agile Release Trains (ARTs).
With training and preparation, participants have been more engaged in PI Planning events after that first learning experience. Communication, says Weaver and Ramirez, has been critical to the acceptance of the new way of working. Especially in the early days, they had to communicate clearly and persistently to convince people to join in the effort and assuage fears about what this meant for their futures.
“We really had to do a lot of selling on SAFe to get people comfortable,” Weaver said. “People were genuinely apprehensive about changing the way they have worked for so long, but as they have seen results, they have embraced it.”
And over time, HQR has implemented other SAFe concepts such as Weighted Shortest Job First (WSJF). Well ahead of a PI, the primary stakeholder has time to weigh the value of work and prioritize—which takes some of the emotion out of the decision, Ramirez says.
They are also in the process of adjusting budgets to fit more with shorter-term planning. Instead of years in advance, they began thinking in terms of three-month increments, in which Ramirez called a halfway step between the traditional approach and the ‘wild west’ of Scrum.
After a bumpy beginning, CMS points to measurable progress:
While CMS can’t yet measure customer satisfaction gains directly, they know that fewer quality issues and more innovation contribute to that goal.
“SAFe provided a map that enabled us to shift to modernizing versus just maintaining the status quo,” Weaver said. “Beneficiaries will ultimately benefit from more user-friendly, human-centered design systems, which will allow us to reduce the burden on our providers.”
The group’s success has caught the attention of others, with trains now starting in other CMS groups. “Other programs within CMS have approached HQR asking us how to drive the same outcomes,” Santos said. “It’s a testament to how far we’ve come in the past year.”
Back to: All Case Studies
Suggested Case Study:
NHS Blood and Transplant
“For Deutsche Bahn Digital Sales, SAFe is the framework for the strategic digitalization program … With it, we are delivering faster and more effectively on our objectives, which drives our ability to compete in the digital age.”
—Matthias Opitz, Senior Program Manager, DB Vertrieb, Deutsche Bahn
After privatizing the company, Deutsche Bahn faced new market forces, along with increasing competition from new transportation players.
Transportation
In recent years, Deutsche Bahn (DB)—one of Europe’s largest railway operators—has faced unprecedented change. In 1994, the two railways of East and West Germany merged after the country’s reunification. While the company was adjusting to the Lean-agile transition, it was also contending with rising costs and greater competition than ever before from other railway operators, long-distance bus services and new, fast-acting players providing ride services and car-sharing.
Within this challenging environment, in 2014 DB embarked on a digital transformation to modernize the way their business units operate, from cargo transport to passenger ticket sales. It was up to each business unit to decide on a path forward to meet those goals.
Initially, the business units implemented Lean-Agile practices at the team level, on a small scope. Yet as they began trying to deliver on objectives, they fell short of targets—especially on larger solutions. The company struggled with lengthy decision cycles; fragmented responsibility; constant design, coordination and estimation; changing requirements; and many, many dependencies.
“In nearly every business unit, the transformation projects struggled to deliver large solutions,” said Matthias Opitz, Senior Program Manager, DB Vertrieb. “We were going around in circles analyzing, and the processes were so complex that the organization was not able to deliver simple minimum viable products.”
It was clear the effort would require a considerable overhaul of its long-established ways of working.
The company looked for a Lean-Agile methodology capable of handling its complex environment on a larger scale and found it in the Scaled Agile Framework® (SAFe®).
Within each segment of the company, at least one business unit rolled SAFe out as part of the digital transformation initiative:
“For Deutsche Bahn Digital Sales, SAFe is the framework for the strategic digitalization program,” Opitz said. “It brought a continuous delivery process that keeps us on track toward our objectives.”
DB Vertrieb started its Lean-Agile transformation in 2015, when the business unit established an effort named ‘KAI‘ (an acronym for the German words meaning customer centricity, agility, and innovation), which stressed five attributes:
To ease the transition, the company engaged Scaled Agile Partner KEGON as its primary provider for training and coaching. With KEGON, the DB companies began comprehensive training to prepare everyone who would be joining an Agile Release Train (ART), a team of teams in the Framework.
Lean-Agile leaders at DB Cargo and DB Vertrieb took the Leading SAFe® course, with others taking role-based training such as SAFe® Scrum Master, SAFe® for Teams, and SAFe® Product Owner/Product Manager. At least nine change agents at DB business units also earned SAFe® Program Consultant (SPC) certification in order to teach their colleagues. DB saw training as essential for helping people through the inevitable challenges that would come up, including resistance.
“Training was very important for giving us confidence and answers to questions that came up,” Opitz said. “Because we trained all participants, training also helped open discussions and convince skeptical people that this was the right way to go.”
DB Cargo was the first division within the company to kick off the first ART with a Program Increment (PI) planning event. Managers of the other business units attended only to observe.
In that meeting, they accomplished several of their top objectives:
SAFe practices such as the Program Board gave participants clear insight, for the first time, into the company’s numerous dependencies. With that visual aid, they realized that changes to peripheral systems would affect the critical path of the initiative, allowing teams to coordinate appropriately.
As the PI got underway, leaders and team members alike hit challenges with breaking old habits. The governance and budgeting structures remained in a waterfall construct early on, but began to move toward Lean budgeting as DB Vertrieb kicked off PIs in 2017.
To bridge this gap, Opitz stresses that the business units had to ensure that SAFe and the new approach extended to the broader organization, beyond IT. Therefore, DB Vertrieb decided to establish a ‘Target Operating Model’ (TOM) for the business unit and to perform the transformation activities in a dedicated ART. Shared services departments such as HR, controlling, communication, training
and support, and marketing were brought into the fold.
Any doubt or resistance soon faded away as teams delivered perfectly on target for their first PI. “At first, everyone looked at the committed backlog and said, ‘It’s too much,’” Opitz said. “But by the end of this first PI, we had delivered almost everything, which was a surprise to everyone.”
With SAFe, DB Vertrieb finally implemented a process by which to plan requirements, prioritize, and synchronize the various programs, and to break down the requirements and epics into features and stories. Additionally, automated epic and feature reporting brought critical transparency regarding implementation status.
“Just a year ago, it was a big challenge to do specifications,” Opitz said. “Now we have a process that makes it happen.”
A number of steps and factors contributed to DB Vertrieb’s SAFe transformation. For one, DB leveraged Agile metrics to manage Portfolios and ARTs, and to help secure funding for them. In turn, management supported the effort by funding standing teams. They also invested in co-located and synchronous PI planning events for all ARTs in 2019.
The company performed a Value Stream analysis, which resulted in four Value Streams covering vertical products and horizontal services.
Toward continuous improvement of testing, teams performed system tests and implemented integrated development test servers.
Starting at the Portfolio level, they switched from a traditional requirements specification process to Agile requirements engineering.
DB Vertrieb found that self-organized teams were empowered to make decisions. In one case, a team detected an incorrect architectural decision when communicating with a stakeholder.
Back to: All Case Studies
Suggested Case Study: TomTom
“Continuous delivery improved quality, increased productivity, and improved the employee experience.”
—Ashish Pandey, Technical Lead, CSIT Team
Cisco wanted to shift away from waterfall, and replace periodic major releases with continuous delivery of new features.
Information Technology, Telecommunications
Cisco achieved significant improvements by using SAFe on two major projects:
Cisco IT constantly looks for new ways to go faster and simplify. As part of its digital IT strategy, the Cisco Cloud and Software IT (CSIT) organization wanted to adopt more Agile development as a way to replace periodic major releases with continuous delivery of new features.
“Our goals are to speed up releases, increase productivity, and improve quality,” says Ashish Pandey, technical lead for the CSIT team.
Although a few small teams had adopted Agile techniques, waterfall was still the norm for teams that were large, distributed, or working on complex projects.
To solve these challenges, CSIT moved to the Scaled Agile Framework® (SAFe®) and immediately began applying scaled Agile practices on two major initiatives: their Subscription Billing Platform, and the Webex app for Samsung tablets..
For its Subscription Billing Platform (SBP)—which supports various subscription services—the company originally formed different teams for design, build, test and deploy. In waterfall fashion, each team began work once the previous team had completed their part.
Cisco delivered the new release of SBP on time and with all planned capabilities. When the company compared this release to those using waterfall, it found a 16 percent drop in the defect rejected ratio (DRR). Plus, critical and major defects decreased by 40 percent.
Continuous delivery also increased defect removal efficiency (DRE) by 14 percent due to greater collaboration among international teams, and by helping members identify opportunities for improvement during daily meetings.
The CSIT team attributes those quality improvements to several factors:
Additionally, the new way of working improved employee satisfaction by eliminating the need for after-hours work and reducing meetings and calls. Employees also saw how they fit into the bigger picture.
In early 2014, the application for WebEx Meetings came pre-installed on Android tablets. Leading up to the release, developers had to work quickly to meet the release date, despite frequently changing requirements.
The team followed an Agile Scrum framework with three sprints for geographic rollout, the first two consisting of three weeks and the last of five weeks.
During planning, Cisco IT and others gathered requirements, and evaluated the readiness of environments, partners, and engineering and marketing teams.
Developers employed extreme programming, including test-driven development, where they first write an automated test case for a new function. Then they produced the minimal amount of code needed to pass the test and then refined code to make it simpler and easier to maintain.
On the WebEx app, Cisco reduced quality assurance defects by 25 percent. Plus, with developers checking code in several times a day, the business group reviewed new features sooner in the cycle than before. And each sprint ran more efficiently than the last.
Ultimately, Samsung sold more than 35 million tablets with the new app, creating wide exposure for the brand.
Back to: All Case Studies
Suggested Case Study: Royal Philips
“SAFe brings so much more engagement, which has really been key for all parties. I wouldn’t want to do it any other way.”
—Rajbir Bal, Program Manager, Access Control
JCI’s access control division needed to improve coordination among firmware and software teams across three locations with the goals of improving time-to-market, quality, and engagement.
Information Technology
SAFe®
Johnson Controls Inc. (JCI), a global diversified technology leader, serves customers in more than 150 countries and reports $30 billion in annual revenue. The company’s access control division develops systems to help buildings achieve maximum security while increasing efficiency and lowering costs.
Developing access control systems demands that firmware and software teams work together to deliver on a coordinated schedule. At JCI, those teams are spread across Southern California, Milwaukee, and India.
In 2014, the division began an effort targeted at improving time-to-market and the predictability of releases. They also sought to identify quality issues sooner, increase transparency, and raise team engagement.
“We were having very little success at agility planning, predicting releases and committing to and delivering on the timeline,” explained David Richter, Director of Engineering, Access Control. “We wanted to increase our flexibility and ability to react to change, and to react to our customer’s needs in a positive and respectful manner.”
But Richter and other change agents knew they would have to contend with several roadblocks along the path to SAFe transformation:
JCI identified the Scaled Agile Framework® (SAFe®) as the most promising route for instilling lasting Lean-Agile practices.
“SAFe brought all the practices for us to start and then learn and adapt as we go,” said Rajbir Bal, Program Manager, Access Control. “It also forced us to have tough discussions early and throughout development—versus down the road when we got close to release.”
To gain leadership backing, the Director of Engineering gave decision-makers clear reasons for deploying SAFe and the expected outcomes. Concurrently, Scaled Agile Gold Partner Icon Agility Services trained leaders in Leading SAFe® so they would fully understand the Framework. This worked well as change agents succeeded in securing executive backing.
They followed with Leading SAFe® for directors, product managers, and resource managers, bringing together 15 individuals from California, Milwaukee, and India. Next, they defined the structure of the various teams that would begin the first Agile Release Train (ART), and put all team members through SAFe® for Teams training.
Two individuals, including Bal, earned certification as SAFe® Program Consultants (SPCs) in order to serve as change agents and coaches. Following certification, they became authorized to deliver SAFe® Scrum Master, SAFe for Teams, and SAFe® for Product Owner/Product Manager training.
In addition to Bal, other coaches included engineering managers and the director of engineering, while Scrum Masters became coaches at the team level. When it was apparent that Scrum Masters and Product Owners had an overlap of responsibility, or at least their understanding of it, Bal brought them together in one location for a custom Product Owner/Scrum Master workshop to clarify roles and responsibilities.
In 2015, JCI launched its first ART at a Program Increment (PI) Planning meeting with about 100 people and followed Essential SAFe. Bal and others knew they were taking the first steps toward progress, however, early planning events felt chaotic.
“The first two PIs were not fun and we did not come out with committed plans,” Bal said. “Some features were not well defined, people were not clear on the process, and we needed more time to break down user stories.”
Bal attributes the discord to a couple of factors. The company included some user interface teams in that first ART, but not others, which caused misalignment. Geographic distribution also created challenges.
For more cohesive teams, they tried several approaches. First, they brought representatives from India to present on behalf of their teams. However, in doing so, they lacked the voices of those not in attendance.
Instead, they decided to start concurrent planning in the U.S. and India, with India beginning 12 hours ahead due to the time zone differences. As teams in India complete their planning days, those in the U.S. come in early to overlap with them. The Indian teams present their planning via videoconference. The same goes for day two of planning. American teams presented in what was the evening for their Indian counterparts.
Richter notes that, in those early months, JCI attempted to modify the Framework. Only some teams attended training and the company followed three-week sprints. “We tried to make changes to SAFe, but that was a disaster,” he said. “After that experience, we then started following SAFe exactly.”
Many people also insisted on continuing lengthy documentation of functional and design specs, after 50 years of following this practice. But that changed over several PIs. “We realized that documentation is not adding value,” Bal said. “Instead, we switched more to flow diagrams and writing code versus paragraph after paragraph of specs.”
With these tweaks, subsequent PIs progressed more smoothly as everyone became accustomed to the ceremonies and practices of SAFe. They made better use of their time at PI planning events. By the third PI, all teams also joined the train.
Over time, JCI found it more feasible to modify the framework to its own processes. In the access control division, developers must follow a specific process. They found that SAFe allowed them to implement Lean-Agile methods that worked in conjunction with these required processes. Other modifications included concurrent planning for India and the U.S., and face-to-face meetings between Product Owners and Scrum Masters to walk through the features radiator.
Richter and Bal saw a number of positive outcomes emerge during the transformation:
“We started acting like one big team, instead of a bunch of teams of teams,” Bal said. “We saw more engagement at all levels.”
After early growing pains, JCI began seeing the results of its efforts:
“This wasn’t an easy process for us,” Bal said. “It takes time getting everyone jelling PI over PI. But SAFe brings so much more engagement, which has really been key for all parties. I wouldn’t want to do it any other way.”
Back to: All Case Studies
Suggested Case Study:
Deutsche Bhan