Are lengthy, outdated flightdeck briefings really contributing to aviation safety? Captain RICH LOUDON*, Alaska Airlines and Captain DAVID MORIARTY, RAeS HF Group (Flight Operations and Training) take a look at current briefing procedure and suggest a new way forward.
On 14 August, 2013, an Airbus A300, experienced a controlled flight into terrain fatal accident during a localiser, non-precision approach to runway 18 at Birmingham Shuttlesworth International Airport, Birmingham, Alabama. The National Transportation Safety Board (NTSB) ultimately concluded that pilot error was the primary cause of the crash. The cockpit voice recorder revealed a haunting revelation about the content of the crew’s arrival briefing… it was perfect. Or was it? There was certainly a lot of talking by the Pilot Flying (PF) as he dutifully ‘ticked all the required boxes’ but no discussion regarding the relevant threats or countermeasures that could have averted disaster. The fatigued crew chose to fly a seldom performed, non-precision approach at night to a short runway with limited lighting with a weather forecast that suggested an unpredictable cloud ceiling. This is one more example of an all too common thread in recent industry accidents: the loss of flight path and situational awareness due to onset of high crew workload as a result of rapidly changing conditions.
briefings have become one-size-fits-all solutions serving as repositories for redundant verbal crew crosschecks of highly automated, highly reliable systems."
I have spoken to numerous US and international air carriers about the content of their own departure and arrival briefings and have found most to be strikingly similar. The commonality is a decades-old briefing method that has neither adapted to next generation flight decks nor incorporated breakthroughs in our understanding of human cognition. Today’s typical Standard Operating Procedure (SOP) briefing is simply too long (due to years of adding more and more items determined to be ‘too important not to discuss’). Additionally, briefings have become one-size-fits-all solutions serving as repositories for redundant verbal crew crosschecks of highly automated, highly reliable systems. Finally, they are all too often one-sided conversations that lack involvement from the very crewmember that recent industry accident trends indicate will play a primary role in maintaining safety margins: the Pilot Monitor (PM).
After the Birmingham accident, Alaskan Airlines reviewed our departure and arrival briefings and found they were equally inadequate. As a result, we decided to conduct a comprehensive study of our crew briefings that started with a review of our voluntary safety data (AQP, ASAP, FOQA, LOSA). We wanted to see if we could find a link between the content of our own lengthy, one-sided, ‘box ticking’ type briefing and the safety deficiencies noted in the data. What we found was astonishing. There was not only a clear connection between crew errors and undesired aircraft states with the quality and content of the briefings that preceded them but there was also a disconnect between our SOP briefing requirements and line pilot adherence to those requirements. Our analysts advised us that we either had bad pilots or bad policy. We believed it was the latter. Our briefings, like so many in the aviation industry (as shown in the LOSA archive), had become so over-loaded and rote that many of our crews were either choosing not to adhere to the seemingly irrelevant policy or they dutifully followed it only to find out later through debriefing, that what they spent so much time briefing wasn’t focused and directed on what they should have been briefing.
Time to brief better? (David Moriarty)
It is time to rethink the way we brief to not only address these issues but also create a methodology that incorporates recent breakthroughs in cognitive theory regarding decision-making in the very environments that are proving to be so challenging for pilots. After a year of research and development, we came up with four goals for our briefings:
1. Threat Forward. Following the law of primacy (that information presented first is better retained), crew departure and arrival briefings should first address the relevant threats to the flight and go on to discuss specific countermeasures that could be employed should any of those threats degrade safety margins. An additional benefit of a threat-forward briefing is that, in identifying relevant threats early in the briefing, those threats tend to positively inform the subsequent departure or arrival plan.
2. Interactive. The briefing design should encourage interaction between the PF and PM. It is time to put away the age-old notion of ‘my leg, your leg’. The desired goal should be an ‘our leg’ mindset where the PM plays a leadership role in developing critical content of the briefing. After all, industry accident data continues to reveal that it is the PM that will play a significant role in noticing and re-establishing safety margins should they deteriorate.
3. Scalable. Just as no two departures or arrivals are the same, neither should be the briefings that precede them. Yet, on today’s modern flight decks, crews are required to go through the same litany of items for each and every flight leg. Crew briefings need to be scalable. Professional aviators know how to discern what is important based on proficiency, familiarity, flight complexity and a host of other factors that may or may not be relevant at the time.
4. Cognitive. Finally, following the principle of recency (that information presented last is also well retained), crew departure and arrival briefings should conclude with a recap of the critical threats and associated countermeasures, as well as specific PM duties for each particular departure or arrival. Why is this so important? Dr Gary Klein, a leading researcher in recognition-primed decision-making theory, has determined that professions requiring rapid decision-making in high workload environments subject to rapidly changing conditions (ie fire-fighting, law enforcement, military and aviation), will involve decisions based on recognition-primed pattern-matching. A pattern match, according to Klein, is an action that is derived from relevant cues, expectancies, and goals. These cues, expectations and goals will normally be a result of insights and expertise gained through specific training or routines, professional study, deliberate practice, or overall experience. In very rare cases, such as Sully’s ‘miracle on the Hudson,’ experts will seek a pattern-match that is ‘close enough’ because the situation is unfamiliar to them, requiring some level of improvisation. In any case, a successful outcome will require an appropriate pattern match. For this reason, flight crews should brief in a manner that will serve to prime them with potential pattern-matches. Once these pattern-matches and the cues that should elicit them have been mentally primed, it is a lot more likely that when an abnormal situation arises, the crew will be able to trigger these pattern-match based responses quickly and accurately.
Set-up and brief (T-P-C)
An example of the new 'Threat Forward' briefing.
To incorporate these four goals, we came up with a better way for crews to prepare for departures and arrivals. First, they perform a set-up. The set-up is a very specific, deliberate process in which both the PF and PM take time, normally without discussion, to ensure all required and applicable items are ready to go. These include a review of the weather, applicable NOTAMs, a set-up of their electronic flight bags, instrument panels, navigational guidance and appropriate crosschecks [eg, automatically uploaded departure or arrival waypoints in the flight management computer). The reason for a ‘silent’ set-up is that we only want crews actually discussing relevant items that may affect safety. We found no data to support the fact that a verbal, crew crosscheck of automatically loaded systems, is necessary. Though that might have been important when a system was first introduced, after many years of improvement and proven reliability, a verbal review is simply no longer needed. Knowing what we now know about the importance of priming and pattern-matching, we are convinced that every word crews speak during their briefing is critical and potentially life-saving.
The PM starts the briefing
New flightdeck briefings should be more interactive. (United Airlines)
Once both crew are set-up, the newly devised ‘T-P-C’ (Threats-Plan-Considerations) briefing begins with the PF asking the PM to review any relevant THREATS that might be anticipated. By requiring the PM to begin the discussion in this manner, a level of ownership and interactive engagement is fostered. The PM must take time to prepare an answer to the inevitable question that will start the briefing: ‘What are our threats?’ Together, the crew will then discuss and decide on countermeasures for each relevant threat identified. We provide our crews with a quick reference card that includes a summary of the briefing format, a tool for conducting debriefs and a list of common threats as a memory jogger. On complex, high-risk departures and arrivals, the threat portion of the briefing can be the most significant and lengthy component of the overall discussion.
Next comes the PF’s PLAN. There was considerable debate over what should be included in the plan, as we did not want to revert back to the long, drawn out ‘list’ of required items we were trying to revise (this is an exercise each respective airline will have to perform as they decide for themselves what guidance they want to include). Just like briefing threats, however, the plan portion should also be relevance-based and scaled up or down appropriately. If a crew is about to perform their 10th arrival and visual approach in the same sunny conditions to an airport they have been flying to all month long, then the discussion will normally be appropriately scaled down due to high proficiency, familiarity, and low risk. If, on the other hand, there exists low familiarity and high risk then much more detail is required.
Finally, the CONSIDERATIONS portion of the briefing is intended to be a recap or summary of the discussion. It is particularly important if the briefing has been scaled up due to a combination of high risk and complexity. A review of specific PM duties will serve to ‘prime the PF and PM for action’ should any relevant threats require the agreed upon countermeasure(s).
How easy is it to change SOPs at your airline?
The most frequent questions I get asked are; ‘How did you get your Flight Operations leadership to buy off on such a big change to your SOP?’ and ‘How did you go about communicating the change to your pilots?’ The answer to the first question is easy… we just showed them the voluntary safety data and proposed a solution that was more in-line with what crews were actually doing and one that incorporated human factors science. Regarding the second question, we spent considerable effort communicating the need for a change several months in advance. We then developed a robust training module including video examples and, more importantly, emphasising the ‘why’ behind the change. On the day of the rollout, numerous Flight Operations leaders were available at each domicile to ensure a smooth transition and answer any lingering questions. Several months following the rollout, we conducted a fleet-wide survey to obtain feedback on how well the change was being incorporated and to learn how it could have been trained and implemented better. The overall satisfaction of the entire process received an 84% approval rating.
Autonomy, mastery and purpose
Briefing better would unshackle crews from 'box-ticking, unthinking' briefs. (David Moriarty)
It is time to unshackle our line crews from the decades old required list of briefing items. As Dan Pink has said in his New York Times bestseller, Drive – The Surprising Truth About What Motivates Us: “Carrots and sticks are so last century. For 21st Century work we need to upgrade to autonomy, mastery and purpose.” The ‘brief-this-or-else’ stick places the motivation in the wrong place. We need to allow crews the autonomy to scale and tailor their briefings according to the specific situation at hand, not require a one-size-fits-all solution. We must further encourage crews through revised SOPs to exercise their professional mastery in analysing risk and crafting management strategies to mitigate relevant threats to the safety of flight and to develop appropriate plans of action based on conditions. The purpose of briefing is also the purpose of a professional pilot: to maximise safety. The Birmingham crew thought they were briefing in the safest possible manner but, despite their compliance with all the rules, it just wasn’t enough. We can and we must do better.
*Check Airman and lead Alaska Airline Human Factors Working Group