Eight to Late

Sensemaking and Analytics for Organizations

Archive for the ‘Management’ Category

The DRS controversy and the undue influence of technology on decision-making

with 7 comments

The Decision Review System (DRS) is a technology that is used to reduce umpire errors  in cricket.  It consists of the following components:

  1. High-speed visualisation to  track the trajectory of a ball as it goes past or is hit by a batsman
  2. Infra-red and sound-based devices to detect whether or not the bat has actually made contact with the ball.

There were some misgivings about the technology when it was first  introduced a few years ago, but the general feeling was that it would be beneficial (see this article by Rob Steen, for example).  However, because of concerns raised about the reliability of the technology, the International Cricket Council did not make the use of DRS mandatory.

In the recent Ashes series between England and Australia, there have been some questionable decisions that involved DRS. In one case, a  human umpire’s decision was upheld even though DRS evidence did not support it and in another an umpire’s decision was upheld when DRS evidence only partially supported it, See the sidebar in this news item for a summary of these decisions.

Now, as Dan Hodges, points out in an astute post,  DRS does not make decisions – it only presents a human decision-maker (the third umpire) with more, and allegedly better, data than is available to another human decision-maker (the on-field umpire). This is a point that is often ignored when decision support systems are used in any kind of decision-making, not just in sports: data does not make decisions, people do. Moreover, they often reach these decisions based on factors that cannot be represented as data.

This is as  it should be: technology can at best provide us with more and/or better data but, in situations that really matter, we would not want it making decisions on our behalf. Would we  be comfortable with machine diagnoses of our X rays or CT scans?

Taking a broader view, it is undeniable that technology has influenced the decisions we make: from the GPS that directs us when we drive, to Facebook, Linkedin and other social media platforms that  make suggestions regarding  who we might want to “friend” or who “connect with.” In his book, To Save Everything, Click Here,  Evgeny Morozov argues that this is not a positive development. He takes aim at what he calls technological solutionism, the tendency to view all problems as being amenable to technology-based solutions,  ignoring other aspects such as social, human and ethical concerns.

Morozov’s interest is largely in the social and political sphere so many of his examples are drawn from social networking and search engine technologies. His concerns relate to the unintended consequences of  these pervasive technologies- for example, the loss of privacy that is the consequence of using social media or the subtle distortion of human behaviour through the use of techniques like gamification.

The point I’m  making  is rather more modest:  it is that technology-based decision-making tools can present us with more/better/refined data, but they cannot not absolve us of our responsibility for making decisions.  This is particularly evident in the case of ambiguous issues. Indeed, this is why decision-making on such matters  has ethical, even metaphysical implications.

And so it is that sports needs human umpires, just as organisations need managers who can make decisions that they are willing to stand by, especially when  situations are ambiguous and data is open to interpretation.

Written by K

August 14, 2013 at 7:46 pm

On the contradictions of consulting (and management) rhetoric

with 6 comments

Introduction

Successful management consultants are often seen as experts and trendsetters in the business world. The best among them are able to  construct convincing narratives about their expertise and experience, thereby gaining the  trust of senior managers in large organisations.

Have you ever wondered how they manage to pull this off?

In a paper entitled, The Invincible Character of Management Consulting Rhetoric: How One Blends Incommensurates While Keeping Them Apart, Jonas Berglund and Andreas Werr discuss how consultants, unbeknownst to their clients, often draw from two mutually contradictory forms of rhetoric to construct their arguments: rational (scientific or fact-based) and practical (action-based). This renders them immune to potential challenges from skeptics.  This post, which is based on the work of Berglund and Werr, is an elaboration of this claim.

Background and case study

Typically management consultants are hired to help organisations formulate and implement strategic initiatives aimed at improving organisational performance.  On the ground, such initiatives usually result in large-scale change initiatives such as organisation-wide restructuring or the implementation of enterprise systems.  Whatever the specific situation, however, consultants are generally brought in because clients perceive them as being experts who have the necessary knowledge and practical experience to plan and execute such transformations.

A typical consulting engagement consists of many interactions between consultants and diverse client-side stakeholders.  Berglund and Werr begin their paper with a description of an example of such an interaction drawn from their fieldwork in a large organisation. In brief: the  example describes a workshop that was aimed at redesigning business processes in an organisation. The two-day event was facilitated by the consultants and involved many stakeholders from the business.  I reproduce their description of the event below so that you can read it in its original form:

The event begins with a plenary session. The 25 participants—a selection of key persons on different levels in the organization—sit around a u-shaped table in a large room. Three consultants sit at one end of the table. One (a bit older than the others) is Ben, the project manager.

At 9 am sharp he rises and enters the stage. A nervousness is reflected in his somewhat impatient movements and way of talking. This is an important presentation. It is the first time since the ‘kick off’ of the project, that it is being delivered to a larger audience. Ben welcomes the participants and briefly introduces himself: ‘I am a consultant at Consulting Ltd. My specialty is BPR [Business Process Reengineering]. I have worked extensively with this method in the telecom industry.’ He also briefly introduces the two colleagues sitting at the end of the table. But the consulting team is not complete: ‘We are waiting for Alan, a portal figure and innovator concerning BPR.’

Ben suggests beginning the seminar with a brief introduction of the participants. After this has been completed, he remarks: ‘we clearly have a massive competence here today’. Thereafter, he leaves the floor to Ken, the CEO of the company, who says the following:

‘There are many reasons why we are sitting here today. The triggering factor has been the rapid growth rate of the market. But why should we start working with BPR? I have worked a lot with process improvement, and I have failed many times, but then I heard a presentation by Alan and everything fell in place. I saw the mistakes we had made—we focused on the current situation instead of being creative.’ Following this introduction, the importance of the project is further stressed. ‘The high growth rate of the market demands a new way of working . . . The competitive situation for the company is getting harder; the years when the customers just came to us are over. Now we have to start working for our money . . . The reason for this project is that we want to become the best from our owners’, customers’ and employees’ perspective.’

After this presentation, Ben takes over the floor again: ‘I have something to tell you. I want to report what we have done in the project so far . . . We have worked in four steps, which is a quite typical approach in reengineering’, he says, showing a slide headed ‘Method for Implementation’, which depicts four project phases arranged in the form of steps from the lower left to the upper right. The more detailed exploration of these phases, and the related activities occupy the group for some minutes.

Thereafter, a sequence of transparencies is shown. They describe the overall situation of the company using well-known business concepts. The titles of the slides read ‘Strategic Positioning’ (the model presented under this title has strong similarities with the BCG [Boston Consulting Group] matrix), ‘SWOT Analysis’, ‘Core Competencies’, and ‘Critical Success Factors’.

I expect many readers who work in organisational settings will be able to relate elements from the above extract to their own experiences with management consultants.

Although the case-study is dated,  the rhetoric used by the consultant is timeless. Indeed, in such plenary sessions, the main aim of  consultants (and client-side senior management) is to justify the proposed changes and convince client-side staff to get involved in implementing them.  This is as true now as it was a decade ago, the rhetoric used has hardly changed at all. What’s more interesting, though, is that their arguments taken as a whole are often inconsistent. To see why, let’s take a closer look at two kinds of rhetoric employed by consultants.

The rhetoric of reason

Consultants often legitimize their proposed actions by claiming to use “established” or “proven” methods. At the time of the case study (remember this was in the 90s), BPR was all the rage and, as a consequence, there were a number of contemporary books and articles (both in research and trade journals) that consultants could draw upon to legitimize their claims.  Indeed, many of the articles about BPR from that era delved into things such as critical success factors and core competencies – the very terms used by Ben, the consultant in the case study.  By doing so, Ben emphasised that BPR was a logically justifiable undertaking for the client  organisation.

However, that’s not all:  by referring to a stepwise “method for implementation,” Ben makes the process seem like a rational one with an “if we do X then Y will follow” logic. Of course, real life is never that simple, as evidenced by the statistics on failed BPR projects. Consultants often confuse their clients by presenting the map which is the idealised process as being equivalent to the territory that is organisational reality.

The rhetoric of action

To be sure, those who run organisations care more about results than models or methodologies. As a result,  consultants have to portray  themselves as being practical rather than theoretical. This is where the rhetoric of action comes in.

Ben’s reference to his “extensive experience in the telecom industry” and his invocation of   “Alan, the portal figure and innovator” are clearly intended to emphasise the consulting organisation’s experience and “innovative approaches” to  implementing BPR initiatives. Notice there are no references to reason here; there is only the implicit, “trust me, I’ve done this before”, and (if not that, then), “trust Alan, the portal figure and innovator.”

Ben’s spiel is backed up by the CEO;  consider the CEO’s line, ” …I have worked a lot with process improvement, and I have failed many times, but then I heard a presentation by Alan and everything fell in place. I saw the mistakes we had made…

The boss heard the BPR Gospel According To Alan and had an epiphany; everything just “fell in place.”

Discussion

The short case study illustrates how consultants shift back and forth between two essentially incompatible modes of rhetoric when speaking to clients: a rational one which assumes the existence of objective management models and a normative one which appeals to human behaviours and emotions. This enables them to construct narratives that, on the surface, seem plausible and convincing, and more important, are hard to refute.

Although the rhetoric of reason refers to an idealised world of management models, its power and appeal  cannot be overstated. As the authors state:

The belief in experts and their techniques is firmly anchored in the modern belief in rationality. In our culture ‘the notions of ‘‘science’’, ‘‘rationality’’, ‘‘objectivity’’, and ‘‘truth’’ are bound up with one another’. Knowledge is power, and formalized knowledge is praised as the only legitimate form of knowledge, offering hard and objective truth in correspondence to reality.

Indeed, consultants play a huge role in the diffusion of new knowledge and models in the wider business world, thus perpetuating the myth that management models work.

On the other hand, consultants must show results. They have to portray themselves action-oriented and hence Ben’s attempt to establish his (and his organisation’s) credibility via credentials. This mode of rhetoric downplays scientific-rational thinking and highlights  wisdom gained by experience instead. As the authors state:

The chain of argument usually goes like this: merit always prevails over privilege; management knowledge is often contrasted with scientific, theoretically informed knowledge, which is regarded with suspicion by managers; and a persons’ track record and ‘hands-on’ experience is regarded as more important than expertise in general management skills acquired through extensive education.

Another facet of the rhetoric of action is that it emphasises the uniqueness of each situation. This is based on the idea that things in organisations are subject to continual change and that the lack of a stable configuration and environment makes it impossible to employ management models. The implication being that the only way to deal with the mess is to create a sense of collectivism – a “we’re in this together” attitude. The  concept of  organisational culture plays on this by portraying an organisation as this unique, wonderful place in which everyone shares the same values and deep sense of meaning. As the authors state:

The management literature discussing corporate culture is filled with religious and magical metaphors of the leader stressing the less rational sides of the organization, emphasizing the role of ceremonies, rituals, sagas, and legends (to mention only a few), in creating a system of shared values in the organization.

Seen in this light, the CEO’s references to Alan’s epiphany-inducing presentation, the “competitive situation,” and the need to “start working for our money” are attempts to generate this sense of collectivism.

The foregoing discussion highlights how consultants and their allies draw upon incompatible modes of rhetoric to justify their plans and actions. This essentially makes it difficult to refute their claims: if one tries to pin them down on logical grounds, they can argue based on their track record and deep experience; if one questions their experience, they can point to the logic of their models and processes.

…but we are all guilty

Finally, I should emphasise that management consultants are not the only ones guilty of using both forms of rhetoric,  we all are: the business cases we write, the presentations we deliver, the justifications we give our bosses and staff are all rife with examples of this. Out of curiosity, I re-read a business case I wrote recently and was amused to find a couple of contradictions of the kind discussed in this post.

Conclusion

In this post I have discussed how consulting rhetoric frequently draws upon two incompatible kinds of arguments –rational/fact-based and practical/action-based. This enables consultants to present arguments that are hard to refute on logical grounds.  However, it isn’t fair to single out consultants: most people who work in organisation-land are just as guilty of mixing incompatible rhetorics when attempting to convince others of the rightness of their views.

Written by K

August 1, 2013 at 10:55 pm

Wickedness, undecidability and the metaphysics of decision-making in organisations

with 3 comments

Wickedness

A central myth about decision making in organisations is that it is (or ought to be) a rational and objective process. Although this  myth persists,  there is a growing realisation  that many organisational issues are wicked – i.e. they are hard to define, let alone solve.  The difficulty in defining such problems  arises from the fact that they are multifaceted, which in turn  gives rise to a diversity of viewpoints about them.  So it is that people involved in a wicked decision problem will have different opinions on what the problem is and how it should be tackled.  This makes it impossible to decide on wicked issues on logical grounds alone , and hence the ineffectiveness of rational decision making processes for such problems.

Often times the wickedness of a problem is a consequence of the way in which it is framed.  I’ll have more to say about frames later in this post, for now I’ll just note that the term frame refers to the perceived assumptions and context regarding a  problem, and I say perceived because these are often matters of  opinion and belief .  For example, depending on ones background and beliefs,   the issue of crime may be seen as a law and order problem (lack of policing) or an economic one (poverty or lack of opportunity).

Although organisational issues are not as complex and multifaceted as social ones such as crime,  most managers would have experienced situations in which they simply did not know what to do because the problem was not decidable based on their preconceptions regarding  the facts   and assumptions surrounding the problem, and the organisational situation in which it lives (the context).

Undecidability

My use of the word decidable in the previous sentence may raise some eyebrows because the term has a very precise meaning in mathematics. The notion of undecidability (or decidability) comes from the work of Kurt Goedel who proved that any system based on a set of axioms (premises) will necessarily contain statements that can neither be proven nor disproven within that system.

Now an axiomatic system  is nothing  but a framework consisting of a  set of premises plus some logical rules using which one can derive statements that are true within the system (these true statements are theorems).  One can thus make an analogy between axiomatic systems in mathematics and (for the want of a better term) decision systems in organisations: decisions in organisations are outcomes of  a set of premises plus some rules (not necessarily logical ones!) using which one can make arguments supporting one or the other viewpoint. In terms of the analogy, it is clear that wicked problems in organisations are akin to undecidable problems in mathematics in that they are not solvable within the frame in which they are posed.

The interesting thing about undecidable problems in mathematics is that although statements may be undecidable within a particular system of axioms, they can sometimes be  rendered be decidable within another, broader system. Put simply, a proposition that is undecidable may be rendered decidable by modifying or expanding the underlying premises or assumptions. In even simpler terms, the decidability of a statement depends on one’s  frame or viewpoint.  In terms of the analogy this amounts to saying that wickedness (or the lack of it) depends on how the problem is framed.

Wicked (or undecidable) decision problems can sometimes be managed (or rendered decidable) by an appropriate choice of frame.

The metaphysics of organisational decision-making

I should hasten to add that the foregoing cannot be used as a justification for making a decision based on a  convenient frame that is aligned  to one’s own interests and opinions.  Indeed, an appropriate choice of frame is one that takes into account the entire spectrum of interests and opinions relating to the decision problem. So much so that the choice of a correct frame is a metaphysical issue because it forces the decision-maker(s)  to choose how they view themselves in  social and  ethical terms – in short, as socially responsible human beings!

I realise this statement may sound over the top to many readers so I’ll try to argue for its plausibility,  if not its truth, by drawing on a brilliant paper entitled, Ethics and Second-Order Cybernetics,  by the eloquent cybernetician and polymath, Heinz von Foerster.

Noting that just about everything about metaphysics is controversial, von Foerster tells  us:

When I invoke Metaphysics, I do not seek agreement with anybody else about her nature. This is because I want to say precisely what it is when we become metaphysicians, whether or not we call ourselves metaphysicians. I say we become metaphysicians whenever we decide upon in principle undecidable questions.

Why does our deciding on undecidable questions make us metaphysicians?

The answer lies in the difference between  decidable and undecidable questions. The former are unambiguously decided by the framework within which they are posed whereas the latter are not. Therefore we are forced to make a choice (of framework and consequent decision) based on our interests and opinions. The point is, our interests and opinions tell us something about who we are, so the choices we make when deciding on undecidable questions define our individual human qualities.

As von Foerster states:

Decidable questions are already decided by the framework in which they are asked, and by the  rules of how to connect what we call “the question” with what we may take for an “answer.” In some cases it may go fast, in others it may take a long, long time, but ultimately we will arrive, after a sequence of compelling logical steps, at an irrefutable answer: a definite Yes, or a definite No.  But we are under no compulsion, not even under that of logic, when we decide upon in principle undecidable questions. There is no external necessity that forces us to answer such questions one way or another. We are free! The complement to necessity is not chance, it is choice! We can choose who we wish to become when we decide on in principle undecidable questions.

The claim that we choose who we wish to become  becomes evident when one notes that  organisational decisions often put decision makers into situations in which they have to make ethical choices. For example, cost cutting measures may lead to job losses, changes in work policies may affect employee well being, wrong choices of technologies may pollute the environment  and so on. The point is that most undecidable (or wicked!) problems in organisational life have ethical dimensions, and we define ourselves as human beings when we make decisions regarding them.

No wonder then that we have so many devices  by which people try to avoid the making decisions and the consequent responsibility that comes with it. As  von Foerster states:

With much ingenuity and imagination, mechanisms were contrived by which one could bypass this awesome burden. With hierarchies, entire institutions have been built where it is impossible to localize responsibility. Everyone in such a system can say: “I was told to do X.”

On the political stage we hear more and more the phrase of Pontius Pilate: “I have no choice but X.” In other words “Don’t make me responsible for X, blame others.” This phrase apparently replaces: “Among the many choices I had, I decided on X.

Then, aiming squarely at rationality and objectivity, he writes:

I mentioned objectivity before and I mention it here again as another popular device of avoiding responsibility.  Objectivity requires that the properties of the observer shall not enter the description of his observations. With the essence of observing, namely the processes of cognition, being removed, the observer is reduced to a copying machine, and the notion of responsibility has been successfully juggled away.

..and I take it as given that none of us wish to be reduced to mere copying machines.

Conclusion

The mechanisms of decision making in organisations encourage decision makers to  avoid the burden of responsibility rather than accept it – “Sorry, but it is business” or “I’m just following orders” are common phrases that flag such avoidance. From personal experience, I’m painfully aware of how easy it is sweep ethical issues out of one’s field of vision when dealing with wicked problems…and I now also understand that metaphysics is not a rarefied academic discipline, but one that holds practical lessons for us all –  you, me, our peers, and those who sit on the floors below and above us.

Written by K

July 19, 2013 at 9:50 pm