The Paradox of Organisational and Business Transformation in Modern Times
The paradox
Organisations have never had more transformation expertise available to them, yet many transformations end by recreating the very conditions they set out to change. New structures, operating models and technologies arrive, and within a few years the same frustrations resurface in a different form.
This is the paradox of transformation in modern times: the harder we apply what we know, the more faithfully we reproduce the system we are trying to leave. The cause lies less in the quality of our knowledge than in how we understand the terrain we apply it to.
Expertise loses fit, not value
A common observation is that traditional expertise loses value as the world becomes more volatile. In my experience, expertise rarely loses value; it loses fit. Every body of knowledge was built for a particular causal state, and the mindset applying it often fails to notice when that state has changed.
The knowledge itself remains sound. What fails is the assumption that the situation in front of us belongs to the same kind of causality as the one in which that knowledge was formed.
The flat earth paradigm
The closest metaphor I have found is the flat earth paradigm. William Perry, the Harvard educational psychologist whose 1970 study traced how people's ways of knowing develop, described a movement from dualistic thinking, through multiplicity, towards relativism. In my framing, each of these sits on its own two-dimensional plane. Robert Kegan, the Harvard developmental psychologist, later described a self-transforming mind able to hold and move between whole systems of meaning, reaching beyond relativism altogether.
Viewed from within any one plane, every challenge is flattened onto it, so we reach for the same knowledge, skills and tools each time. This is a quiet form of cognitive foreclosure: the plane feels complete because nothing outside it can be seen from within.
The shift comes with a post-relativistic capacity to see that these planes sit within a four-dimensional epistemology. Complexity, ambiguity, orthodoxy and temporal dynamics are the lenses through which we make sense of the territory, and each shapes how we perceive the others.
As Alfred Korzybski, the Polish-American founder of general semantics, put it, the map is not the territory. Viewed this way, some answers are already known, some are knowable with the right expertise, some are complex and only emerge as we engage with them, and some are chaotic, so turbulent that causality cannot be traced at all in the moment.
Why now: the compression of complexity
We are living through a compressed period in which complexity is rising faster than at any time before. Planes of thinking that once evolved over generations now coexist and compete, each attempting to resolve the same rising complexity from within its own frame.
The expertise of each plane has not lost its value. It remains valid for organisations still operating within the plane where it belongs. What compression does is amplify the gaps between planes, so that what works in one fails visibly in another. Kegan argued in In Over Our Heads that modern life already makes demands on adults that exceed the capacity most of us have developed. Compression widens that gap further.
Much of today's debate about transformation mistakes these gaps for disagreements: one approach against another, or all approaches as equally valid. Seeing past that chatter to what is really going on is the purpose of this article.
The missing link: developmental metacognition
What determines how we use these lenses, and whether we notice we are using them at all, is our level of metacognition. Clare Graves, the American psychologist whose research at Union College later underpinned Spiral Dynamics, found that value systems emerge as responses to particular life conditions. Each is a coherent way of making sense of the world, and from inside it, the world looks flat. Perry, Graves and Kegan describe these stages in different terms, but they converge on the same movement: from seeing the world through a single frame to seeing the frames themselves.
From a single plane, other systems appear either as opposites to be defeated or as equally valid preferences. Command-and-control hierarchy and self-organising teams are a familiar example: usually debated as rival philosophies, when each emerged to meet a different level of complexity, ambiguity and orthodoxy.
The epistemological shift is the metacognitive capacity to see this: to recognise which plane we are thinking from, and whether it matches the conditions we face. When it does not, we experience the paradox of transformation.
Orthodoxy: the filter in the system
Belief systems form as we normalise our perceptions of experience. Over time, those normalisations become orthodoxies: the sense-making filters through which we process ambiguity and complexity.
Orthodoxies behave like the if-then statements in a system. They work well within the variables the system recognises, but anything outside them is either filtered out as invalid or distorted to fit. Jean Piaget, the Swiss psychologist who mapped how children construct knowledge, called this assimilation: fitting new experience into existing schemas rather than changing the schema itself. Thomas Kuhn, the American physicist and philosopher of science, later showed the same pattern in science, where paradigms set aside anomalies until they accumulate into crisis.
Normalisation also creates comfort. The familiar plane feels safe, and the biases it produces keep us within it. Orthodoxy exists at every developmental level; what changes with higher metacognition is the capacity to notice our own filters, and to question them when the conditions demand it.
How expertise shifts with causal state
Dave Snowden, the Welsh complexity thinker who developed the Cynefin framework while at IBM in the late 1990s, treats these causal states as properties of systems themselves, and showed that each calls for a different sequence of sense-making and action. The territory is real; our lenses determine how well we perceive it. An airline dealing with disruption illustrates this well:
Known: a routine delay is handled by sensing the situation, categorising it and following the procedure.
Knowable: a technical fault needs engineers to sense, analyse and then respond.
Complex: when weather, crew availability and an air traffic control outage collide, no playbook covers the combination. The teams that cope best probe first with small parallel responses, sense what works, then respond by building on it.
Chaotic: in a full breakdown the order reverses entirely: act first to stabilise, then sense, then respond.
These states are not fixed. Situations move between them over time, and Snowden warned that complacency in an ordered system can tip it suddenly into chaos.
The expertise that succeeds at each level is not simply deeper knowledge. It is the ability to recognise which state it is in and change how it acts.
That is why bringing established knowledge and proven skills to complex or chaotic situations rarely produces adaptation or innovation. It produces more of what worked before, in conditions where what worked before no longer applies.
Recognising the plane you are on
Behaviour doesn't drive behaviour. Our values, beliefs, metacognitive habits, motivations and impulses do. Robert Dilts, whose logical levels model became central to NLP, placed beliefs and identity above behaviour for this reason: change at the surface rarely holds unless what sits beneath it shifts.
The first place to start is recognising our own habits in the face of complexity and ambiguity. When a complex subject arises in a meeting, notice what happens:
Are you motivated to learn more and understand its full complexity?
Are you drawn to a short-term fix, held by the belief that this is being efficient?
Does your internal dialogue move quickly to right or wrong?
These are indicators of our ability to see beyond the rational. Carl Jung, the Swiss psychiatrist who founded analytical psychology, distinguished the rational functions, which judge experience against what we already know, from the irrational functions, which perceive beyond it. He was clear that irrational meant beyond reason, not against it.
Many of us prefer to work in the space of what we know that we know. The space where we don't know what we don't know, with its unknown variables, complexity and ambiguity, can feel daunting, even irrational. Yet every human response is ultimately a reflection of our capacity to meet the complexity of life.
Symptoms as signals
This is where the paradox of transformation becomes visible. Organisations often approach transformation as a problem to be fixed, rather than first making sense of the causal state they are in.
A problem and a problema are two very different mindsets. The Greek problēma meant something put forward: a question set before us for inquiry, not an object to be removed. Seen as an object, a problem invites a fix. Seen as a problema, it invites us to ask what causal relationships produced it, and to read its symptoms as effects of the system itself.
Every decision we make relies on a causal bridge held largely unconsciously in our minds. We rationalise outcomes through behavioural cause and effect, when the deeper cause usually lies in the beliefs and orthodoxies that shape the behaviour. Chris Argyris, the Harvard organisational theorist, called this the difference between single-loop learning, which adjusts actions to fix a result, and double-loop learning, which questions the assumptions that produced those actions.
Resolving symptoms without addressing their causes produces a more polished version of the same pattern. Real change starts when we treat symptoms as signals about the causal system, and recognise that we are operating within that system, so responding well requires a higher level of understanding than the one that created it.
Contextual mastery
The way through the paradox is not more expertise, better tools or faster technology, valuable as each may be. It is a fundamental shift in mindset and contextual mastery: recognising which plane we are thinking from, noticing the orthodoxies that filter what we see, and remembering that complexity, ambiguity and time are maps we hold, not the territory itself.
It means approaching transformation as a problema rather than a problem: reading symptoms as signals, questioning the causal bridge in our own minds, and choosing how to act according to the causal state we face. Organisations that build this capacity in their leaders and people stop recreating the systems they set out to change, and begin to adapt and innovate in ways their existing knowledge alone could never have produced.
References
Argyris, C. and Schön, D. (1978) Organizational Learning: A Theory of Action Perspective.
Beck, D. and Cowan, C. (1996) Spiral Dynamics: Mastering Values, Leadership and Change.
Dilts, R. (1990) Changing Belief Systems with NLP.
Graves, C. (2005) The Never Ending Quest, ed. Cowan, C. and Todorovic, N.
Jung, C. G. (1921) Psychological Types.
Kegan, R. (1994) In Over Our Heads: The Mental Demands of Modern Life.
Korzybski, A. (1933) Science and Sanity.
Kuhn, T. (1962) The Structure of Scientific Revolutions.
Perry, W. (1970) Forms of Intellectual and Ethical Development in the College Years.
Piaget, J. (1954) The Construction of Reality in the Child.
Snowden, D. and Boone, M. (2007) 'A Leader's Framework for Decision Making', Harvard Business Review.
Comments