12 March 2014

Complexity - SEBOK (15)

Complexity

This article is part of the Systems Fundamentals Knowledge Area (KA). It gives the background and an indication of current thinking on complexity and how it influences systems engineering (SE) practice. Complexity is one of the most important and difficult to define system concepts. Is a system's complexity in the eye of the beholder, or is there inherent complexity in how systems are organized? Is there a single definitive definition of complexity and, if so, how can it be assessed and measured? This topic will discuss how these ideas relate to the general definitions of a system given in What is a System?, and in particular to the different engineered system contexts. This article is closely related to the emergence topic that follows it.

Origins and Characteristics of Complexity

This section describes some of the prevailing ideas on complexity. Various authors have used different language to express these ideas. While a number of common threads can be seen, some of the ideas take different viewpoints and may be contradictory in nature.

One of the most widely used definitions of complexity is the degree of difficulty in predicting the properties of a system if the properties of the system's parts are given (generally attributed to Weaver). This, in turn, is related to the number of elements and connections between them. Weaver (1948) relates complexity to types of elements and how they interact. He describes simplicity as problems with a finite number of variables and interaction, and identifies two kinds of complexity:

1. Disorganized Complexity is found in a system with many loosely coupled, disorganized and equal elements, which possesses certain average properties such as temperature or pressure. Such a system can be described by “19th Century” statistical analysis techniques.

2. Organized Complexity can be found in a system with many strongly coupled, organized and different elements which possess certain emergent properties and phenomena such as those exhibited by economic, political or social systems. Such a system can not be described well by traditional analysis techniques. Weaver's ideas about this new kind of complex problem are one of the foundational ideas of systems thinking.

Later authors, such as Flood and Carson (1993) and Lawson (2010), expand organized complexity to systems which have been organized into a structure intended to be understood and thus amenable to engineering and life cycle management (Braha et al. 2006). They also suggest that disorganized complexity could result from a heterogeneous complex system evolving without explicit architectural control during its life (complexity creep).

However, "complexity" should not be confused with "complicated". Complexity is a system property related to the kinds of elements and relationships, not simply to their number. Ordered systems have fixed relationships between elements and are not adaptable.

Complex systems may evolve “to the edge of chaos”, resulting in systems which can appear deterministic but which exhibit counter intuitive behavior compared to that of more ordered systems. The statistics of chance events in a complex system are often characterized by a power-law distribution, the “signature of complexity” (Sheard 2005).

Objective complexity is an attribute of complex systems and is a measure of where a system sits on this spectrum. It is defined as the extent to which future states of the system cannot be predicted with certainty and precision, regardless of our knowledge of current state and history. Subjective complexity is a measure of how easy it is for an observer to understand a system or predict what it will do next. As such, it is a function of the perspective and comprehension of each individual. It is important to be prepared to mitigate subjective complexity with consistent, clear communication and strong stakeholder engagement (Sillitto 2009).

Due to the variability of human behavior as part of a system and the perceptions of people outside the system, the inclusion of people in a system is often a factor in their complexity. People may be viewed as observing systems or as system elements which contribute to the other types of complexity (Axelrod and Cohen 1999). The rational or irrational behavior of individuals in particular situations is a vital factor in respect to complexity (Kline 1995).

Defining System Complexity

Sheard and Mostashari (2011) synthesize many of the ideas described above to categorize complexity as follows:

1. Structural Complexity looks at the system elements and relationships. In particular, structural complexity looks at how many different ways system elements can be combined. Thus, it is related to the potential for the system to adapt to external needs.

2. Dynamic Complexity considers the complexity which can be observed when systems are used to perform particular tasks in an environment. There is a time element to dynamic complexity. The ways in which systems interact in the short term is directly related to system behavior; the longer term effects of using systems in an environment is related to system evolution.

3. Socio-political Complexity considers the effect of individuals or groups of people on complexity. People-related complexity has two aspects. One is related to the perception of a situation as complex or not, due to multiple stakeholder viewpoints within a system context and social or cultural biases which add to the wider influences on a system context. The other involves either the “irrational” behavior of an individual or the swarm behavior of many people behaving individually in ways that make sense; however, the emergent behavior is unpredicted and perhaps counterproductive. This latter type is based on the interactions of the people according to their various interrelationships and is often graphed using systems dynamics formalisms.

Thus, complexity is a measure of how difficult it is to understand how a system will behave or to predict the consequences of changing it. It occurs when there is no simple relationship between what an individual element does and what the system as a whole will do, and when the system includes some element of adaptation or problem solving to achieve its goals in different situations.

Complexity and Engineered Systems

The different perspectives on complexity are not independent when considered across a systems context. Both problem situations and potential solutions may contain subjective and objective complexity; structural complexity of a system-of-interest (SoI) may be related to dynamic complexity when the SoI also functions as part of a wider system in different problem scenarios. People are involved in most system contexts, as system elements and as part of the operating environment. People are also involved with systems throughout the lifetimes of those systems.

The main focus for systems approaches is organized complexity, the ways we choose to structure system elements to help manage and mitigate both objective and subjective complexity. Sillitto (2009) considers the link between the types of system complexity and system architecture. The ability to understand, manage and respond to both objective and subjective complexity be they in the problem situation, the systems we develop or the systems we use to develop and sustain them is a key component of the Systems Approach Applied to Engineered Systems and hence to the practice of systems engineering.