12

I have tried to come to terms with the notion of "complex systems" of which I heard in one of the lessons at school though without too much depth. I grasp that a complex system is such that the behavior of the elements in the system do not yield wholly the behavior of the system as a whole - in some sense the system is not predicted and may be thought of as something between total order and total chaos. I also understand that practically everything around us might be of such nature - the internet, the infrastructures of electricity and water, the human society, the human brain, and so on. However I could not pick the practical value in keeping this view "all the way" while researching this or that.

Trying to better understand "complexity" I have ran into two wonders: is it the opposite of reductionism? Is it some sort of holism? What is the historical and philosophical context of complex systems?

J D
  • 26,214
  • 3
  • 23
  • 98
Luna
  • 769
  • 4
  • 14
  • 2
    To understand complex system is complicated due to it's internal structure. Actually for any computably generated object it may be such a complex system itself and there's a complexity description measure of any generated object called Solomonoff-Kolmogorov-Chaitin complexity and Algorithmic information theory principally studies complexity measures on strings (or other data structures). Because most mathematical objects can be described in terms of strings... it can be used to study a wide variety of mathematical objects... – Double Knot Feb 14 '22 at 00:38
  • 3
    If restricted to understand complexity of the theoretical cases of any recursively axiomatized theory such as the common ZFC and PA, Chaitin proposed his famous “heuristic principle,” the theorems of a recursively axiomatized theory cannot be significantly more complex than the theory itself. Thus the complexity of such a theoretic system as a whole cannot exceed and very close to that of its most complicated theorem which is only part of the system. Also it can be shown the probability that a true sentence of length n is provable in the theory tends to zero when n tends to infinity... – Double Knot Feb 14 '22 at 01:38
  • 2

5 Answers5

11

Short Answer

Complex systems is a mathematical approach to studying certain objects of science, and is neither a science, nor a philosophy, but an approach that might be considered a combination of the mereological with mathematical modeling, which is a sub-discipline of mathematics. It is a topic frequently found in conjunction with chaos theory since real-world phenomena are complex, stochastic systems.

Long Answer

Determinism

The paragon for the mathematization of the sciences is often considered Newtonian mechanics, since Isaac Newton took the philosophy of mathematical insights of Galileo Galilei and Rene Descartes and applied them to revolutionize physics, particularly with the laws of motion. By the time of Kepler, mathematical science was far more common, but after Newtonian mechanics became a shorthand for reductionism and determinism. Some scientists at the end of the 19th-century believed the human species was on the cusp of solving all important scientific problems, and it was just a question of how much computation was involved in modeling the universe, and the things in it. Of course, the revolution of quantum mechanics in physics and a set of incompleteness theorems in logic began to put the kibosh on that thinking by before WWII.

Non-Determinism

By 1990s, chaos and complexity theory began to enter the public consciousness outside of universities with books like Complexity: The Emerging Science at the Edge of Order and Chaos by Waldrop and Chaos: Making a New Science by Gleick. Today, there's a body of literature and can find manuals on programing those sorts of models. O'Reilly has a recent book in python Think Complexity that demonstrates how widely studied methods for constructing such models are.

At the root of complexity theory is the idea that behavior of systems can modeled from the very simple, such as a mathematical point on a plane, to having billions of data points in four dimensions, such as in weather systems. In fact, highly related to complex systems is the notion that to mathematically model them requires a science of its own, and in computer science, computational complexity deals with that. What is at play is a desire to understand 'when does a model require qualitative differences or when does it require quantitative ones?'

Scientific Application

As an example of modeling complex systems, one practical application is folding proteins. Stanford University many years ago launched a distributed client for utilizing unharnessed cycles on CPUs and their cores to do such research with their Folding@Home initiative. In the days of alchemy, alchemists would haphazardly combine substances through various processes and see what would happen, and a lot knowledge about substances like aqua fortis was accumulated. But as modern chemistry emerged out of these empirical activities and the evidence they accumulated, mathematical models emerged, simple ones at first, like Dalton's law or Avogadro's number.

These days, physical chemistry, affectionately known as p-chem, uses sophisticated mathematical models to predict the behavior of molecules. Since the human body can be seen as a large set of folded proteins, folding proteins is important to experimentation in medicine. In Edward Jenner's day, experimentation meant manually attenuating potential pathogens and injecting them into live people and seeing what happened. But there are several downsides to this sort of scientific practice. It's somewhat unethical; it's expensive to buy substances and build and operate laboratories; it's time-consuming to go through permutations of substance and process in the real world. So, chaos and complexity theory might be thought of as the intellectual substrate of an approach to use computation to model real-world phenomenon to narrow down what work to perform in the real world.

Computation

What makes chaos and complex theory a bit different than other contemporary academic disciplines is that it attempts to be interdisciplinary, and that's because all phenomena can be modeled in roughly the same way. Systems have parts, interact with other systems, and can be modeled with mathematics. In data science, big data models and machine learning techniques can be applied to these models which are often built on relational models. There are academic programs and institutions devoted to these sorts of techniques. One famous place where such ideas are studied is the Santa Fe Institute. From WP:

The Santa Fe Institute (SFI) is an independent, nonprofit theoretical research institute located in Santa Fe, New Mexico, United States and dedicated to the multidisciplinary study of the fundamental principles of complex adaptive systems, including physical, computational, biological, and social systems. The institute is ranked 24th among the world's "Top Science and Technology Think Tanks" and 24th among the world's "Best Transdisciplinary Research Think Tanks" according to the 2020 edition of the Global Go To Think Tank Index Reports, published annually by the University of Pennsylvania.2

Summary

So, these days, if you're looking to crush an epidemic, one of the best approaches is to build a series of sophisticated models: model the epidemiology, and the human body, and the biomolecular interactions. Then, search a problem-space for desirable outcomes. If you can fold a protein, and then use CRISPR to engineer a bioreactor to produce a substance, and then model the best way to economically distribute the substance, you have a tremendous opportunity to find solutions to problems quickly, cheaply, and effectively. But that requires a certain mastery of interdisciplinary thinking, an understanding of the probabilistic nature of physical phenomena, and an aptitude for modeling large, complex systems effectively on computers. And that's the hole complex systems seeks to fill.

J D
  • 26,214
  • 3
  • 23
  • 98
  • And...? What is a complex system? – RodolfoAP Feb 13 '22 at 21:26
  • One that satisfies this definition, roughly: https://en.wikipedia.org/wiki/Complex_system – J D Feb 13 '22 at 21:28
  • 1
    I think that it's a rebranding to put the idea of interdisciplinary thinking at the forefront, and that like most definitions, there's no definition of sufficiency and necessity that is adequate. It might better be apprehended as a prototypical definition.. – J D Feb 13 '22 at 21:30
  • Wikipedia: "A complex system is a system composed of many components which may interact with each other", sorry, but that's really naive. How many? And, excluding that number, which I hope someone provides, how is this different from the classical definition "A system is a set of interrelated parts"? – RodolfoAP Feb 13 '22 at 21:30
  • 4
    @RodolfoAP I'd argue you're engaged in a specious thinking of the sorites paradox, or the fallacy of the beard. The idea isn't that there is some sort of strict criterion that allows for a taxonomy from simple to complex, but rather an understanding that there are certain philosophical principles at play a la emergence/supervenience/mereology that form a fundamentally more sophisticated way to think of systems... – J D Feb 13 '22 at 21:33
  • 2
    that's where the features section comes in. Complex systems in prototypical fashion exhibit some family resemblance of: cascading failures, openness, fuzzy boundaries, irregular transitions of state, have non-linear, system control loops, etc... – J D Feb 13 '22 at 21:36
  • 2
    Complex systems in science are rooted in chaos theory and non-linear dynamics, where I'd say the definitions are quite clear: Have philosophers speculated on how chaotic forces meeting together can result in order?. Complex and emergent systems are subtypes of non-linear systems – CriglCragl Feb 15 '22 at 17:11
  • @JD chaos and complex system are deterministic but non predictable ( quantum mechanics is non deterministic) – quanity Dec 07 '23 at 13:26
11

A system is a complex system if its characteristic properties cannot be investigated by studying its components in isolation. A typical example of a complex system is the weather: One cannot study the weather by studying the path of each separate molecule within the atmosphere.

Hence a complex system resists a reductionist approach. But I would not throw out the baby with the bath water: Not each part of a complex system is connected to each other part in a holistic way. A possible approach to study complex systems is to decompose the system into layers. And then studying each layer by a suitable method adapted to the layer.

Many complex systems show chaotic behaviour though they are deterministic: A slight change in their initial conditions provides completely different developments, which cannot be predicted in the beginning. A typical example is the Mandelbrot set, which results from iterating again and again the simple function „z maps to z^2 +c“. The result depends in a sensible way on the value of „c“.

Hence one root of complexity is chaotic behaviour, it may result when the basic equations are non-linear. In a historical context non-linearity is one of the roots for studying complex systems.

Jo Wehler
  • 30,912
  • 3
  • 29
  • 94
  • This is just holism, nothing new here. Non-linearity is also a feature of classical systems. Nobody said that the classical systems theory study only linear systems or systems which parts have the same features as the whole. "division into lsyers" is the reductionist approach, which is not incompatible with holism. See my answer. – RodolfoAP Feb 14 '22 at 05:01
  • @RodolfoAP 1. Is your objection: System Theory also comprises the theory of complex systems. Hence there is no need to coin a new term? 2. How and where do you establish a border between System Theory and other theories from natural science or sociology? Which topics do not belong to System Theory? 3. In your answer you „classify the Systems Theory in the category of metaphysics“. Why metaphysics? – Jo Wehler Feb 14 '22 at 07:46
  • Yes. 2. No relation, but anyway. In any case, the question is what is the demarcation between that allegedly "complex systems theory" and the traditional? 3. Instead, question yourself: are "complex systems" part of science (empirical truth, that is, knowledge dependent on the senses), or metaphysics (pure, ideal, related to mathematics)? If it depends on the senses, observation, it is science, so, near biology.
  • – RodolfoAP Feb 14 '22 at 08:31
  • This raises a further question: why can't a complex system be investigated by studying its components? Is it because it is practically in feasible for us, or because this will not work even in principle? In other words, is this a property of the system itself, or the people investigating the system? – gardenhead Feb 15 '22 at 19:11
  • @gardenhead One reason: Because of the large number of components. There are about 6*10^^23 molecules of air within some cm^^3. One cannot solve Newtons equations for a system of about 10^^23 coupled differential equations. Here thermodynamics became the method of choice to investigate averaged quantities of the system like pressure, temperature and energy. – Jo Wehler Feb 15 '22 at 19:27