technology paradox
Setting the context:
Technology is a tool.  It can be used for good or ill.  The overarching intent of all my efforts is to try and understand the question of vitality by sculpting tools to elucidate these existential investigations.  From the telescope to writing itself, technology can certainly help us explore.  Of course, it has a dark side, as any technology can be employed to nefarious ends.  But, even more subtle than the question of intent, technology has some intrinsic attributes that must be faced as we embrace it.  I'll focus on three inter-related attributes, each with existential implications, to help set this investigation's context: Functional Over-coherence, Species Insulation and Entropy Maximization.
Technology, to date, is defined by its functional utility.  We make tools for reasons, and if the tool does not perform that pre-established purpose, we consider it broken.  However, as Greek tragedy points out, humans have a curious habit.  As we put more effort into making tools for useful reasons, we double-down on believing past reasons for a tool will be relevant reasons in perpetuity.  In other words, we create a positive feedback loop where the tool is made to perform some task useful to the human in a given context, and then we try to convince ourselves - even modifying our environment - to maintain the reason to maintain the tool.  Often, this maintenance is in spite of a changing environment.  Given our initial investment in and success of a tool, we tend to invert the logic, exhibiting hubris, to preserve a tool's fixed, if archaic, raison d'être.
This Functional Over-coherence necessitates insulating ourselves from our environment.  We use ever more resources to mitigate the growing mismatch between our own dynamics and those in the larger open system.  This insulation then allows us to cohere ever harder on the fabricated belief in stability, a belief animated by mechanistic metaphors of fixed functions and determinate outcomes.  Ever increasing order and isolated efficiency is both the reward and its own cost.  But, being a limited species, we lose track of all the costs we've externalized.  We focus in, seeing only the benefits, while entropy accelerates beyond the horizon of our awareness.
This Species Insulation made possible by our technological insulation from change accelerates entropy production.  Not only is there waste from making the originally useful tool, there's waste on top of that to maintain into the future an environment conducive to the utility for that original tool.  This accelerates waste and risks rendering our species toxic to the wider biosphere, which, of course, renders us toxic to ourselves as Silent Spring foretells.
Some stabilization is healthy.  However, as Heraclitus observed, one needs to change to remain the same, i.e. to be a river is for it to flow by definition.  This is true for life ontologically.  The dilemma is a "bird in the hand vs. two in the bush."  Does a society focus on what works now, specializing, or does it diversify its capacities, generalize?  Do we cohere on what is known or risk exploration into the unknown?  Life is in the balance.
This paradox is captured by the Blind Men and the Elephant.  Each has their own perspective, perceiving the world in their own way.  To maximize the view of one over the others risks perceiving little of reality.  The task is to first acknowledge the reasonable, even if different, view of each and then strive to resolve the contradictions among them.  My intent is to resolve this dilemma, and those described above by creating a novel technology to help find overlaps among our diverse understandings, while providing a lens through which this understanding of ourselves in the physical world is expanded.
Below are a series of projects that describe my journey to create this new technology that is not merely mechanical, and whose behavior can adapt and complexify in response to its environment, not unlike sentient creatures.  The intent is to better understand our own capacity to navigate the paradoxical terrain into the future by building a technology that doesn't abet our over-coherent, insulated and wasteful relationship with the only known biosphere.  It intends to augment our individual and social capacity to perceive the wider existential implications of our choices.
World Trade Center Memorial Competition
World Trade Center Memorial Design Competition Entry; 2003
Design - 3D AutoCAD, 3DS Max, Photoshop
This rather ambitious task started with a seemingly simple and practical intent.  I wanted to make an interactive sculpture that transcends current New Media.  More than a mechanical or algorithmic stimulus-response interaction with passersby, I wanted to create an immersive experience where the architectural artifice had a literal sentient relationship with human visitors.
Back in 2003, to do this, I proposed a transparent obelisk that would display a dynamic 3D abstract pattern.  It was an interpretation of sensed motion, heat, sound, and other patterns of visitors to the site (upper image below).  Individual participants would figuratively see themselves reflected in the proposed 3D display (lower left image); while, many participants would see both themselves and the abstract patterns of others superposed in real-time (lower right image).  Based on sensing people, past and present, the dynamic pattern would evolve to create ever-novel and increasingly complex "patterns of patterns".
The intent was for people to imagine themselves among others in a non-judgmental abstract way.  I wanted them to see themselves as distinct while inter-related, simultaneously.  Over time, patterns would be selected by the system that tended to attract more people, thereby increasing its own impact.  This was my response to the acrimony of the 9/11 attack.
Below is a diagram of my nascent attempt at a rigorous description.  Creating that diagram generated many more questions than answers and set the stage for a decade of investigation into how exactly a technology could be built that would literally sense its environment and continuously synthesize novel higher-order patterns based on those sensory inputs.
Click on image to see original competition entry
Studio project within the Conceptual and Information Arts, San Francisco State Univ.; 2007
Design - AutoCAD, 3Ds MAX and Photoshop
To implement the art installation above, as early as 2004, I was fascinated by artificial neural networks, not unlike those under the hood of current Deep Learning implementations; however, once I read a number of neuroscience papers and investigated some of the critiques of “brain as computer” by John Searle, Hubert Dreyfus and Rodney Brooks, I realized that my goal of sentience wasn’t down any purely digital road.  So, I went to many lectures at the Helen Wills Neuroscience Institute at UC Berkeley, and was part of a neuroscience study in Professor Levi’s perception lab.
In 2007, I applied and was accepted to the Conceptual Information Arts program at San Francisco State under Steven Wilson at the time.  But, after a semester I realized that my technology, or "medium", able to implement my proposed "sentient observatories" was not ready.  After SF State I recommitted myself to rigorously articulate both the design to build and theory to test what I then called "synthetic cognition".  And for technical implementation purposes, between 2007 and 2009, I completed the analog and digital circuit design tracks at San Francisco City College along with JAVA programming.
And, although my semester at SF State didn't render my technology any more rigorous, it did help me refine my artistic intent.  The project shown above was an attempt to better integrate a built structure with an immersive and interactive experience.  This project links the artistic intent in my World Trade Center Memorial design to the body of work at Studio for Public Spaces, which further develops and realizes my art installation practice.
As an "Improbable Monument", it intended to challenge the idea that the permanence of memory relies on the static and immobile rigidity of a traditional monument.  Like Heraclitus's river allegory, actual memories in the brain are paradoxically maintained through change.  They are adapted by subsequent experiences to maintain their relevance in a changing world.  Visitor stimulation is necessary for this maintenance, just as humans must have stimulation.
Schematic design for a Self Organizing Autonomous Resonant Superposition Engine; 2011
Design - AutoCAD, 3Ds MAX, Photoshop

Build - analog sensors and physical 3D nodal matrix with an abstract digital data structure
My work on the Improbable Monument at SF State helped me realize how much further I still had to go to realize a viable implementation for anything approximating animal sentience.  So, from 2007 to the end of 2011, I focused entirely on that implementation, which is summarized briefly below.
To understand its non-exotic, if novel and unfamiliar, nature it helps to understand my original inspirations for SOARSE.  The precipitating event was the trivial observation of sunlight reflecting off a baking dish in my kitchen.  The light shown on a wall, illuminating undulating waves, a sort of gossamer of dancing light.  I marveled at how much information was contained in that simple, yet dynamic, reflection; and, I also realized that this information was, in a sense, a physical proto-interpretation, or representation, of many simultaneous inter-dependent events: the sun's angle; the geometry of the dish and its constraints on the waves; the water properties; perturbation of the dish; and, the 2D wall.
This observation galvanized two other core inspirations: my study of quantum mechanics at UC Santa Barbara and my exposure to Colin Rowe's Transparency: Literal and Phenomenal at CU Denver.  The conceptual and practical take-away from these two deep subjects is the concept of superposition.  Briefly, the problem of sensing and knowing rests on the capacity to realize not just individual things in the mind, but the interplay between them, simultaneously.  In other words, some physical medium must embody and superpose both the distinct patterns and their inter-dependencies, simultaneously.  For example, knowing a few things about an apple - like color, shape, feel and taste - and their inter-dependencies is significantly more useful than knowing infinitely many isolated things.  These myriad physically embodied inter-dependencies, like the waves in the baking dish, are the scaffold upon which higher-order conception can be accrued.
But, how does one make this?
As mentioned above, I started with recursive neural nets, the basis for Deep Learning today.  However, those neural nets, when digitally implemented, are constrained to isolated states, because that's the genius of digital: its noiseless preservation of state.  But, the downside is that, by design, digital can never truly be superposed.  It can only ever simulate superposition.  Nature, on the other hand, is inherently superposed.  Nature is fundamentally noisy; and, the brain evolved in and adapted to this reality.  As Searle points out "simulation is not duplication", and as Korzybski pointed out "the map is not the territory."
But, what do Searle and Korzybski really mean, and what do we get in return for what amounts to adding noise to our once isolated and stable states?  What are we trying to put back into our technologies that current functional machines have bracketed off?  How can a technology reform itself to inform itself?
Stable states are not adaptive; so, by adding what I call "structured noise", we get the opportunity to discover novel inter-relations among environmental phenomena.  The noise is structured because we are putting relevance back into the machine; in other words, each Primary Node (burgundy above) is uniquely sensitive to the environment, just like people are.  Digital transistors, on the other hand, are specifically designed to behave identically; whereas, diverse SOARSE elements resonate with their environment differentially, and then "emote" a signal back into their shared space to create a novel superposed complex pattern, like the baking dish patterns.  This so-called "noise" is quite structured because it has inherent physical order that is relevant to the higher-order environment that stimulated it.  Now, Secondary Nodes (light blue above) literally sense this interstitial field and harvest the sparse order that emerges.  This "harvesting" is the creation of interconnections along the relatively constructive interference in the superposed terrain; and, these connections tend to correlate with the co-stimulation of diverse Primary Nodes by patterns in the environment, e.g. Hebbian Plasticity.  In essence, the system re-forms itself to in-form itself, because it accrues network biases that sensitize it to ever-more complex patterns of patterns that are literally resonant with dynamic patterns in its environment.
What was once a dilemma with the diversity of response from the Blind Men, is now a strength as the system leverages its distinct perspectives of a shared reality to embody a higher-order sentience.  Like Heraclitus's river, the distinct sentient self, situated in the world, is maintained through continual and dynamic shaping by the complex terrain it is immersed within.  Far from being a simulation, a static map or a modular cog with a functionally fixed response, the patterns of patterns that accrue within the sentient agent are unique to its internal structure, tuning, history and physical vantage point.
SOARSE is a technology that implements a self-organizing adaptive resonant superposition engine, a step towards authentic sentience; and, it is my artistic medium, which intends to breath some semblance of "life" into the lifeless technology and architecture that currently insulate us from a more general, adaptive and vital understanding of ourselves in the world.
To better understand how this technology will augment my artistic practice moving forward, please see my Artist Statement.
See SCIENCE section of this site for more details on the rigorous testable theory for this proposed technology.
SOARSE Summary - a four page summary of SOARSE.
Full Draft Manuscript - full description and theory of SOARSE design along with means for hypothesis testing.
Research and Development - outline, description and documentation of experiments implementing SOARSE.
Back to Top