On applying integrative design-oriented cognitive science to hypertext: a framework for cognitive productivity

In The Reflective Practitioner [10], Donald Schön argued that applying science is not a simple matter of drawing logical implications from theory. Practice is messy. How might cognitive science inform the development of hypertext applications? Empirically oriented researchers might proceed in a 'lean' fashion, treating designs as hypotheses to be induced from and tested by data. Instead, in my talk I will show ways in which an integrative design-oriented (IDO) approach to understanding humans as autonomous agents [3] might help design hypertext apps. The approach suggests important problems to address and original ways to think about them. Conversely, designing and testing software can inform our IDO theories. I will illustrate the IDO approach with a theory of, and application for, sleep onset and insomnolence. Then I will focus mainly on hypertext applications that are more directly aimed at improving 'cognitive productivity', meaning how efficiently and effectively one uses knowledge resources to solve problems, deliver services, create products and ultimately improve oneself.

Cognitive science is meant to be the interdisciplinary computational study of brain-based and artificial information processing. In practice, cognitive scientists almost exclusively focus on classical or 'dry' cognition (memory, perception, reasoning, language, etc.) Emotion, motivation and ancillary functions tend at most to be viewed as distinct processes that can interact with cognition. In contrast, the IDO approach is necessarily integrative, seriously attempting to understand diverse blended mental functions, including motivational, affective and ancillary processes. It is partly inspired by artificial general intelligence [8]. While authentically interdisciplinary, the IDO approach is necessarily design-oriented meaning it revolves around attempts to reverse-engineer functionality (the 'designer stance'). It values specification and understanding of competence over prediction. It posits and is intrinsically concerned with requirements of autonomous interdependent agency (humans and other automata), such as the necessity of pursuing multiple top-level motivators in contexts of danger and despite limited knowledge. Two examples of research in this tradition are [1, 12].

A particularly impressive and inspirational early application of the designer stance, underpinning the IDO approach, is Lamontagne's theory of visual motion perception, which though not integrative led to the discovery of an entirely new class of visual illusions [6]. A promising example of integrative empirical psychology, though not from the designer stance, is Agnes Moors' theory of emotion [9]. Imagine how much more can be achieved by combining integrative and design-oriented approaches as described above.

Being so ambitious, the IDO approach calls for doing research and development in teams, which ideally include software architects. A major reason for doing computer simulations in AI is to determine whether one's theory can account for what we think it can, as Lamontagne's simulations did, (rather than it being 'hand waving'). Deriving hypertext or other practical applications from IDO theories will be much more difficult than from non-integrative theories. Like [8] say of the relationship between cognitive science and AGI, applications from IDO might normally (for the foreseeable future) at best be inspired by IDO theories. Still, I believe the back and forth between developing IDO models of autonomous agents and applying them will benefit both science and technology.

My colleagues and I have used the IDO approach in characterizing aspects of 'emotion', repetitive thought, obsession, addiction and mental alarms as mental perturbance [3]. Mental perturbance, by specification, involves the asynchronous generation and activation of motivators, which tend to consume executive functions (attention, deliberation, meta-management), influencing motives, goals and behavior [3, 11, 12]. Mental perturbance is thus inherently an IDO concept.

The IDO approach is being used as a basis for developing the somnolent information-processing (SIP) theory of sleep-onset and insomnolence [2]. SIP is an attempt to reverse-engineer the human sleep-onset control system as involving multiple blended mind-brain functions [7]. One of the postulates of SIP is that mental perturbance is insomnolent (interferes with onset of sleep). The SIP theory in turn informally led to a prediction that certain mental patterns could be both pro-somnolent and counter-insomnolent. If so, then sleep onset could be facilitated by triggering such patterns via the 'cognitive shuffle': imagining diverse concrete objects, scenes and actions prompted by audio hypertext (with SomnoTest and mySleepButton^® apps). While SIP is early stage research and development, it may serve as a reference model for future IDO applications.

Drawing on my two Cognitive Productivity books, I will sketch a cognitive productivity framework with seven principles and several key IDO concepts (such as effectance, architecture-based motivation and meta-effectiveness). I will illustrate how IDO-thinking can help specify hypertext software for these principles and concepts. For example, (a) assessing knowledge resources requires distinguishing caliber, utility, potency and appeal (CUP'A). (b) In The Manifesto for Ubiquitous Linking¹ 24 knowledge workers argued that ubiquitously available hyperlinks (in all user interfaces and automation of user-facing software) would contribute to intermediate awareness[4, 5] (consciousness), psychological flow (aspects of strategic surfing) and cognitive productivity. The manifesto has since been signed by many others. (c) Productive practice is a form of deliberate practice based on research on test-enhanced learning, expertise, testing effects, and other areas. Its objectives are ambitious; they are not merely to enable factual learning, but also the development of manifold 'mindware' underlying habits, attitudes, etc. Each of these concepts (CUP'A, consciousness, flow, mindware, etc.) should be understood in IDO terms and pose research challenges.

The Cognitive Productivity framework also applies to transforming ourselves with fiction. I will suggest that subscription streaming services like Netflix, Inc., and e-book services could be augmented with fun but implicitly serious games hyperlinked to content with a view to helping consumers apply, in their day to day lives, knowledge gleaned from fiction.

The practical end of the Cognitive Productivity framework is to help humanity, with hypertext software, address its opportunity and obligation to use knowledge to become more profoundly effective.

See https://cogzest.com/projects/meta-effectiveness/human22-keynote-ido/ for additional information.