Ground
Works

Watching and Dreaming is a body of work that enables the viewer to peer inside the “mind” of a machine to observe its perceptions, mind wanderings, and dreams. This is not a metaphorical representation of dreams, nor a technical exercise in AI such as DeepDream [1] but the realization of a computational model of dreaming informed by cognitive neuroscience. This level of description avoids biases towards Jungian and Freudian psychology that assume dreaming is exclusively human. Dreams should not be considered independently of the perceptual capacities of the dreamer, and thus comparing this model to human perceptual abilities is problematic. For the audience, these artworks function as entry-points to consider the constructed nature of perceptions and the continuity of waking, mind wandering, and dreaming. For the artist, the artworks are sites of knowledge-making; it is through the making of artistic works that the model (computational formalization) and theory (argument that situates the model in empirical knowledge) are developed. The research underlying these artworks integrates knowledge in multiple disciplinary dimensions: (a) The computational modeling of dreaming processes (Zhang 2009; Treur 2011), (b) generative and media artworks engaging with the concept of memory and dreaming (Franco 2007; Dörfelt 2011), and (c) the conception of dreaming as imagination (Nir and Tononi 2010). In this text, Watching and Dreaming (2001: A Space Odyssey) (2014) serves as an exemplar of the Watching and Dreaming body of work. The machine attempts to learn and predict Stanley Kubrick’s film 2001: A Space Odyssey through the construction of its own subjective perception that is the basis of dreaming. “Mental” images generated during perception, mind wandering, and dreaming are subjective constructions bound to the peculiarities of the machine’s way of seeing. The body of work constitutes various manifestations of the cognitive model, not attempts to communicate the model’s mechanisms.

The Pennsylvania State University 'Viral Imaginations: COVID-19' project is a curated, online, publicly-accessible gallery and archive of Pennsylvanians’ creative expressions in response to their first-person, lived coronavirus pandemic realities. Constructing a safe and empowering space for sharing experiences across strata of race, ethnicity, language, age, socioeconomic status, education, and ability, the archive provides a platform for the preservation of unique and diverse narratives. Designed as a highly interdisciplinary endeavor, 'Viral Imaginations' brings together specialists from multiple domains— including art education; bioethics; women’s, gender, and sexuality studies; communication arts and sciences; information technology; and data analytics—into a robust, just-in-time ecology that produces public good and hybrid scholarship. Arising from a university seed-funding call for proposals during pandemic exigencies, this project demonstrates how coalescing around crisis can yield critical theory, scholarly discourse, and pedagogical opportunities across various fields through arts and humanities inquiries. Such scholarship, in turn, has cultivated interrelationships among 'Viral Imaginations' faculty, fomenting deep disciplinary integration, such as academic collaboration, faculty cross-appointment, and the introduction of expanded courses and novel academic program offerings. Artistic works within the 'Viral Imaginations' archive often challenge existing worldviews and traditions, calling individuals to question perceptions of reality, along with ethical judgments made in times of collective trauma. Ecologies of epistemology manifested in the visual and poetic work produced and exhibited in 'Viral Imaginations,' disrupting how we have known ourselves and our environment. Utilizing digital capacities to rearrange and reimagine order and relationality, the pandemic stories that emerge provide poignant insights into the affective state of humanity in crisis.