Fusion: Landscape and Beyond

Fusion Landscape and Beyond is an interdisciplinary art project, exploring the role of memory in imagination and creation through Artificial Intelligence(AI) and Chinese landscape painting. Inspired by the theory of Cultural Memory, which emphasizes the process of selectively retrieving and updating memory with the responses to the ever-changing present situations or concerns, we find that the current text-to-image AI algorithms can be thought of as analogous to this theory of Cultural Memory, in that they react to diverse human instructions with relatively fixed knowledge, i.e. checkpoints in pre-trained models. It shows different results based on both its formed dataset and the current inputs, producing more fantastic and unbridled images compared with the original ones in its dataset. In addition, cultural memory is also a kind of institution that exists only in disembodied form and requires preservation and re-embodiment. In response to this analogy and the three key components of the cultural memory – tradition, transmission, and transference – we propose a novel concept called AI memory and link that to the Chinese landscape painting (Shan-Shui-Hua), a synthetic embodiment of creativity derived from the artist's memory. This series now includes three subsequent works: Fusion V1: Synthesis of Time and Terrain (2022), Fusion V2: Calligramof Contrasts (2023), and Fusion V3: Illuminating Urban Scars (2024).

FUSION V1: Synthesis of Time and Terrain (2022) contains a video animation titled The Faded Landscape(2022), a series of still images From Landscape to Landscape (2022) series & Exotic Landscape (2022) series created with our fine-tuned AI text-to-image generation models. We also developed a special edition with AI+AR exploration with From Landscape to Landscape (2022) series. In our artworks, we combine the symbolic elements of landscapes that span time and space to represent the past, present, and future through “AI memory”.

> The Faded Landscape(2022) Preview in 720p (The original resolution: 7680*2160 | 60fps | 06:17)

> Still Images: Fusion and Contrast of Urban & Nature
- Group 1:

The Exotic Fusions (2022). Fine art  paper print, AI generated image, 64 × 22 inches.

The format of display is inspired by traditional Chinese bookbinding technique called the dragon scale bookbinding and a 17th century European composition technique, tabula scalata. Both techniques involve fusing different sets of disconnected elements into one harmonious entity.

View in different perspective:

- Group 2:

From Landscape to Landscape NO. 1 | New York (2022). Fine art matte paper print, AI generated image, 22.05 × 47.25 inches.

The concrete jungle is here. Can you discern city forms in the mountain and river landscape?

From Landscape to Landscape NO.2 | Shanghai (2022). Fine art matte paper print, AI generated image, 22.05 × 47.25 inches. 

The floating characters display AI’s effort to learn and imitate scripts of Chinese calligraphy. It is more of an artistic than semantic creation. We call it the “calligraphy of AI.”

From Landscape to Landscape NO.3 | Future? (2022). Fine art matte paper print, AI generated image, 22.05 × 47.25 inches.

What will the future city / landscape look like?

From Landscape to Landscape NO.4 | Future+ (2022). Fine art matte paper print, AI generated image, 22.05 × 47.25 inches.

What harmonious dance between city and nature will define the future, where concrete jungles blend seamlessly with the lush embrace of forests, and the gentle hum of technology is accompanied by the melodious symphony of birdsong?

> An AR exploration titled Landscape Illusion (2024)
> Photos from previous presentation
Photo of the exhibition in Cali2 by Qualcomm Institute
Photos by Qualcomm Institute

As an extension of this project, we created an AI Chinese Poem & Painting Generator, Idyllic, bridging the Chinese poem and painting through "AI memory". Click here to see the documentation of the generator.

Credits:

Artist: Mingyong Cheng

Art Historian & Research and Exhibition Support: Xuexi Dang

Chinese Research Support: Xingwen Zhao

Technical Support: Zetao Yu

Project advised by Memo Akten & Kuiyi Shen

Music: 鹤舞白沙 and 是我的脑海还是云的末端 by Amingliang

Sound/Recording: Water Lap by snog, Rain Moderate by InspectorJ, Road Traffic Environment Ambix by KilianJosselinAlba

This project used open-source AI generated art tools Stable Diffusion and Deforum. 

Exhibition & Conference Presentation:

AR experience: Landscape Illusion, ACM CC (Creativity & Cognation) Conference 2024 Art Gallery with anart panel, Chicago, US

NeurIPS (Conference on Neural InformationProcessing Systems), Creative AI Track 2023, New Orleans, US

Animation: The Faded Landscape, 26th Antimatter [media art], Victoria,BC, Canada, 2023

Animation: The Faded Landscape, CVA Gallery, University of Toledo,Ohio, US

Animation: The Faded Landscape, Here and Now, 8th Digerati EmergentMedia Festival, Denver, CO, US

Animation: The Faded Landscape, 28th Split Film Festival/InternationalFestival of New Film, Split, Croatia

Animation: The Faded Landscape, Heterotopias | Of Other Places, UTOPIA, New York, US

Animation: The Faded Landscape, Conference on Neural Information Processing Systems (NeurIPS) Workshop on

Machine Learning for Creativity and Design 2022, Online

Painting: From Landscape to Landscape, Unbound Natures, SME Gallery, UC San Diego, US

Painting: From Landscape to Landscape, Beyond Horizon, Annmarie Sculpture Garden & Arts Center, Solomons Island, MD, US

IDEAS Program, California Institute for Telecommunications and Information Technology, Qualcommon Institute & UCSD, San Diego

*As part of the Fusion series, collectively presented at:

ISEA (International Symposium on Electronic Art) Everywhen, CreativeOnline Artwork Track with an Artist Talk

CICA (CzongInstitute for Contemporary Art) New Media Art Conference, South Korea, 2024

Distrito 350, Calle General San Martín 350, Col Americana, Guadalajara,Jalisco.