Title

From Writing To Painting: A Kinect-Based Cross-Modal Chinese Painting Generation System

Keywords

Creativity; Cross-modal interaction; Paintings; Writing

Abstract

As computer and interaction technologies mature, a much broader range of media is now used for input and output, each of which has its own rich repertoire of techniques, instruments, and cultural heritage. The combination of multiple media can produce novel multimedia human-computer interaction approaches which are more efficient and interesting than traditional single media methods. This paper presents CalliPaint, a system for cross-modal art generation that links together Chinese ink brush calligraphy writing and Chinese landscape painting. We investigate the mapping between the two modalities based on concepts of metaphoric congruence, and implement our findings into a prototype system. A multi-step evaluation experiment with real users suggests that CalliPaint provides a realistic and intuitive experience that allows even novice users to create attractive landscape paintings from writing. Comparison with a generalpurpose digital painting software suggests that CalliPaint provides users with a more enjoyable experience. Finally, exhibiting CalliPaint in an open-access location for use by casual users without any training shows that the system is easy to learn.

Publication Date

11-3-2014

Publication Title

MM 2014 - Proceedings of the 2014 ACM Conference on Multimedia

Number of Pages

57-66

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

DOI Link

https://doi.org/10.1145/2647868.2654911

Socpus ID

84913533441 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84913533441

This document is currently not available here.

Share

COinS