Gallery of Agent Behavior as a Driver for Novelty and Creativity in Human-Robot Co-Drawing

Angelica M. Bonilla Fominaya, Daehwa Kim, Jack Mirenzi, Anisha Jog

Carnegie Mellon University

Describing Agent Behavior Via Prompt Design

To describe a range of behaviors, we rely on intentional visual/semantic dissonance/congruence to provoke lateral problem-solving and break creative fixation. Here are example co-drawing outputs from six artists with our nine prompt designs.

Visual
differentneutralsimilar
Visual different, semantic similar Visual different, semantic neutral Visual different, semantic different Visual neutral, semantic similar Visual neutral, semantic neutral Visual neutral, semantic different Visual similar, semantic similar Visual similar, semantic neutral Visual similar, semantic different
similarneutraldifferent
Semantic
1 / 6

Co-drawing Outputs from the Physical Robot Agent

With four focused group participants, we asked them to draw an open collaborative landscape drawing over alternating turns. Particpants were given various drawing implements such as color sharpie, highlighters, pencil.

Co-drawing with the physical robot Co-drawing with the physical robot Co-drawing with the physical robot Co-drawing with the physical robot Co-drawing with the physical robot Co-drawing with the physical robot Co-drawing with the physical robot Co-drawing with the physical robot

Co-drawing Output with Online Agent

With twenty particpants, we performed preliminary study using browser-based painting app with tablet and stylus.

Conditions:

Hover over a drawing (tap on a touch screen) to replay how it was made. Blue strokes: participant's. Red strokes: co-drawing agent's.

Adversarial

Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)
Robot drawing (adversarial)

Collaborative

Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)
Robot drawing (control)