Call for Papers. Synaesthetic Syntax IV: The Ghost vs the Machine

Infinitely Yours,  Miwa Matreyek, Golden Nica winner, Prix Ars Electronica 2020

In this, our fourth symposium at the critical juncture of embodied, sensual perception and the processes and technologies of expanded animation, we turn our attention to kinaesthetic and physical presence. Our human senses of proprioception (detecting our own position in space) and the vestibular system (detecting gravity, movement and balance) allow us to map our surroundings, navigate through space and detect the proximity of others. In an age in which our city streets have become a film studio with our every movement tracked by surveillance cameras and our every thought, memory or social interaction mediated through the camera, GPS, microphone and motion sensors of our smart devices, what does it mean to have a body? In what ways can expanded animation explore the physical presence of the live human body in motion and what is the role of technology in relation to this?

Venue

The conference will be held at the Ars Electronica Festival in Linz, Austria. The media festival will take place on the 6th–10h of September 2023: https://ars.electronica.art/festival/en/.

Call for Papers

We are looking for thought-provoking proposals that present innovative perspectives on working in expanded animation with the live body in motion. The questions we are interested in include, but are not limited to:

  • How can we critically and creatively use live performance in animation and animation in live performance? 
  • What can the liveness of performance bring to animation in terms of improvisation, participation, spontaneity and unpredictability?
  • Since ancient times, thousands of years of performance practice have produced many different ways to move a body from stylised forms of dance to exaggerated clowning. What is ‘life-like’ motion and why does psychological realism remain a goal for animated characters who are, after all, not human? 
  • In what new ways can the properties of human kinaesthetics be applied to animation? How can balance, gravity, weight, movement patterns, spatial mapping and proximity detection be re-imagined and creatively explored?  
  • What are the ethics of capturing and re-appropriating a performer’s physical movement signature with mocap? How can we counter the algorithmic biases built into the fabric of motion capture systems and the under-representation of different demographics in motion capture libraries? 
  • How might the technologies of surveillance, motion detection and capture be subverted and used for new artistic purposes?
  • How can the space in which performance takes place be animated and what impact does this have on performer and audience experience?
  • Can animation be used in live performance to disrupt theatrical conventions such as the fourth wall and unity of time and space?
  • How can animation be used to create proximity and communal experience in connected audiences?
  • How can AI technology revolutionize/change the way we will animate human bodies?
  • What does it mean to have a body in interactive animated environments (metaverse, games, VR)?

Deadline

Submission deadline: Friday, 26th May 2023

How to Submit

We call for papers, presentations and responses to our themes above.

Submission is via Oxford Abstracts at this link: https://app.oxfordabstracts.com/stages/5966/submitter. You will be prompted to create a free account with Oxford Abstracts.

Your submission should include:

  • Title of your presentation
  • Abstract (brief summary of your proposed presentation) 500 words (including bibliographic references)
  • Short Biography – 200 words
  • Relevant links to moving image work/websites etc.

If the paper is practice-based, it should include reflection and contextualisation in addition to presenting the practice. We will not accept papers that propose to show the practice only.

Finally, we are unable to provide feedback on individual submissions.

Keynote: Ghislaine Boddington, body>data>space

Creative Director, body>data>space / Reader In Digital Immersion, School of Design, University of Greenwich 

Ghislaine Boddington is a curator, presenter and researcher, known for her pioneering work placing the body as the interface for digital technologies and exploring telepresence, digital intimacy and virtual physical blending since the early 1990s. Her research led practise, expert direction and curations include “Robots and Avatars” (EU/Nesta 2009-11), “me and my shadow” (National Theatre 2012), Nesta’s FutureFest 2015-18 and the recent exhibition/symposium Extended Senses and Embodying Technologies (UoG/UCA Sept 22). In 2017 Ghislaine was awarded the esteemed IX Immersion Experience International Visionary Pioneer Award for her long-term work on collective embodiment within digital immersion. She is an expert presenter for BBC World Service Digital Planet weekly radio show/podcast, a member of the DCMS College of Experts and a Trustee for Stemette Futures. Her websites can be found at Linktr.ee 

Committees

The symposium is jointly organized by Dr. Juergen Hagler, Ars Electronica, University of Applied Sciences Upper Austria, Hagenberg and Professor Dr. Birgitta Hosea, Animation Research Centre, University for the Creative Arts, Farnham, UK.

Scientific committee: Professor Rose Bond, PNCA, USA; Andy Buchanan, independent scholar; Associate Professor Max Hattler, School of Creative Media, CityU, Hong Kong.

Synaesthetic Syntax: Gestures of Resistance

Synaesthetic Syntax is a one-day symposium on Sunday 11th September as part of the 10th Expanded Animation section of the Ars Electronica Festival. The event explores the complex relationship between sensory perception and expanded animation. In focussing on the primacy of the senses, the symposium aims to ask questions about the seduction of technology and how to maintain a discourse of what is fundamental about being human. This year’s theme is touch, gesture and physical movement. For more details about the presentations and how to view them online, go to the website for Expanded Animation.

We are delighted to welcome our keynote speaker and winner of a Golden Nica at this years Prix Ars Electronica: Rashaad Newsome. He will be giving his keynote presentation at 14.00 (CET) on Friday 9th Sept.

To be human, to be in a body, is to move and to feel; to move as it feels and to feel itself moving.[1] However, bodies do not exist in isolation. Bodies collide with one another in social contexts. They have the power to affect others or to be affected themselves. Bodies are structured by culture, but they can also resist. Motion and sensation felt in the body leads to change.[2]

At the time of organising the symposium, a line of tanks, armoured vehicles and troops 40 miles long were approaching Kyev: literally illustrating change in motion through technology. How can animation respond to this? How might technologies of gesture, proprioception and motion be used to create animation that goes beyond formalism and is able to reflect upon the forces that seek to contain movements towards change?

The sensation of touch can be brutal and violent or tender and loving. Through ‘haptic visuality’[3], a sense of touch can be evoked in animation by triggering physical memories of smell, touch and taste that engages the viewer bodily to convey cultural experience rather than through a use of language. How can touch be used in animation to create community or share memories?

Presentations:

The presentations respond to the following questions:

  • How to critically reflect on the tools and technologies of touch and movement used to create animation – motion capture, tablets and pens, sensors – and the data sets and libraries that they create?
  • How might the capture of motion, gesture and proprioception be used to innovate and tell stories of new communities?
  • What is the role of touch in conveying memory?
  • How might touch and biofeedback data be used in new ways to create animation?

[1] Paraphrase from p1. Brian Massumi, Parables for the Virtual: Movement, Affect, Sensation (2002, Duke University Press)
[2] Cf. Massumi, op. cit.
[3] Laura U Marks, The Skin of the Film: Intercultural Cinema, Embodiment and the Senses (2000, Duke University Press)

Ecstatic Truth VI: To Attend

International symposium in which expanded animation and experimental moving image intersect with documentary, 22nd April 2022, University of Creative Communication, Prague, Czech Republic 

Symposium programme

View the presentations here:

Etymologically “to attend” comes from Middle English (in the sense ‘apply one’s mind or energies to’): from Old French atendre, from Latin attendere, from ad- ‘to’ + tendere ‘stretch’.

At a time when attending an event can mean two things: being present in person or virtually, new questions are raised about what attendance means. If attendance and attention have the same etymological roots, can we consider attending as a form of attention rather than requiring physical presence? And if the essence of attention is its elasticity, can we argue that attention is able to stretch to overcome physical distance? That our shared attention (as well as time and virtual platforms) allows us to be in attendance, together, no matter how physically displaced we are.  

According to philosopher and cognitive scientist Lucas Battich (TT journal 3) shared attention not only helps us learn better, it is also multi-sensory. Is therefore watching a film together more illuminating than watching it alone, in separate spaces? What effect our new, so called “hybrid reality” has on our attention? Which role do the so-called proximity senses play in being attentive, attending to presence?

Attention is a precious and limited human resource which is under pressure: multiple forces constantly fight for our attention. Not just every day demands but social media, advertising and various other inventions of our late capitalist world, which understand that attention and money are intertwined. Attention is what makes us present, attention is learning, attention is the fabric of our experience, attention is being conscious, being conscientious, it is our future memory: we remember what we pay attention to, the rest becomes an unconscious assimilation of facts. And as we know from advertising methods, subliminal messaging can affect us on a level where we are unable to rationalise its effect, hence are more vulnerable.

Film (and moving image) as a medium has long been associated with memory: Like the mind it records and edits, what it deems significant. It can capture moments in time, make them conscious and preserve them for the future. It enables us, the viewers, to attend to the presence of those that came before us, even if they no longer share our everyday reality… Temporal and physical distances are bridged.

In association with Animation Research Centre, University for the Creative Arts, UK; Lusafona University, Portugal and Tangible Territory journal

Holes: ASIFAKEIL, Vienna

Due to the lockdown in Austria, I was unable to travel to install this work in person, so I am very grateful to Stefan Stratil and Holger Lang for putting it together for me and the exhibition has now opened. It’s seen through the windows of the gallery, so can be visited as part of a lockdown-compatible walk in the area.

The show was due to have an opening event as part of the Under_the_Radar festival, but this is now postponed. We hope that the festival can run at the end of January and plan a finishing event and presentation about the exhibition then. All is dependent on the pandemic and the regulations in place in Austria then. More news to follow.

CFP. Synaesthetic Syntax II : Seeing Sound / Hearing Vision, Expanded Animation symposium for Ars Electronica

Image: Refik Anadol, Machine Memoires: Space

Submission deadline: 30th June 2021
Symposium details: Sunday 12th September 2021, Ars Electronica, Linz, Austria (online)
Submit proposals here: https://easychair.org/conferences/?conf=ea2021

In the age of pandemic, our previously normal experiences of human touch and intimate proximity have become mediated by the screen rather than felt directly. We can no longer hear live music and feel the sonic vibrations; see a painting’s texture in close proximity; become immersed in the events of live theatre or engage in debate: these events are now bounded by the flat rectangular screen and limited by the extent of the pixels in our screen’s resolution.

Under these conditions, how can animation, in combination with music or audio art, re-engage us with bodily sensations received through the senses?

Coming together as a series of online events, this year’s Expanded Animation (http:/ /www.expandedanimation.com)symposium at Ars Electronica continues a dialogue about relationships between the senses, in particular the auditory and the visual. What are the rules, principles, and processes that govern correlations between sound and animation? How might these embodied sensations be explored, unpacked and reassembled in our age of virtual communication intensified by COVID-19?

Keynote Speaker: Refik Anadol

Our Keynote Speaker is media artist, director and pioneer in the aesthetics of data and machine intelligence, Refik Anadol. His body of work locates creativity at the intersection of humans and machines. In taking the data that flows around us as the primary material and the neural network of a computerized mind as a collaborator, Anadol paints with a thinking brush, offering us radical visualizations of our digitized memories and expanding the possibilities of architecture, narrative, and the body in motion. Anadol’s site-specific AI datasculptures, liveaudio/visual performances, and immersive installations take many forms, while encouraging us to rethink our engagement with the physical world, its temporal and spatial dimensions, and the creative potential of machines.

Submission Guidelines

In response to these themes, we call for academics and artists to propose 20-minute papers that bring the disciplines of music, audio art and animation together from a variety of perspectives: from historical, theoretical or critical perspectives to new and surprising practice. If the paper is practice-based, it should include reflection and contextualisation in addition to presenting the practice.

The proposal should include an abstract of no more than 500 words (including references) and a short biography of no more than 200 words. 

Submission is via Easy Chair at https://easychair.org/conferences/?conf=ea2021 where you will be prompted to set up a free Easy Chair account. 

In the field ‘Title and Abstract’ please enter the text for both your abstract and your bio. Do not submit a web link instead of a bio. This information can also be attached as a PDF document.

List of Topics

Suggested topics include:

Hearing Colour Seeing Sound
Can music become visual? How did pioneers of visual music such as Oskar Fischinger and Mary Ellen Bute translate melody, harmony and rhythm into the form of animation? And can moving drawings become music? How can historic and / or contemporary practice demonstrate synaesthetic syntax?

In front of your eyes and ears 
With a perceived disparity between the slow time taken to create animation and the instant time taken to perform music, how can animation be performed live? Can the audio and the visual be combined in improvised performance? How can live, hand scribing or music notation or coding or drawing be used to conjure spontaneous audio-visual performance? What is gained from real-time, instant creation in the present moment? What does it mean for ‘liveness’ to experience this at home through a screen rather than being fully present at the event?

Rhythmanalysis
Repetition and difference is at the heart of rhythm, at the heart of the algorithm, at the heart of animation, at the heart of lived experience. Rhythm is everywhere. From the natural – visceral, internal rhythms of the body breathing and the heart pumping or the slow changing of the seasons; to the artificial – externally imposed rhythms ordering us through the ticktock of mechanical  clock-time or the ebb and flow of economic cycles. How does rhythm connect audio and animation? What might animation learn from audio and music theory and vice versa?

A Return to the Material
In an age of digital synthesis and screen-based connections is there a craving for a return to the material? Do we long for haptic feedback and analogue experience: the touch of guitar strings, the feel of charcoal smearing under the fingers, banging a drum, painting on film? Is this simply a form of nostalgia or might it be thought through in new ways? How can it be brought together in the audio-visual?

Organising Committee

The symposium is jointly organised by Dr Juergen Hagler, Ars Electronica, University of Applied Sciences Upper Austria, Hagenberg and Professor Dr Birgitta Hosea, Animation Research Centre, University for the Creative Arts, Farnham, UK.

Scientific committee:

  • Professor Rose Bond, PNCA, USA
  • Dr Max Hattler, School of Creative Media, CityU, Hong Kong
  • Laura Lee, Audio Research Cluster, UCA
  • Dr Vicky Smith, Animation Research Centre, UCA 
  • Dr Harry Whalley, Audio Research Cluster, UCA

Venue

The conference will be held online as part of Ars Electronica Festival in Linz, Austria. The media festival will take place on 8th-12th of September 2021 under the motto “A New Digital Deal – How the Digital World Could Work” (https://ars.electronica.art/newdigitaldeal/en/).

Contact

All questions about submissions should be emailed to animationresearch@uca.ac.uk.

___________________________________________________________________________________

Birgitta Hosea: Inaugural Professorial Lecture

Here is ‘Expanding Animation and Other Queer Goings On’, my inaugural professorial lecture at the University for the Creative Arts in which I relate how I developed a post-medium approach to animation and much more besides.

Animate Projects: Female Figures

On Thursday 2 July at 6pm, artists Jessica Ashman, Anna Bunting-Branch, Birgitta Hosea and Michelle Kranot will present their work and discuss the opportunities and challenges of working with live performance and technology. All four work with animation in their practice and are going beyond the single screen to create immersive worlds where performance is integrated into their work. More info here: https://animateprojects.org/accelerate-sessions-female-figures


[Birgitta Hosea, Virus, (performance/installation, 1996)]

There will be a Q&A led by Animate Projects producer Abigail Addison, where you will have the opportunity to ask questions of the speakers.

Join us on Thursday, 2 July, 6-7pm, on Zoom. The event is free. As spaces are limited please register here: https://bit.ly/3dUy1g3

Festival of Digital Disruption

19th November 2019, Reading

A StoryFutures event for anyone interested in immersive storytelling. In my talk, I will be reflecting on the spatial experience of animated installation (from my chapter in the Experimental and Expanded Animation book) and comparing that with examples of contemporary Virtual Reality artworks.

Click here to register: https://www.eventbrite.co.uk/e/festival-of-digital-disruption-the-future-of-storytelling-a-mixed-reality-tickets-75578149279

Judging Prix Ars Electronica (Computer Animation) 2019

Here is the text of a presentation I gave at the Expanded Animation symposium about the judging process for the Computer Animation category at Prix Ars Electronica this year.

Initial discussions

Introducing the jury

I’m here on behalf of the 2019 Prix Ars Electronica Computer Animation jury – Ferdi Alici, Ina Conradi, Nobuaki Doi, Birgitta Hosea, Alex Verhaest.

We come from Turkey, Singapore, Japan, UK and Belgium. Our joint expertise ranges from artist, animator, curator to animation theorist and most of us are involved in a mixture of all of those activities.

I thought I’d start off by talking about how the judging process works. It was actually very difficult.

The judging process

There were (I believe) 828 entries in the Computer Animation category this year including 5 nominations by each of the jury members. The type of work varied enormously from very slick CGI productions by professional top-end agencies to less polished works from students and emerging artists. It was thrilling to watch the variety on offer and we really felt like we were getting a snapshot of what is cutting edge in computer animation in 2019.

The process of selection takes several stages. Before the judging starts in Linz, each juror watches films at home in order to get familiar with the entries. After the initial preselection, there are three full days of further discussion and voting by the jury. The idea is to first narrow down the entries under consideration and then to select the final fifteen. Sometimes there was a consensus of opinions while we were doing this and we were in total agreement and at other times we had quite heated disagreements. When this happened, decisions were taken by majority vote. At all times, the jury was very mindful of the impact and exposure that winning an award can have on the recipient’s profile and future career. It could change someone’s life. Because of this, we tried to recognise independent artists and small studios over major industry players.

48691631363_6e076cbe4c_o

Coming up with judging criteria

At all times we felt a very strong sense of responsibility about who would be chosen and why. We wanted to be very fair. Although you could argue that all animation, however it is made, is computer animation these days, we particularly wanted to make a strong statement about what we thought the Computer Animation category at Ars Electronica in its 40th anniversary should represent. We realised that computer animation encompasses many different forms. It is no longer simply a category for short films. It can be installation, It can be VR, AR, MR. It might be sculpture. it might be on the web. It might be software or a game or a visualisation of data.

We mainly watched the entries on screen, but we also spent time experiencing immersive works from inside VR headsets. Since computer animation can take so many different forms, we were very concerned that our selection would represent the variety of different approaches that animation can take.  That was something we talked about a lot. We thought a lot about how people are playing games, how people are communicating through animation, how animation can visualise ecological issues, gender issues, all kind of different social and political themes.  And how this can be communicated to the viewer.

In our judgements we really wanted to reward works that weren’t just dealing with aesthetics or form, or clever new techniques. We wanted to see ideas, thinking and investigation, so we selected works that demonstrated individual authorship, independence of vision and thoughtfulness. Even more than technical prowess, we valued meaning, daring and emotional risk.

We had to make some very difficult choices. For example, there were some very accomplished traditionally made animations that we rated highly as animated films, but we did not think they fitted a category called ‘Computer Animation’. There were some technically brilliant examples of animation techniques that we greatly admired, but lacked content and we just did not feel moved by. And there were also examples of very innovative and engaging cutting edge short films that we just could not consider as being examples of animation.

Trends we saw this year

As I said earlier, seeing the range of selections is like watching a software fashion show. Technical trends that we observed included processes such as algorithmic generation; point clouds that present a machine view of the world; artful photographic manipulation with Touch Designer; impossible Octane objects that show cartoon reality in CGI rather than the known laws of the physical universe; stylish graphic combinations of 3d mo-cap and 2D rendering; machinima animations that use existing game engines and various inventive methods to render live data. Common themes in terms of content that emerged from the works included personal issues – such as gender, sexuality, relationships, social inclusion, body image and mental health – as well as wider social and geo-political issues – such as migration, the impact of mass communication networks, ecological devastation and impending extinction.

The VR entries become more sophisticated year upon year. We noted how this year’s entries really play with point of view, misdirection, voyeurism and empathy to enhance storytelling and emotional affect. In addition, some of the entries played particular attention to the viewers experience in the world outside the headset by creating sensory experiences in the physical environments in which the VR was encountered that complemented the effect of the work.

Further thoughts/conclusion

Before introducing you to the winner and the two special mentions, I just wanted to end on a few concluding thoughts:

As animators we can conjure powerful visions through our fingertips and we must take responsibility for the messages we portray. We should be careful to avoid becoming totally absorbed by the technology and to remember that we are communicating ideas to an audience, not just showcasing the latest clever techniques. As a jury, we hope to continue to see animation that does more than technically innovate, but has the vision and bravery to engage with the complexity of topical issues in contemporary society and the sensitivity to portray intimate, personal, human experience.

EA_2019-01Juergen Hagler presents the Expanded Animation book.

Golden Nica

Kalina Bertin, Sandra Rodriguez, Nicolas S. Roy, Fred Casia (CA): MANIC VR

EA_2019-02EA_2019-0348691695188_8fd8755b09_o

Mental illness is too often a shameful and misunderstood topic that people do not want to talk about in public. It can be hard to understand if you have not personally experienced it. Although we were not without cynicism for the cliché of VR as an empathy machine, as several jury members had personal knowledge of friends or family with a bipolar disorder, we found it moving to be taken through the experiences of the filmmaker’s brother and sister and to hear them talk about it through first-hand accounts left as messages on her voicemail. Scenarios such as being trapped in a small room and then flying through the ceiling to touch the stars served as a metaphor for the rush of mania after a depressive episode. Above all, we applauded the work’s ambition to use expanded animation technology to seek understanding for a debilitating condition.

Awards of Distinction

Ruini Shi (CN): Strings

EA_2019-04EA_2019-0548691971801_dd129e6b2b_o48691631598_f6d9834bd0_o

With a clever script that mixes chat messaging with programming language in a nostalgic retro gaming aesthetic, Strings addresses online gaming and the loneliness of remote communication. Chasing ghostly algorithms within a discarded game, the narrator searches through data banks for traces of a lost cyber, femme fatale who has once caressed him pixel by pixel, but can no longer be found. The jury was enamoured with the highly poetic treatment of this story of lost love and the loneliness of social media. They also found the idea of a lost world of forgotten games to be moving and thought provoking.

Cindy Coutant (FR): Undershoot, sensitive data: Cristiano

48692031761_2f10e9c621_o48692031646_e7399061b0_oEA_2019-06

Inspired by her love for the famous soccer player Renaldo, in this installation the artist Cindy Coutant has created a virtual character with whom she can have a deep personal relationship. Undershoot pays tribute to the deeply personal need to connect through all of the senses – sound, touch, and smell – with the image on the screen and real person. The animation is emotionally charged and enhanced by the physical installation.  The jury was moved by the honesty of the piece. Undershoot provokes the social, cultural, and ethical standards of the current technology, screen-based and social media infatuation. We are in constant communication with everything around us through machines. As such, it is a tribute to lost emotional connection, intimacy, and materiality.