Fusing Semantic and Audio Technologies for Intelligent Music Production and Consumption

Lead Research Organisation: Queen Mary, University of London
Department Name: Sch of Electronic Eng & Computer Science

Abstract

Music is probably the most pervasive of the performing arts, and perhaps, the most abused (think of your recent shopping trips!). It has tremendous power to influence our emotions, often subliminally. The advent of recording in the 19th Century made it possible to enjoy music at a time, and in a place, different from the performance. Compression, broadband and the ever increasing capacity to aggregate large collections mean that the issues confronting music consumers have totally changed in nature: equally so for professionals, such as broadcasters (playlists for radio, music for documentaries, etc.) and those at the creative heart of the process: musicians, sound engineers and producers. The recorded music industry has grappled unsuccessfully with digital technology and the rate of adoption of new technologies has been slow, ironically, mostly in fear of piracy and loss of revenue. Given the social and economic importance of music, it is vital that the industry's crisis is averted and its decline reversed. Simple semantics and metadata are already helping (for example in recommendation and sharing services) but this is just the beginning. The next generation semantic technologies that are the focus of this proposal have the power to exact the turnaround that music (and other content industries) needs but this should be established via a fundamental and principled exploration of how semantic technologies underpin music throughout the value chain.

The proposal brings the very latest technologies to bear on the complete industry, end-to-end, producer to consumer, making the production process more fruitful, the consumption process more engaging, and the delivery and intermediation more automated and robust. In this project we will address 3 premises: (i) that Semantic Web technologies should be deployed throughout the content value chain from producer to consumer; (ii) that advanced signal processing should be employed in the content production phases to extract "pure" features of perceptual significance and represent these in standard vocabularies; (iii) that this combination of semantic technologies and content-derived metadata leads to advantages (and new products and services) at many points in the value chain, from recording studio to end-user (listener) devices and applications.

The project will work with partners from industry - BBC R&D, Microsoft Research Cambridge and Omnifone) as well as internationally - the International Audio Labs, a joint initiative of the Fraunhofer Institute in Erlangan and the local university, and the Internet Archive, one of the world's major on-line libraries. We will engage with other universities in the UK supported by a partnership fund and via the BBC Audio Research Partnership.

This long term project will foster new ways for professionals to work with music in the studio and for consumers to engage in their homes. It will support new business models that emphasise the whole experience of musical involvement, and discover ways to monetise the metadata as well as the essential content. The technologies to be researched support new ways of learning (about and to play) music as well as new ways of teaching and performing. And because the project will encompass vast quantities of music data and metadata, from heterogeneous sources, and will stress test emerging principles of big data, distributed intelligence and future generation web, it also addresses key questions of wide significance to EPSRC's ICT Programme, particularly relating to Intelligent Information Systems and Working Together.

Planned Impact

By employing a 0.5 fte Outreach and Impact Officer (OIO), we expect to deliver significant impact throughout the project, by making impact part of the process from the start, rather than added in as an afterthought. Working closely with all the investigators, researchers and the programme manager, the OIO will help us capitalise on our industrial partnerships to develop specialised marketing, publicity and media strategies.

The project will deliver impact to academic beneficiaries in conventional ways, including papers in both journals and conferences, but will enhance this with more focussed provision in the form of special sessions, workshops and tutorials at selected important conferences including AES, ACM SIGGRAPH, CHI & Multimedia, and many others.

Because media/content metadata is vital to the broadcast industry, we will continue to engage with the MPEG and EBU standardisation processes, as well as that of AES. Partners at Oxford are able to promote potential standards within W3C. This industrial engagement and impact is enhanced through our partners, BBC, Microsoft and Omnifone and, in turn, their partners reaching deep into the music industry eco-system. For industry we will also offer online training materials (free) and specialist on-site courses (charged) and we will organise concerts highlighting live use of semantic technologies.

We will provide Open Source software including building on the successful VAMP, Sonic Visualiser and Sonic Annotator products from Queen Mary, and the SoundSoftware project, that offers open code repositories as well as advice and training. Also with the assistance of the SoundSofware project, we will promote best practice in reproducible research. We will continue to enhance the Music Ontology, and its family of ontologies all of which are offered under Creative Commons licenses, and to grow the offering of Open Linked Data hosted from our servers, including dbTune and others that have been provided since the early days of the Semantic Web.

Other avenues for outreach include to schools, via cs4fn, audio! (two paper & online magazine offerings from QML) and TeenTech, an organisation coordinated by Maggie Philbin for STEM outreach into schools with which QML has undertaken several successful activities. It is highly likely that spin-outs will arise from this project, supported by the 3 universities' technology transfer teams.
 
Title Ada Lovelace "Numbers into Notes" (Team: Oxford) 
Description "Ada Lovelace Numbers Into Notes" is an exercise in digital content capture and repurposing through a series of performances, as a case study in workflow and Digital Music Objects. It was conducted in collaboration with the AHRC Transforming Musicology project. The events were a performance of "Ada Sketches" by composer Emily Howard at the Science Museum, which was then performed in the Mathematical Institute in Oxford and captured together with audience data and front of house materials; this was then presented at the Ada Lovelace Symposium together additionally with music generated by a simulator of the Analytical Engine, and the combined efforts presented at the Digital Music Research network (December 2015) and the Centre for Digital Scholarship at the Bodleian Library (January 2016). The demonstration software is publicly available online. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2015 
Impact The event allowed for a number of engagement activities with both musicians and the general public to take place. It also led to the the generation of a variety of digital content that can be used to further develop the research and put similar events together in the future. 
URL https://dl.dropboxusercontent.com/u/15772302/NumbersIntoNotes/index.html
 
Title Collaboration with guitarist Patrick Shaw: Artcodes 
Description Working with Patrick Shaw, a very active guitarist and performer, enabled the FAST IMPACt Nottingham team to have some insight into how the Artcodes technology and the concept of Accountable Artefacts are understood by a practicing musician. Part of Patrick Shaw's rationale for having scannable Artcodes embedded into his guitar was so that he could promote broader awareness and discussion around this work with the musicians he plays with in the future. 
Type Of Art Artefact (including digital) 
Year Produced 2016 
Impact The adoption of the accountable artefacts concept by a performance practioner. 
URL https://carolanguitar.com/
 
Title MELD supports "Climb!" virtuoso piano piece (see description also under "collaborations and partnerships) 
Description Performance integrator (Climb!) is a collaboration between David Weigl, Kevin Page (Oxford), Adrian Hazzard, Chris Greenhalgh, Steve Benford (Nottingham) and Maria Kallionpää (visiting scholar at Nottingham). The collaboration supports the performance of Climb!, a gamified piece for virtuoso pianists composed by Maria. The collaboration involves the technical integration of the MELD dynamic semantic notation system developed at Oxford with Muzicodes, a music pattern recognition and interaction system developed at Nottingham. 
Type Of Art Composition/Score 
Year Produced 2016 
Impact The collaboration is still active; the ongoing composition of the piece interacting with ongoing technical developments. The collaborators have submitted a paper and performance notes for the project to NIME 2017, and further outputs are planned for the future, both in terms of submissions to academic conferences, and in performances of the piece. The collaboration is multi-disciplinary, drawing on aspects of music composition, music performance, audio engineering, computer science, and web science. 
 
Title Muzicodes: composing and performing musical codes (in progress) 
Description The project's goal is the development of a browser based system that enable composers and musicians to identify and perform musical phrases that acts as codes to trigger media interactions within their performance practice, such as: instance lighting cues, visuals, backing tracks, samples etc. Alongside development of this technical system, the research project aims to capture a deep understanding of the issues at play when using this system. Development (on-going) of a contemporary composition intended for performance in international concert halls. 
Type Of Art Composition/Score 
Year Produced 2016 
Impact Not applicable at this time. The project is ongoing. The completed composition, as supported by the developing Muzicodes and MELD technologies, intends for a series of high profile international performances. These include seeking out concert hall venues and performances connected to research engagements such as conferences and workshops. 
 
Title Open Symphony (Team: QMUL) 
Description Western performing arts practices have traditionally restricted audience interaction with performers. What if this were revisited - not to replace - but to create novel types of musical experiences? Open Symphony reimagines the music experience for a digital age, fostering alliances between performer and audience and our digital selves. The project investigates how to embrace digital technology in the live music environment to engage both audience and performers and develop new platforms for music composition, performance and listening.Open Symphony is an immersive performance system which explores the creativity and spontaneity of reactive interactions through an ensemble of performers and an audience using mobile technology and data visualisation. Open Symphony performances will be held at the workshop 'A Mind of Music' (March 2016, QMUL) and at the International conference on Computer Human Interaction (May 2016, USA). 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2015 
Impact The Open Symphony project has been selected as one of six UK projects to join the Sound and Music organization's Audience Labs programme funded by Arts Council England", which is an audience development programme designed to test new ways of communicating and presenting new music to audiences. 
URL http://isophonics.net/content/opensymphony
 
Title Performance at the Mad Scientist festival in Bern, Switzerland, 9. September 2016 
Description Performance at the Mad Scientist festival in Bern, Switzerland, 9. September 2016, with acoustic musicians, using Audio Dream, a web-based performance software that uses clustering algorithms and recurrent neural networks to reorganize recorded audio from the performers. https://github.com/florianthalmann/audio-dream 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2016 
Impact Not known. 
URL https://github.com/florianthalmann/audio-dream
 
Title The B076 audio experience 
Description This is part of the FAST IMPACt research collaboration between Nottingham and Queen Mary that has pushed forward the ongoing development of the Semantic Player. The Nottingham and Queen Mary partners worked to extend and hone the existing functionality of the Semantic Player to enable the development, authoring and deployment of the B076 experience, which used iBeacons for indoor positioning. The B076 audio experience engaged with 12 members of the public who signed up to take part. They were recruited via the Primary Arts Space and distributed flyers. It was hosted in the Primary Arts Space, Nottingham. It was an indoor interactive installation where visitors walked around an empty exhibition space. iBeacons were distributed around the room which tracked the proximity of visitors, thus determining their location in the room. Their position triggered playback of different audio streams which culminate in a continuous soundscape narrative. 
Type Of Art Artistic/Creative Exhibition 
Year Produced 2016 
Impact The most significant outcome from this creative project was extending the sensor functionality of the Semantic Player. 
 
Title The Carolan Guitar (Team: Nottingham) 
Description The Carolan guitar is an augmented acoustic guitar that has been constructed and deployed as a technology probe to explore the broad nature of and potential uses for the digital record of a music instrument. Carolan is an unusual instrument in that its digital record can be inspected by scanning its decorative inlay using a mobile phone. The guitar is called Carolan in honour of the legendary composer Turlough O'Carolan, the last of the great blind Irish harpers, and an itinerant musician who roamed Ireland at the turn of the 18th century, composing and playing beautiful celtic tunes. Like it's namesake, Carolan is a roving bard; a performer that passes from place to place, learning tunes, songs and stories as it goes and sharing them with the people it encounters along the way. This is possible because of a unique technology that hides digital codes within the decorative patterns adorning the instrument. These act somewhat like QR codes in that you can point a phone or tablet at them in order to read their codes (see below) which in turn accesses information on the Internet. Unlike QR codes, however, they are aesthetically beautiful and form a natural part of instrument's decoration. Scanning the different patterns on the Carolan guitar takes you to different information such as the history of how it was made, details of who has played it, videos of their performances and also the instrument's user guide and full technical specification. As a result, this unusual and new technology enables the Carolan guitar to share a growing 'digital footprint' throughout its lifetime, but in a way that resonates with both the aesthetic of an acoustic guitar and the craft of traditional luthiery. 
Type Of Art Artefact (including digital) 
Year Produced 2015 
Impact The FAST Nottingham team have documented over forty encounters with players in homes, studios, gigs, workshops and lessons (see www.carolanguitar.com). 
URL http://www.carolanguitar.com
 
Title The Rough Mile audio experience 
Description The Rough Mile experience engaged with 22 members of the public, who signed up to take part. They were recruited via Rough Trade records, posters and flyers distributed around Nottingham City. It consisted of two locative audio walks that took place on different days, for paris of friends to come and experience together. The first walk was a pre-defined narrative performance that in part captured information from the friends about music tracks choices they would like to gift to each other. The second walk then consisted of this gifted experience, where they listened to these music tracks as between pairs of friends. The experience was a research exercise, but also a standalone 'artistic engagement' in its own right. 
Type Of Art Artefact (including digital) 
Year Produced 2016 
Impact Anecdotal evidence was captured from participants discussing their enjoyment and subsequent desire to seek out and engage with other similar experiences. Successful deployment of a detailed locative audio experience with a universally positive reception was noted. 
 
Description Preliminary results are becoming of interest to parts of the recorded music industry. Musician Imogen Heap's mycelia project seeks to wrest value back from the major music labels and return it to the musicians. This is coupled with a vision of enhanced recorded music products and services for the music consumer. The programme grant's technologies provide a really good fit to these aims. At the recent meeting of mycelia, Sandler presented FAST and this led to meetings with two london based companies and one still pending with an artists' representation organisation.
First Year Of Impact 2015
Sector Creative Economy
Impact Types Cultural,Societal
 
Description Horizon 2020 (H2020-ICT-2015)
Amount € 676,850 (EUR)
Funding ID Proposal number 688382 
Organisation European Commission (EC) 
Sector Public
Country European Union (EU)
Start 02/2016 
End 01/2019
 
Description The Royal Society Wolfson Research Merit Award
Amount £25,000 (GBP)
Funding ID to be confirmed. 
Organisation The Royal Society 
Sector Academic/University
Country United Kingdom of Great Britain & Northern Ireland (UK)
Start 03/2015 
End 03/2020
 
Title Grateful Dead project 
Description New ontological model for the representation of aligned recorded fragments of the same performance, based on the music ontology and timeline ontology. Other ontologies fail to describe different recordings of the same event in comparably detailed ways. -Computer model/ algorithm -used internally, yet unpublished 
Type Of Material Computer model/algorithm 
Provided To Others? No  
Impact N/A 
 
Title ILM10K dataset 
Description ILM10K dataset is a mood annotated music dataset of 10,000 tracks using the method developed in Pasi Saari, György Fazekas, Tuomas Eerola, Mathieu Barthet, Olivier Lartillot, Mark B. Sandler: (2016) Genre-Adaptive Semantic Computing and Audio-Based Modelling for Music Mood Annotation. IEEE Trans. Affective Computing 7(2): 122-135 (2016) 
Type Of Material Database/Collection of data 
Year Produced 2016 
Provided To Others? Yes  
Impact Not applicable at this time. 
URL https://www.computer.org/csdl/trans/ta/2016/02/07173419-abs.html
 
Title Multitrack Testbed (Team: QMUL) 
Description The goal of this project is to populate the recently developed Open Multitrack Testbed (multitrack.eecs.qmul.ac.uk), an online platform for storing, searching and browsing multitrack audio and mixtures thereof. It is a resource intended for but not limited to users such as researchers in MIR and intelligent music production, as well as sound engineering students and audio software developers. The researchers' aim is to realise the testbed's potential impact by including the most popular multitrack datasets around, complemented with extensive metadata. The idea of publishing a multi-track database has been raised several times and a few prior attempts have been made within the Queen Mary researchers' group. The project is led by Brecht De Man, who collected audio files for a number of multi-track recordings. György Fazekas (FAST IMPACt) advised on semantic technologies, having developed the Studio Ontology Framework which is being used in the testbed. Mariano Mora-Mcginity (also a FAST IMPACt team member) finished developing the testbed (barring solving any issues that may arise during the annotation) to a state in which it 1. shows all content for the user to browse through; 2. has a search interface to search and filter using any of the metadata fields; 3. allows an authorised user (password protected with customisable permission) to enter new metadata associated with audio on the testbed server (c4dm.eecs.qmul.ac.uk/ multitrack) or elsewhere on the web. The C4DM team has annotated over 600 multitracks have been annotated, comprising over 3000 individual tracks. Full details have been maintained about the instrumentation, genre, recording process, artifacts, attribution.... This is a sufficient number for this data to now be used in machine learning and data mining applications. It is contributing to research on music mixing practices and multitrack audio processing. 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Several researchers have referenced the testbed in their papers since its inception, and it was well received during a session on multitrack audio datasets of the Unconference at 15th Conference of the International Society for Music Information Retrieval in Taipei, Taiwan, November 2014. Furthermore, within C4DM the local multitrack repository is extensively used for research, but as the licenses are not open - or unclear - disseminating data and results is less than straightforward. This is especially a problem when funding bodies, journals or conferences require open data for sustainability and reproducibility purposes. The research team is positive that this resource, the first of its kind, has the potential of becoming the main resource for any researcher, student or developer who needs multitrack audio and mixtures thereof, provided it has the critical mass to become appealing as a go-to platform. It is evident that there is already a strong support base for this idea, and already extensive usage of the still limited dataset. Multitrack audio is a valuable resource for a wide range of audio professionals, educators, students, developers, and researchers. Many of these communities are not that aware of C4DM and its activities. Notably, this project is expected to have significant impact with music technology students and educators, who will use the content in learning and teaching music production skills. R&D areas in which large and diverse sets of high quality, multi-stream audio are essential in music information retrieval (MIR) research, development of improved music production tools, and tasks like audio source separation, audio segmentation and research in auditory perception. 
URL http://multitrack.eecs.qmul.ac.uk
 
Title Musical Mood Dataset 
Description Musical Mood Dataset: a Semantic Web dataset combining publication metadata of over 10,000 commercial tracks with crowd-sourced mood tags and arousal-valence coordinates. The musical mood dataset is a linked data verison of the ILM10K dataset that consists of samples from 10,199 commercial tracks from iLikeMusic1 (ILM). It combines audio recordings used in the Moodplay interactive experience with track metadata derived from MusicBrainz music encyclopedia and social tag data collected from Last.fm. The collection includes tracks from over 5,600 unique artists. The database also includes automatically annotated arousal and valence mood ratings for each track using the Affective Circumplex Transformation (ACT). This method ensures that coordinates obtained by applying Multi-dimensional Scaling (MDS) to crowd-sourced tags conform to locations of mood adjectives validated in human Psychological experiments. (See: P. Saari, G. Fazekas, et al.: Genre-Adaptive Semantic Computing and Audio-Based Modelling for Music Mood Annotation. IEEE Trans. Affective Computing 7(2): 122-135, 2016) 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Not applicable at this time. 
 
Title The Semantic Audio Feature Extraction Dataset SAFE-DB 
Description The Semantic Audio Feature Extraction Dataset (SAFE-DB) is a continually updating database of semantically annotated music production metadata, taken from an international user group of sound engineers. The data is taken from 4 audio effects: a dynamic range compressor, an overdrive distortion, a parametric equaliser and an algorithmic reverb. 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Not applicable at this time. 
URL http://www.semanticaudio.co.uk/datasets/data/
 
Description Audio Feature Ontology (ongoing) 
Organisation Pompeu Fabra University
Department Music Technology Group
Country Spain, Kingdom of 
Sector Academic/University 
PI Contribution There is an ongoing collaboration with the Music Technology Group (MTG), UPF, Barcelona, Spain, to enhance the message response format of the AcousticBrainz project. AcousticBrainz hosts crowed-sourced acoustic features for research and retrieval purposes. The collaboration aims to facilitate the inclusion of a Linked-Data mechanism into AcousticBrainz so the data provided may be used in the context of the Semantic Web.
Collaborator Contribution There is an ongoing collaboration with the Music Technology Group (MTG), UPF, Barcelona, Spain, to enhance the message response format of the AcousticBrainz project. AcousticBrainz hosts crowed-sourced acoustic features for research and retrieval purposes. The collaboration aims to facilitate the inclusion of a Linked-Data mechanism into AcousticBrainz so the data provided may be used in the context of the Semantic Web.
Impact Prior work related to this activity has led to European Funding (H2020): Audio Commons (grant no 688382, running between 2016-2019) to build an ecosystem that supports the reuse of Creative Commons licensed audio content in the creative industries. The project includes work that uses the ontology developed by this activity.
Start Year 2015
 
Description CALMA (Computational Analysis of the Live Music Archive) 
Organisation Internet Archive
Country United States of America 
Sector Charity/Non Profit 
PI Contribution This is a collaboration between QMUL, U. of Manchester, Oxford, and the Internet Archive. Built data analysis framework using Vamp audio analysis plugins. Designed ontology to describe provenance of data processing. Built and published CALMA dataset containing audio features extracted from live sound recordings.
Collaborator Contribution Oxford contributed to ontology design and built data analytics framework in R and analysed key typicality over a large collection of recordings. IA provided access to Live Music Archive audio and metadata, Manchester contributed to publishing analysis and provenance data as linked data.
Impact Publications (there are reported under the FAST Publications Outcome), published datasets on the Semantic Web, completed data analysis. The project is multi-disciplinary involving, computer science, digital signal processing and musicology.
Start Year 2016
 
Description CALMA (Computational Analysis of the Live Music Archive) 
Organisation University of Manchester
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Academic/University 
PI Contribution This is a collaboration between QMUL, U. of Manchester, Oxford, and the Internet Archive. Built data analysis framework using Vamp audio analysis plugins. Designed ontology to describe provenance of data processing. Built and published CALMA dataset containing audio features extracted from live sound recordings.
Collaborator Contribution Oxford contributed to ontology design and built data analytics framework in R and analysed key typicality over a large collection of recordings. IA provided access to Live Music Archive audio and metadata, Manchester contributed to publishing analysis and provenance data as linked data.
Impact Publications (there are reported under the FAST Publications Outcome), published datasets on the Semantic Web, completed data analysis. The project is multi-disciplinary involving, computer science, digital signal processing and musicology.
Start Year 2016
 
Description CALMA (Computational Analysis of the Live Music Archive) 
Organisation University of Oxford
Department Department of Biochemistrty
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Academic/University 
PI Contribution This is a collaboration between QMUL, U. of Manchester, Oxford, and the Internet Archive. Built data analysis framework using Vamp audio analysis plugins. Designed ontology to describe provenance of data processing. Built and published CALMA dataset containing audio features extracted from live sound recordings.
Collaborator Contribution Oxford contributed to ontology design and built data analytics framework in R and analysed key typicality over a large collection of recordings. IA provided access to Live Music Archive audio and metadata, Manchester contributed to publishing analysis and provenance data as linked data.
Impact Publications (there are reported under the FAST Publications Outcome), published datasets on the Semantic Web, completed data analysis. The project is multi-disciplinary involving, computer science, digital signal processing and musicology.
Start Year 2016
 
Description Collaboration with BBC R&D with EP/L019981/1 
Organisation British Broadcasting Corporation (BBC)
Department BBC Research & Development
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Public 
PI Contribution BBC R&D is a partner on EP/L019981/1. Lead participant, Dr Frank Melchior attends our 6 monthly major meetings and guides lines of research within the project while we assist in their research around IP in the studio.
Collaborator Contribution BBC R&D is a partner on EP/L019981/1. Lead participant, Dr Frank Melchior attends our 6 monthly major meetings and guides lines of research within the project while we assist in their research around IP in the studio. Dr Melchior contributed to the writing of the proposal, especially at the early formation stages. Some principles they have been adopting within their technological development have been adopted within the project.
Impact To be completed.
Start Year 2014
 
Description Collaboration with Internet Archive: Exploration Tool for Grateful Dead Live Performances 
Organisation Internet Archive
Country United States of America 
Sector Charity/Non Profit 
PI Contribution 1. production of low-level and high-level audio feature data of the complete Grateful Dead collection of the Live Music Archive; 2. development of tools for the aggregation and analysis of topic-related information from a variety of sources on the conventional Web. This information can be in text, image, or video form; 3. development of a suitable data model for the representation of the data (including the audio feature data) on the Semantic Web; 4. Development of a Web App using the aforementioned data with a suitable GUI and data visualisation.
Collaborator Contribution 1. access to the audio material of the archive - this includes non-public lossless audio material, that is otherwise only available in streaming lossy format; 2. a virtual machine located at the Internet Archive for the processing of non-public audio material which should not be copied to outside servers.
Impact A Web application specifically developed for the exploration of Grateful Dead concerts will be the outcome. The project aims to demonstrate how Semantic Audio and Linked Data technologies can produce an improved user experience for browsing and exploring music collections. It is motivated by the ongoing interest in detailed descriptions of Grateful Dead performances, evidenced by the large amount of information available on the Web detailing various aspects of those events. The application links the large number of concert recordings by the Grateful Dead available in the Internet Archive with audio analysis data and retrieves additional information and artefacts (e.g. band lineup, photos, scans of tickets and posters, reviews) from existing Web sources, to explore and visualise the collection. Conversations with Bob George from the Archive of Contemporary Music (ARC) and Brewster Kahle from the Internet Archive have taken place. Both Bob George and Brewster Kahle are quite interested in this project. Bob George might be able to provide us with additional resources from archives about the Grateful Dead.
Start Year 2015
 
Description Collaboration with Omnifone 
Organisation Omnifone
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Private 
PI Contribution Omnifone have installed QMUL audio feature extraction software into their audio signal processing workflow. They use our Sonic Annotator with VAMP plugins to extract features from the audio to assist with providing APIs to let third party companies create new music services. This is covered in an agreement. The company will provide QMUL with these features, which we will publish on the semantic web via SPARQL query point. This will enable researchers around the world, but especially at QMUL to do research on Big Music Data and Metadata.
Collaborator Contribution see above
Impact To be completed.
Start Year 2015
 
Description Collaboration with SSL 
Organisation Solid State Logic
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Private 
PI Contribution Innovate UK application, pending. Sponsoring two EPSRC CASE students to be appointed.
Collaborator Contribution Innovate UK application, pending. Sponsoring two EPSRC CASE students to be appointed.
Impact none to date, other than the innovate uk grant proposal and 2 CASE studentship agreements.
Start Year 2015
 
Description Collaboration with SUSTRANS: Musically accompanied walking experiences to motivate behaviour change in commuters 
Organisation Sustrans
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Charity/Non Profit 
PI Contribution Following initial discussions with Sustrans the research team at the MRL devised and undertook a mobile musically accompanied walking study. This prelimanary activity intends to inform and drive forward a larger scale research activity with Sustrans.
Collaborator Contribution To date Sustains have engaged in a series of preliminary discussions and a design workshop focused on devising a collaborative project around adaptive musical walking experiences to promote behaviour change in commuters who currently use car and public transport. Currently in stasis due to changes in Sustains staff, I.e., the primary contact has left their post. Some Sustains staff participated in the musically accompanied walking study listed above.
Impact There are as yet no formalised outcomes. The proposed project is interdisciplinary in nature (HCI, music theory, music production).
Start Year 2015
 
Description Collaboration with Tracy Readhead: prototype of a dynamic song app based on the Semantic Player Framework (in progress) 
Organisation University of Newcastle Australia
Country Australia, Commonwealth of 
Sector Academic/University 
PI Contribution -Further development of the Semantic Player Framework to suit the ideas emerged from the collaboration (performance optimization) -implementation of an algorithm that automatically generates the dynamic music objects and mappings necessary for the experience -packaging the experience as an app for android
Collaborator Contribution -Composition and compilation of the audio material -design of the sensor mappings -Testing the app at various stages of iteration
Impact -Prototype of the app -Paper about the composition process submitted to NIME 2017
Start Year 2016
 
Description Collaboration with the B3 Media TalentLab programme (Mixed Reality Lab, Nottingham) 
Organisation B3 Media
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Private 
PI Contribution The B3 Media partnership with Mixed Reality Lab, Nottingham, is now in its third year. The Mixed Reality Lab provide residency opportunities for establishing artists and practitioners to develop and realise project ideas. A number of participants have gone through this programme, the three stated here represent those who have worked within the FAST remit of audio/music: 1. Richard Ramchurn (2014/5) 2. Grant Smith (2016) 3. Lula Mebrahtu (2017) The following contributions are being offered by the MRL team: 1. Mentoring: Talent Lab participants are paired with MRL researchers who can offer advice and collaborative engagement with the participants area of interested. 2. Workshop and Lab space: as part of the residency, the MRL provides space and resources to support realisation of participant's project. 3. Technical support: Many of these participants are engaging with new novel technologies, the MRL provides access and expertise with these. Post programme support and opportunities: if appropriate for all parties, the MRL is open to further engagement with a Talent Lab artists.
Collaborator Contribution The B3 Media Talent Lab artists enable the MRL researchers to engage and collaborate with working practitioners. This in turn provides opportunities to situate, test out and extend existing research into the field, thus providing a deeper understanding of the implications of our research.
Impact Richard Ramchurn's successful Talent Lab residency concluded with him being offered a PhD studentship on the University of Nottingham's Centre for Doctoral Training, where he is placed in the Mixed Reality Lab. Grant Smith completed his Talent Lab residency and in doing so made new relationships with a range of other practitioners: for example Rachel Jacobs working in the field of streaming and performing data; Anthony Brown, who assisted in the development of solutions for networking remote microphones; and Alan Chamberlain and Patrick Brundell who have engaged with Grants deployable environmental microphones.
Start Year 2015
 
Description Locative Audio Experiences: The Rough Mile & B076 
Organisation Rough Trade Records
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Private 
PI Contribution Main research questions: to explore interactive (locative) audio experiences, to inform the requirements and subsequent developments of bespoke software for such experiences, and capture a deep understanding of the nature of them. The FAST IMPACT Nottingham team at the Mixed Reality Lab (MRL) supported Jocelyn Spence in designing and realising 'The Rough Mile' and B076 experiences. Specifically, this included the ongoing development and authoring of a bespoke software tool for interactive locative audio experiences entitled the DaoPlayer, which was used for 'The Rough Mile', and the collaboration with Florian Thalmann in extending the Semantic Player used for the B076 experience. The MRL provided complementary skills and experience in staging and studying the deployment of such experiences, alongside other resources and infrastructures required to support the process. The B076 experience is a collaboration and partnership with FAST IMPACt member, Florian Thalmann, C4DM, Queen Mary University of London and Jocelyn Spence. The Nottingham team worked with Florian Thalmann to extend and hone the existing functionality of the Semantic Player to enable the development, authoring and deployment of the B076 experience, which used iBeacons for indoor positioning.
Collaborator Contribution Jocelyn Spence led the design of 'The Rough Mile', a two-part locative experience for friends to engage with. The experience found participants undertaking an interactive audio narrative on the streets of Nottingham, which encouraged them to think about their friend and choose music for them to listen to in part two. Part two repeated the walk but re-authored around the music chosen in part one. Jocelyn brough a specific set of skills in designing and deploying interactive, novel performance work. This enabled her to lead the design of the Rough Mile experience. Jocelyn, also contributed to the design and development of the B076 audio experience. A second collaboration to 'The Rough Mile' project was 'Rough Trade Records', Nottingham. Rough Trade Records is a legendary independent record label that was at the epicentre of the punk explosion in 1976, who continue to champion high quality, imaginative, musically diverse and innovative independent music to this present day. Rough Trade Records hosted The Rough Mile experience (the walk commenced and finished at Rough Trade shop in Nottingham). They support the project with publicity and promotion, thus recruiting participants to undertake the experience. Florian Thalmann responded to the requirements of the B076 audio experiences as set out by the MRL team and Jocelyn Spence.
Impact The collaboration with Rough Trade Records and Jocelyn Spence was multi-disciplinary, bringing together the academic disciplines of Human Computer Interaction and Performance Studies alongside the commercial focus of Rough Trade Records. The main (hard) outcome was the realisation and deployment of the Rough Mile experience. Softer outcomes are found in the establishment of a relationship between Rough Trade Records and the Mixed Reality Lab, University of Nottingham. The collaboration with Jocelyn Spence is still active; the collaboration with Rough Trade Records ended in August 2016. The collaboration with Florian Thalmann, alongside other colleagues at Queen Mary University of London, has pushed forward the ongoing development of the Semantic Player. Parallel to this activity an ontology for Interactive Composition is being developed in collaboration, which will aims to inform and support composers working in this area with tools such as the Semantic Player and DaoPlayer.
Start Year 2016
 
Description Outgoing visiting research to New York University (K Choi) 
Organisation New York University
Department Center for Data Science
Country United States of America 
Sector Academic/University 
PI Contribution Mark Sandler, George Fazekas, and Keunwoo Choi collaborated with Kyunghyun Cho for their research. They had regular Skype meetings to discuss research details and co-write the paper submitted to the 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
Collaborator Contribution Kyunghyun Cho supervised Keunwoo Choi for deep learning knowledge and implementations. In addition, CDS provided K Choi high-performance GPU servers. His work benefited from those facilities as it involves computationally extensive experiments.
Impact The most visible outcome of this collaboration is the conference paper by K. Choi, M. Sandler, G. Fazekas and K. Cho that has been accepted to the 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). The visiting enabled Choui to collaborate closely with researchers outside Queen Mary and gain knowledge of areas other than signal processing side of music information retrieval. He mainly worked with Dr. Brian McFee and Prof. Kyunghyun Cho from the Center for Data Science (CDS), New York University. He discussed many implementation details of his work with Dr. McFee who has deep knowledge and intensive experience of MIR and Python. As a result, Choi reported he improved his programming techniques. Working with Prof. Cho and other students who are doing their research on deep learning and natural language processing deepened his understanding on deep learning in general.
Start Year 2016
 
Description Oxford Illinois Digital Libraries Placement Programme 
Organisation University of Illinois
Country United States of America 
Sector Academic/University 
PI Contribution The Oxford FAST IMPACt team hosted a student studying for their Masters in Library and Information Science at the University of Illinois.
Collaborator Contribution The student worked with the Oxford team on the SALT software in June-August 2016. The Semantic Alignment and Linking Tool (SALT) enables the creation of bridging structures supporting unified access to music datasets.
Impact Not applicable at this time.
Start Year 2016
 
Description Semantic Audio Feature Extraction (SAFE) 
Organisation University of Birmingham
Country United Kingdom of Great Britain & Northern Ireland (UK) 
Sector Academic/University 
PI Contribution This project is a collaboration between the Digital Media Technologies (DMT) lab at Birmingham City University and QMUL. Designed SAFE plugin architecture for collecting metadata in music production. Designed SAFE ontology for describing the collected data.
Collaborator Contribution Built and released SAFE plugins in various formats compatible with several digital audio workstations. Set up data collection architecture.
Impact -A set of software plug-ins deployed. -Data collected and published about the application of audio effects -Papers published about the architecture and the analysis of the collected data.
Start Year 2015
 
Title Grateful Dead project 
Description Prototype of a website that links data, music, and artifacts from concerts of the Grateful Dead, from various sources, and presents them to the user in a flexible way. Audio feature data and analytical information can be visualized in various ways and the audio from the Live Music Archive can be streamed directly on the site. 2016, not publicly released. 
Type Of Technology Software 
Year Produced 2016 
Impact Not applicable at this time. 
URL https://github.com/florianthalmann/grateful-dead
 
Title MusicWeb 
Description MusicWeb: a web platform that provides users a browsing, searching and linking platform of music artist and group information by integrating open linked semantic metadata from various Semantic Web, music recommendation and social media data sources. Artists are linked by various commonalities such as style, geographical location, instrumentation, record label as well as more obscure categories, for instance, artists who have received the same award, have shared the same fate, or belonged to the same organi- sation. These connections are further enhanced by thematic analysis of journal articles, blog posts and content-based similarity measures focussing on high level musical cate- gories. Realised in 2015/2016 
Type Of Technology Webtool/Application 
Year Produced 2016 
Impact Ongoing. 
URL http://musicweb.eecs.qmul.ac.uk
 
Title Numbers into Notes web application 
Description "Supposing, for instance, that the fundamental relations of pitched sounds in the science of harmony and of musical composition were susceptible of such expression and adaptations, the engine might compose elaborate and scientific pieces of music of any degree of complexity or extent." Ada Lovelace, 1843 The Numbers into Notes software is available on github; https://github.com/davidderoure/NumbersIntoNotes 
Type Of Technology Webtool/Application 
Year Produced 2016 
Impact The application has been used to support a variety of engagement events. 
URL http://demeter.oerc.ox.ac.uk/NumbersIntoNotes/
 
Title Semantic Player Framework 
Description Semantic Player Framework, 2015-present, ongoing development, used internally within the project, as well as in a collaboration with Birmingham and University of Newcastle, Australia, no public release yet. The Semantic Music Player is a cross-platform web and mobile app built with Ionic and the Web Audio API that explores new ways of playing back music on mobile devices, particularly indeterministic, context-dependent, and interactive ways. It is based on Dynamic Music Objects, a format that represents musical content and structure in an abstract way and makes it modifiable within definable constraints. For each Dynamic Music Object, the Semantic Music Player generates a custom graphical interface and enables appropriate user interface controls and mobile sensors based on its requirements. When the object is played back, the player takes spontaneous decisions based on the given structural information and the analytical data and reacts to sensor and user interface inputs. The Dymo Designer is a prototypical web app that allows people to create and analyze Dynamic Music Objects in a visual, interactive, and computer-assisted way. The Semantic Player framework includes a number of npm packages which can be embedded in other web-based software. https://github.com/florianthalmann/semantic-player https://github.com/florianthalmann/dymo-core https://github.com/florianthalmann/dymo-designer https://github.com/florianthalmann/music-visualization https://github.com/florianthalmann/dymo-generator https://github.com/florianthalmann/example-dymos 
Type Of Technology Webtool/Application 
Year Produced 2015 
Impact Ongoing, no impact yet. 
URL https://github.com/florianthalmann/semantic-player
 
Description Bela Workshop at STEIM, Amsterdam (F. Morreale, G. Moro, A. McPherson, A. Chamberlain) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The Bela Workshop took place on the 10th, 11th & 12th of August, 2016, STEIM, Achtergracht 19, 1017WL, Amsterdam. Participants of the workshops (academics and artists) used Bela (http://bela.io), a new embedded audio / sensor platform based on the BeagleBone Black which provides submillisecond latency between action and sound, and which replaces the need for a laptop and external microcontroller boards such as Arduino to create digital musical instruments.

The programme of the workshop included:
- a comprehensive hands-on introduction to developing with Bela;
- a number of design activities aimed at elaborating ideas and objectives when designing DMIs;
- a prototyping session where members of STEIM and C4DM will help participants port their instruments to Bela
- a test/evaluation session;
- a concluding performance or demo with the newly built instrument.

A major goal of the workshop was to make the new instrument designs from the workshop sustainable by thoroughly documenting the process of building and using the instrument. In addition to the new artefacts created in the workshop, we released documentation that allowed others in the community to replicate and modify the instruments. In addition to technical help, the organising team helped the participants document their efforts as they went along, recording short interviews as part of a research study on digital musical instrument sustainability.
Year(s) Of Engagement Activity 2016
URL http://bela.io
 
Description 2nd International Workshop on Digital Libraries for Musicology (DLfM 2015), USA 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The 2nd International Workshop on Digital Libraries for Musicology (DLfM 2015) was held on the 24th June 2015, Knoxville, TN, USA. Kevin Page from the FAST Oxford team co-chaired this workshop, held in conjunction with ACM/IEEE JCDL 2015.
Year(s) Of Engagement Activity 2015
 
Description Application of Semantic Audio Analysis to the Music Production Workflow, 139th Convention of the Audio Eng. Society 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 139th Convention of the Audio Eng. Society - Workshop: Application of Semantic Audio Analysis to the Music Production Workflow - György Fazekas (co-chair), Ryan Stables (co-chair), Jay LeBoeuf and Bryan Pardo (panelists). This was a workshop intended for audio engineers.The semantic player was demonstrated to show the potential of new music formats. Questions were raised regarding how to produce content for the format proposed. This influenced further research direction and collaborations.
Year(s) Of Engagement Activity 2015
URL http://www.aes.org/events/139/workshops/?ID=4703
 
Description BBC 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Nottingham team hosted a one day visit by a team from BBC R&D to discuss new collaborations. They have visited the BBC in February 2016 for a follow-up conversation about possible musical projects in relation to their new 'Homelab' activity.
Year(s) Of Engagement Activity 2015
 
Description Carolan guitar blog (Nottingham) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Over a period of a fifteen months the Carolan guitar engaged over 50 players, including visiting 6 homes, being played at 3 gigs, taking part in 2 recording sessions, visiting 8 clubs or jam sessions, hosting an 'open mic' event in Liverpool, residing in a shop and undertaking an international road-trip. These activities were documented in in over 50 posts on Carolan's blog www.carolanguitar.com. To date this has been
visited by 7,000 people, receiving 23,000 views. A video about Carolan published on the Computerphile youtube channel (https://www.youtube.com/watch?v=tyjgn5YO1Lk) has received 72,000 views to date.
Year(s) Of Engagement Activity 2015
URL http://www.carolanguitar.com
 
Description Co-chairing Digital Libraries for Musicology workshop 2016 (Kevin Page, Oxford) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact The Digital Libraries for Musicology (DLfM) workshop is a satellite event of ISMIR 2016. Kevin Page Co-chaired the workshop. The event had an attendance of 45 people (from academia, industry, galleries/libraries/museums sector). Date: August 2016, New York.

David Weigl (Oxford FAST IMPACt team member) gave a presentation at DLfM 2016: "In Collaboration with In Concert: Reflecting a Digital Library as Linked Data for Performance Ephemera".

For more information about the workshop, see:
http://www.transforming-musicology.org/dlfm2016/
Year(s) Of Engagement Activity 2016
URL http://www.transforming-musicology.org/dlfm2016/
 
Description Collaboration and knowledge transfer discussions with BBC 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Kevin Page and David Weigl from the FAST Oxford team visited BBC R&D to discuss their work, in conjunction with BBC Radio, on the SALT and SLoBR tools, with a view to further use across BBC data and the Corporation's requirements for DMOs.
Year(s) Of Engagement Activity 2015
 
Description Collaboration with Di Wilshire 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The Nottingham team have collaborated with the artist Di Wilshire to create an interactive sound installation called Sentiment. This features a series of provocative audio interviews with people that are edited to be played over a circular array of speakers, with the mix being controlled by the listener's movement in the space. Di also recorded galvanic skin response data from interviewees (a possible measure of stress) that is also played back to listeners using a wearable tactile device. Sentiment premiered at FACT in July 2015 and is now being extended ready touring with support from an Arts Council grant.
Year(s) Of Engagement Activity 2015
 
Description Collaboration with artist Albino Mosquito 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Nottingham University team have collaborated with the artists group Albino Mosquito to produce an interactive film (with soundtrack) called #Scanners that is controlled through a braincomputer interface. This was exhibited first at the ACM's Creativity and Cognition conference and then at FACT in July 2015. The following video trailer produced by the artists documents the experience as it appeared at FACT:
https://vimeo.com/135983464
Year(s) Of Engagement Activity 2015
URL https://vimeo.com/135983464
 
Description Collaboration with artist Caroline Locke 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The Nottingham team have collaborated with artist Caroline Locke who has developed an artistic interface called sound fountains in which sound in visualised through the activation of water (see: http://www.weareprimary.org/people/caroline-locke/). Caroline exhibited a version of sound fountains connected to a live data stream at FACT and is currently exploring how to Twork with us further extend her approach.
Year(s) Of Engagement Activity 2015
URL http://www.weareprimary.org/people/caroline-locke/
 
Description Collaboration with artist Tracy Redhead 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Recording artist and academic Tracy Redhead was invited to describe her work on a flexible music format to a QMUL FAST meeting. Her ways of working will inform the project's activities on Digital Music Objects.
Year(s) Of Engagement Activity 2015
 
Description Conference Presentation at the Audio Mostly Conference, Norrkoping, Sweden (Benford, Chamberlain, Hazzard, Greenhalgh) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact 75 people attended the presentation. The most notable impact or outcome was the introduction of this work - via a published paper- into the international academic community on audio. This conference presentation acted as a catalyst for discussion around the Muzicodes work with a new community of researchers.
Year(s) Of Engagement Activity 2016
 
Description D-Box paper presentation and demo at ACM Designing Interactive Systems Conference, Brisbane, Australia, July 2016. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The D-Box demo provided an opportunity for conference delegates to configure, reconfigure and play the D-Box, while discovering more about an instrument designed to promote exploratory play.

Approximately 15 participants played the D-Box, and discussed the underlying concepts of exploratory play and design of such instruments. This led to discussion around similar and related work and the forming of networks between academics.
Year(s) Of Engagement Activity 2016
 
Description D-box workshops 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Performers often find ways of playing musical instruments that differ from the designer's original intent. Two "hackable instruments" sessions to explore creative and unexpected uses of digital instruments were organised as workshops:

1) D-Box, FACT, Liverpool, 14th of July 2015
Each participant received a D-Box,, a simple electronic instrument that has been purpose-designed to be as hackable as possible. D-Boxes can be opened up and then completely rewired to produce new sonic effects. Participants learned to play, explore and modify their D-Boxes, share these skills with others and swap instruments to compare hacks.

2) D-BOX workshop as part of Being Human, A Festival of the Humanities, London 2015 16th November.
As above.
Year(s) Of Engagement Activity 2015
URL http://www.fact.co.uk/whats-on/current/the-mrl-d-box-instrument-hack-workshop.aspx
 
Description Demonstrations and posters at ISMIR 2016 (Oxford team) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact ISMIR is the premier international conference on music information retrieval. 2016's demonstration session was, for the first time, open to the public, as well as to the academics and industry representatives attending ISMIR. The Oxford FAST IMPACt team presented their three poster/demos side-by-side, sparking interesting discussions about the individual demos as well as on the wider FAST project:
1) "Numbers into Notes: Cast your mind back 200 years", D. de Roure, P. Willcox, and D. M. Weigl
2) "Dynamic Semantic Notation: Jamming together Music Encoding and Linked Data", D. M. Weigl and K. R. Page
3) "MIR user studies through the lens of relevance: Promoting the impact of MIR user research", D. M. Weigl, D. Steele, J. C. Bartlett, & C. Guastavino
Year(s) Of Engagement Activity 2016
URL https://wp.nyu.edu/ismir2016/
 
Description Digital Musicology workshop at Digital Humanities at Oxford Summer School 2016 (organised and run by Kevin Page). 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Kevin Page (Oxford) organised and ran the Digital Musicology workshop at Digital Humanities at Oxford Summer School. The workshop was attended by 19 registrants (students, academics, industry). Date: July 2016, Oxford. Reach: International reach.

More information about the workshop and FAST participation can be found in our FAST news item:
http://www.semanticaudio.ac.uk/news/fast-partners-participate-in-the-digital-humanities-at-oxford-summer-school/

The workshop website:
http://digital.humanities.ox.ac.uk/dhoxss/2016/workshops/digitalmusicology
Year(s) Of Engagement Activity 2016
URL http://digital.humanities.ox.ac.uk/dhoxss/2016/workshops/digitalmusicology
 
Description Digital Musicology: Applied Computational and Informatics Methods for Enhancing Musicology, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Digital Musicology: Applied computational and informatics methods for enhancing musicology, Monday 20 - Friday 24 July 2015, Oxford

This workshop at the Digital Humanities at Oxford Summer School was organised by Kevin Page, supported by David Weigl. Several other members of the FAST project team also presented to attendees from academia and industry.
Year(s) Of Engagement Activity 2015
 
Description Experience the Carolan Guitar, interactivity demo at ACM CHI 2016, San Jose, USA, May 2016. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Experience the Carolan Guitar' was an opportunity for conference delegates to spend some time playing the Carolan Guitar and scan its embedded Artcodes patterns. Alongside this practical activity participants could discuss the concepts of instrumenting instruments, artcodes, accountable artefacts (physical objects with digital records of their use and function). Their performances were captured and uploaded to its blog (www.carolanguitar.com), thus contributing to the history of the instrument's usage.

Approximately 30 participants played the Carolan guitar, most of which contributed a video recorded performance, discussed the underlying concepts of Artcodes, and accountable artefacts. This led to discussion around similar and related work and the forming of networks between academics.

The most signiticant impact was the dissemination of work to a broad HCI audience alongside their 'performed' contribution to the Carolan Guitar's digital history.
Year(s) Of Engagement Activity 2016
URL http://www.carolanguitar.com
 
Description FACT 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact In July 2015 the Nottingham team hosted a public exhibition and series of associated workshops at the Foundation for Art and Creative technology (FACT) a major UK venue for interactive art in Liverpool. Themed under the general banner of 'Performing Data', this included several pieces of work that were produced by or with support from the Fast project, including works by the artists Albino Mosquito, Di Wilshire and Caroline Locke discussed below as well as a workshop to learn to hack the D-Box musical instruments that have been created by Andrew McPherson and his team from QMUL.
Year(s) Of Engagement Activity 2015
 
Description Hacking Sound workshop (Oxford) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The Centre for Digital Scholarship and the University of Oxford e-Research Centre organised a day of sound hacking for the general public.

The hack day experimented with ways of representing data with sound or music and exploring the sonic world. The participants were encouraged to bring data and existing projects to share, and to start on fresh ideas. The day encouraged networking and developing ideas and projects, ending with a showcase of what was produced and future directions that might be taken.
Year(s) Of Engagement Activity 2016
URL http://blogs.bodleian.ox.ac.uk/digital/2016/09/20/an-invitation-to-hack-sound/
 
Description Innovation in Music (In'Music15) conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact The FAST project organized a panel session at this industry-focused conference. Panelists included Matt White (Director of User Experience, Omnifone), Jon Eades (Project Manager, Abbey Road Red), Gyorgy Fazekas (C4DM, QM), Peter Tolmie (MRL, Nottingham), Gary Bromham (composer, recording / mix engineer, producer) and Adrian Hazzard (MRL, Nottingham). The panel session explored and discussed the FAST project themes as an opportunity to reach out to a wider audience to both promote and foster future engagement with other related parties.
Year(s) Of Engagement Activity 2015
 
Description Internship with Naver Labs, South Korea 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact QMUL-funded FAST PhD student Keunwoo Choi spent 3 months with Naver, South Korea's leading internet search company. He developed visualisations of Convolutional Neural Networks and investigated learning from playcount and playlist data held by the company.
Year(s) Of Engagement Activity 2015
 
Description Linked Music Hackaton, Goldsmiths 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Linked Music Hackaton event (Programming with Purcell, Hacking with Handel, Linking with Liszt, 9th October 2015, Goldsmiths University of London)

Over 25 academics and developers gathered for a Linked Music Hackathon, organised by Kevin Page and David Weigl. Attendees were able to use data produced by FAST and more than 20 other Linked Data music sources to produce new mashups prototyped and presented on the same day. A variety of hacks were shown at the end of the event with the winning project "Geobrowsing using RISM" chosen by popular vote. A Radio 1 team were also in attendance to interview attendees for the BBC's "Make It Digital" campaign.
Year(s) Of Engagement Activity 2015
URL http://semanticmedia.org.uk/?q=hackathon
 
Description MPEG Media Value Chain Ontology meetings 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact QMUL is working to standardise aspects of the musicontology.com within the context of the wider MPEG Media Value Chain Ontology. They are attending meetings every four months; this is ongoing and continuing.
Year(s) Of Engagement Activity 2015
 
Description Moodplay Interactive Experience Digital Shoreditch 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact The C4DM team showcased the Moodplay Interactive experience at the Digital Shoreditch exhibition. Very good interaction with visitors was noted during the event and a number of questionnaires were completed by the public; these provide valuable information on feed back from the user.
Year(s) Of Engagement Activity 2015
 
Description Moodplay installation at BBC Sound Now and Next 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact BBC R & D organised a two day event at the BBC on innovation in sound production. The Queen Mary team was invited as an exhibitor and they presented the Moodplay Installation to professional practitioners, academic and industry and business.

Mention in press release by AudioMedia International (pro audio magazine):
http://www.audiomediainternational.com/broadcast/report-bbc-sound-now-and-next/04522
Year(s) Of Engagement Activity 2015
URL http://www.bbc.co.uk/rd/events/sound2015
 
Description Music Hack Day & Sonar Festival, Barcelona, 17-19 June 2015 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Music Hack Day is an international 24-hour event where programmers, designers and artists come together to conceptualize, build and demo the future of music. Three C4DM members (Matthieu Barthet, Gyorgy Fazekas and Alo Allik) attended the Barcelona Music Hack Day 2015 collocated with the Sonar festival (music, creativity and technology). They won one of the awards from the Rapidmix EU project for the most original hack using biosignal/multimodal wearable technology for music performance. (The award is listed in the Rapidmix section). The prize was a BITalino toolkit to prototype applications using body signals and was awarded by the company biosignalplux.

Description of the hack MoodBox:

MoodBox is a collaborative music jukebox which selects music following user emotional states as characterised by body signals measured with wireless wearable sensors. Correlates of arousal (excitation) and valence (pleasantness) are computed using electrodermal activity (EDA) and electromyography (EMG) with the Biosignalsplux Bitalino wearable sensor as well as electroencephalography (EEG) with the Neuroelectrics Enobio brain helmet. We use our mood recognition technology merging affective computing and semantic web techniques to map a collection of 10,000 tracks to the arousal/valence space. Our visualiser displays the track which is played back in the arousal/valence space according to how users feel on average!

MoodBox cited in thedrum.com article:

http://www.thedrum.com/opinion/2015/06/26/hacking-brain-real-virtual-reality-coolest-creative-tech-s-nard

More news about the Music Hack Day in Barcelona:
http://musichackday.upf.edu/mhd/2015/?p=206
Year(s) Of Engagement Activity 2015
URL http://www.thedrum.com/opinion/2015/06/26/hacking-brain-real-virtual-reality-coolest-creative-tech-s...
 
Description Music Hack Day and Sonar Festival 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Three C4DM members (Matthieu Barthet, Gyorgy Fazekas and Alo Allik) attended the Barcelona Music Hack Day 2015 collocated with the Sonar festival (music, creativity and technology). They won one of the awards from the Rapidmix EU project for the most original hack using biosignal/multimodal wearable technology for music performance. (The award is listed in the Rapidmix section). The prize was a BITalino toolkit to prototype applications using body signals and was awarded by the company biosignalplux.

Description of the hack MoodBox:

MoodBox is a collaborative music jukebox which selects music following user emotional states as characterised by body signals measured with wireless wearable sensors. Correlates of arousal (excitation) and valence (pleasantness) are computed using electrodermal activity (EDA) and electromyography (EMG) with the Biosignalsplux Bitalino wearable sensor as well as electroencephalography (EEG) with the Neuroelectrics Enobio brain helmet. We use our mood recognition technology merging affective computing and semantic web techniques to map a collection of 10,000 tracks to the arousal/valence space. Our visualiser displays the track which is played back in the arousal/valence space according to how users feel on average!

MoodBox cited in thedrum.com article:
http://www.thedrum.com/opinion/2015/06/26/hacking-brain-real-virtual-reality-coolest-creative-tech-s-nard

More news about the Music Hack Day in Barcelona:
http://musichackday.upf.edu/mhd/2015/?p=206
Year(s) Of Engagement Activity 2015
URL http://www.semanticaudio.ac.uk/news/c4dm-team-win-an-award-at-the-music-hack-day-barcelona-17-19-jun...
 
Description Muzicodes workshops (C. Greenhalgh, S. Benford, A. Hazzard, A. Chamberlain) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Four workshops with a range of participants who engaged with setting up, authoring and performing the Muzicodes system, using their own musical instruments. These workshops identified groups of potentially interested participants, thus recruitment was by invite.

These workshops enabled the FAST IMPACt Nottingham team to observe how musicians interacted with the system, thus drawing some broad conclusions, which then inform further technical developments. They disseminated the work to range of practitioners and researchers (some of whom are continuing to engage with it, e.g., Maria Kallionpaa) and enabled its continuing development.
Year(s) Of Engagement Activity 2016
 
Description Mycelia meeting at Sonos Studios 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Mycelia is an initiative by the music performer and artist Imogen Heap to galvanise change in the rights and renumeration in the 21st century recorded music industry. Mark Sandler presented overview of EP/L019981/1 on 9 Feb 2016.
Year(s) Of Engagement Activity 2016
 
Description Open Symphony 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact In a traditional music performance situation, the audience has limited means to give feedback (e.g. applause!) and little opportunity to interact with the music's performance. What if this were revisited? 'Open Symphony' is an immersive performance system developed as part of a collaboration between Queen Mary University of London and a Masters graduate of Guildhall School of Music and Drama. Open Symphony explores the creativity and spontaneity of real-time human interaction through an ensemble of performers and an audience using mobile technology. The project aims to extend the nature of live music to enable audience members to meaningfully collaborate in the development of a musical piece. By realigning both music and technology as co-operating tools, audience members actively influence the music being played in a live environment, creating a meaningful mutual experience between multiple audience members and performers. "Open Symphony" creates new musical experiences, new music and new compositional methods. This is made possible by using a wide range of technologies including web, information visualisation, and sensors.
Year(s) Of Engagement Activity 2015
URL http://isophonics.net/content/opensymphony
 
Description Organisation of DMRN +10 conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact FAST sponsored the workshop and FAST presentations at the Digital Music Research Network (DMRN+10) 2015 event held at QMUL. This is an annual event organised by C4DM.
Year(s) Of Engagement Activity 2015
 
Description Presentation at the Music Encoding Conference in Montreal 2016 (Kevin Page) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Kevin Page (Oxford FAST IMPACt team member) gave a presentation at the Music Encoding Conference in Montreal, May 2016: "Prototypical Scenarios for Contextual Navigation with MEI and Linked Data".
Year(s) Of Engagement Activity 2016
 
Description Presentation at the Sonar+D Festival, June 2016, Barcelona, Spain 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact From 16-18 June 2016, the Centre for Digital Music (QMUL) including members from the FAST project presented a public exhibition of its research at the Sonar+D festival, a high-profile annual event in Barcelona which caters to musicians, the music technology industry, and members of the general public. C4DM was chosen by competitive application for a display booth (roughly 4m x 4m) on the exhibition floor, in a prime location near the entrance to the facility. 12 C4DM researchers, including PhD students, postdocs, early- and mid-career academics, attended to showcase their work.

The event was attended by thousands of people, mainly adults but also occasionally children. The booth had many visitors from both large and small businesses, including several different members of the music company Focusrite. Several musicians who were performing and speaking at Sonar also attended the booth, including the well-known composer Brian Eno who took an interest in several of the research projects. The event raised the public profile of C4DM and the individual projects within it.

MusicWeb was demonstrated to app developers who have taken interest in linked music data.
Year(s) Of Engagement Activity 2016
 
Description Presentation by Mark Sandler, Alan Blumlein event, Abbey Road Studios 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact FAST was presented by Mark Sandler to an audience of ~100 on at Abbey Road Studios, marking the occasion of Blumlein's centenary with a plaque dedicated by IEEE. FAST is now dedicated to the memory of Alan Dower Blumlein, the inventor of binaural and crossed-pair microphone recording techniques, as well as the stereo groove configuration in vinyl LP records.
Year(s) Of Engagement Activity 2015
 
Description Presentations at Oxford Digital Humanities Summer School (July 2016) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact FAST IMPACt had several presentations at the Oxford Digital Humanities Summer School (July 2016). The Summer School is made out of multiple workshops drawn from the over 150 summer school attendees (international; students, academics, professionals, industry.

1) "Creating linked data with Annalist", Linked Data workshop, Graham Klyne. This was a hands-on session which gave participants an opportunity to create linked data based on modelling they had performed in previous workshop sessions.
2) "Linked Data", Introduction to Digital Humanities workshop, Kevin Page
3) "The Physical and the Digital via the Meta", Humanities Data workshop, Kevin Page

FAST produced a news item on FAST participation: http://www.semanticaudio.ac.uk/news/fast-partners-participate-in-the-digital-humanities-at-oxford-summer-school/
Year(s) Of Engagement Activity 2016
URL http://www.oerc.ox.ac.uk/news/digi-humanities-summer-school
 
Description Real World Studios 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Nottingham team was hosted by Real World Studios for a day where they introduced the FAST project and explored opportunities for future partnership.
Year(s) Of Engagement Activity 2015
URL http://realworldstudios.com
 
Description Returning Ghosts - Performance and New Technologies WG Interim Event 24th May 2016 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact The audience engaged with during this workshop were academic researchers in the Performing Arts discipline.

Returning Ghosts focused on identifying new ways to recall memories using performance and technology and features performances and presentations. Jocelyn Spence gave a talk on the Rough Mile Experience.

One of the outcomes that has arisen was an early discussion about collaborating on a book chapter of performative works. It is hoped to facilitate dissemination of work (primarily situated in an HCI research community) to a Performing Arts research community.
Year(s) Of Engagement Activity 2016
 
Description Semantic Digital Humanities workshop, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Kevin Page from the FAST Oxford team co-organised this 3 day workshop which brought together contributors from the humanities and computer science, and academia and the arts and cultural heritage industry.
Year(s) Of Engagement Activity 2015
 
Description Series of talks in the Centre for Digital Scholarship: "Research Uncovered" (Oxford team) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Talks in the Centre for Digital Scholarship: "Research Uncovered" is a series of public talks on digital scholarship; many attendees come from around the University of Oxford but others come from the region, and audiences includes visitors from around the country and the world):

1) "Research Uncovered-David De Roure on Ada Lovelace, Numbers, and Notes", 22 Jan 2016. See: https://blogs.bodleian.ox.ac.uk/digital/2016/01/11/research-uncovered-david-de-roure-on-ada-lovelace-numbers-and-notes/
2) "Research Uncovered-The imagination of Ada Lovelace: creative computing and experimental humanities", part of the Oxford Women's International Festival. 7th March. See: https://blogs.bodleian.ox.ac.uk/digital/2017/01/09/pip-willcox/
3) "Research Uncovered-Making Numbers into Notes: the making of Ada Lovelace's generative music", part of the Oxford Women's International Festival. 7th March. See:
http://blogs.bodleian.ox.ac.uk/digital/2017/02/24/making-numbers-into-notes-the-making-of-ada-lovelaces-generative-music/
4) "Research Uncovered-Finding music to move to: Relevance in Music Information Retrieval", 31 Jan 2017. See: http://blogs.bodleian.ox.ac.uk/digital/2017/01/06/david-weigl/
Year(s) Of Engagement Activity 2016
 
Description Soundlincs 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Industry/Business
Results and Impact The Nottingham FAST team have established a collaboration with Soundlincs, a company that delivers musical outreach activities to disadvantaged communities around the midlands (http://www.soundlincs.org). Following an initial visit, they hosted a one day workshop to explore collaboration at which they identified various opportunities for future joint-projects.
Year(s) Of Engagement Activity 2015
URL http://www.soundlincs.org
 
Description Special Session panelist: Fusing Semantic and Audio Technologies for Intelligent Audio Production and Consumption project (FAST) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact George Fazekas, Centre for Digital Music, Queen Mary acted as a special session panelist: Fusing Semantic and Audio Technologies for Intelligent Audio Production and Consumption project (FAST), Innovation in Music 2015, Anglia Ruskin University, Cambridge, UK.

Intended for music industry professionals. Audience: 60-80.
Year(s) Of Engagement Activity 2015
URL http://innovationinmusic.com/
 
Description Talks and posters at DMRN+11 (2016) (Oxford team) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Digital Music Research Network (DMRN) aims to promote research in the area of Digital Music, by bringing together researchers from UK universities and industry in electronic engineering, computer science, and music. The following FAST talks and posters were presented:
1) "Interacting with robots as performers and producers of music", Alan Chamberlain (University of Nottingham), Kevin R. Page, David De Roure, Graham Klyne and Pip Willcox(University of Oxford)"
2) "Understanding creativity and autonomy in music performance and composition: A proposed 'toolkit' for research and design", Alan Chamberlain (University of Nottingham), David De Roure, Pip Willcox (University of Oxford), Steve Benford and Chris Greenhalgh (University of Nottingham)
3) "Conceptualizing relevance for music information retrieval", David M. Weigl (University of Oxford)
Year(s) Of Engagement Activity 2016
URL http://c4dm.eecs.qmul.ac.uk/dmrn/events/dmrnp11/
 
Description The "Ada Sketches" event, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The "Ada sketches" event was held on 30 November, in the Mathematical Institute in Oxford. It opened with a performance of Ada sketches by four musicians from the Royal Northern College of Music, after which the work was explained musically and mathematically by its composer Emily Howard and mathematician Lasse Rempe- Gillen (from Liverpool), then it was performed a second time. After the break the participants went into the "co-creation phase" where audience members turned "numbers into notes" and these were performed by the musicians. The event captured a live annotation of the first performance by Carolin, and the audience response to the work before and after explanation was collected via questionnaires designed in conjunction with Daniel and Iris from Goldsmiths. The audience included several attendees of the IT as a Utility network "Internet of Audio Things event" which was held earlier that day.
Year(s) Of Engagement Activity 2015
 
Description The Ada Lovelace Symposium, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The Ada Lovelace Symposium was held on the 10-11 December 2015. There was a display in the coffee area with a slideshow based on the performance and played audio clips over headphones (silent disco!), which gave the participants a chance to sit, talk, and demo with interested delegates (many were musicians). On Wednesday afternoon there was a session in the symposium constructed as a conversation on stage between David de Roure and the composer Emily Howard. This also featured a clip of Emily's work "Mesmerism", which is another part of her Ada Lovelace Trilogy, and an example from David de Roure of generating a number sequence on a simulator of the Analytical Engine and developing the output as a music theme (i.e. directly addressing the Lovelace quote on which all our discussions have been based).

There was an additional musical event at the Wednesday evening reception in Blackwell Hall - world premières of "An algorithmic study on ADA" and "ADA", composed by James Whitbourn, performed by Commotio (mixed-voice contemporary choir), Andrew Bernardi (violin), Anna Lapwood (harp), and conducted by Matthew Berry.

David de Roure gave a presentation on all the above at QMUL as part of the Digital Music Research network event. The Transforming Musicology and FAST projects were acknowledged at both events.
Year(s) Of Engagement Activity 2015
URL https://dl.dropboxusercontent.com/u/15772302/NumbersIntoNotes/index.html
 
Description The B076 audio experience 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The B076 audio experience engaged with 12 members of the public who signed up to take part. They were recruited via the Primary Arts Space and distributed flyers. It was hosted in the Primary Arts Space, Nottingham. It was an indoor interactive installation where visitors walked around an empty exhibition space. iBeacons were distributed around the room which tracked the proximity of visitors, thus determining their location in the room. Their position triggered playback of different audio streams which culminate in a continuous soundscape narrative.

The most significant outcome/impact of this activity was extending the sensor functionality of the Semantic Player.
Year(s) Of Engagement Activity 2016
 
Description The Media Talentlab project 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact TalentLab is an annaul programme of events that supports the creative development of BAME artists and filmmakers who are ready to take their careers to the next level. The engagement activities with artists this project is involved in show how working with external artists is part and parcel of our approach to research, allowing us to explore innovative new ideas while also delivering public impact. In order to broaden the diversity of artists with whom we work the Nottingham team have recently established a relationship with the company B3 Media and their Talentlab programme which provides training, development and support for Black, Asian and Minority Ethnic artists. By running workshops with Talentlab 2015 (see: http://www.b3media.net/talentlab#.Vq9f7OsZ7uU) we have recruited three new artists - all working with sound and music in different ways - to collaborate with us on new projects over the coming year. Their proposals are investigating interfaces for live performance, remote streaming of environmental sounds, and interactive musical interfaces for wellbeing.
Year(s) Of Engagement Activity 2015
URL http://www.b3media.net/talentlab#.Vq9f7OsZ7uU
 
Description The Rough Mile 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The Rough Mile experience engaged with 22 members of the public, who signed up to take part. They were recruited via Rough Trade records, posters and flyers distributed around Nottingham City.

The Rough Mile experience consisted of two locative audio walks that took place on different days, for pairs of friends to come and experience together. The first walk was a pre-defined narrative performance that in part captured information from the friends about music tracks choices they would like to gift to each other. The second walk then consisted of this gifted experience, where they listened to these music tracks as between pairs of friends. The experience was a research exercise, but also a standalone 'artistic engagement' in its own right. Anecdotal evidence was captured from participants discussing their enjoyment and subsequent desire to seek out and engage with other similar experiences.

The most significant outcome / impact was the successful deployment of a detailed locative audio experience with a universally positive reception.
Year(s) Of Engagement Activity 2016
 
Description Workshop co-chair: Objective Evaluation in Semantic Audio Analysis and Processing (G. Fazekas) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas, Centre for Digital Music, Queen Mary, acted as workshop co-chair: Objective Evaluation in Semantic Audio Analysis and Processing, 138th International AES Convention, May 7-10, 2015. The workshop was intended for audio engineers and music industry professionals.
Year(s) Of Engagement Activity 2015
 
Description Workshop on Auditory Neuroscience, Cognition and Modelling 2016 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The main aim of the organisers (Marcus Pearce, Emmanouil Benetos, Yvonne Blockland) was to organise and host at QMUL a workshop on Auditory Neuroscience and Computation, which took place on Wednesday 17 February 2016, at the Charterhouse Square campus. The workshop brought together auditory neuroscientists, cognitive scientists, as well as researches in music and audio signal processing and related fields. New insights on the cognitive and neural underpinnings of speech, music and sound processing were presented, with a large focus on EEG and MEG data analysis. The workshop focused on academic impact, however it had industry participation (from Audio Analytic, Red Apple Creative). Following an open call for abstracts and selection process., 32 presentations were accepted: 3 keynote talks, 6 oral presentations and 23 poster presentations.

The workshop website includes a PDF book of abstracts and video recorded oral presentations (see website below). Post-workshop summaries are being written by both workshop organizers and attendees, to be published to several venues: Psychomusicology, Young Acousticians Network newsletter, Audio Analytics Lab blog. Future plans: discussions are underway on applying for an EPSRC Research Network grant, for funding future workshops and network activities.

Post-workshop summaries are being written by both workshop organizers and attendees, to be published to several venues: Psychomusicology, Young Acousticians Network newsletter, Audio Analytics Lab blog.

- Psychomusicology report:
o Workshop on Auditory Neuroscience, Cognition and Modeling. Agres, Kat; Sauvé, Sarah Anne Psychomusicology: Music, Mind, and Brain, Vol 26(3), Sep 2016, 288-292. http://dx.doi.org/10.1037/pmu0000151
- Audio Analytic Lab blog post:
http://www.audioanalytic.com/aa-labs-impressions-on-the-workshop-on-auditory-neuroscience-cognition-and-modelling-2016/
- Young Acousticians Network newsletter:
https://euracoustics.org/activities/yan/yan-newsletter-folder/2016/march-2016/at_download/file

Preliminary discussions have been made with Iris Mencke and Elvira Brattico on hosting the next workshop.
Year(s) Of Engagement Activity 2015
URL http://c4dm.eecs.qmul.ac.uk/wancm2016/
 
Description Workshop, "Audio in Place: Media, Mobility & HCI - Creating Meaning in Space" (by Chamberlain A., Bødker M., Hazzard A. and Benford S.) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Workshop based on presentation by Chamberlain A, Bødker M, Hazzard A and Benford S. (2016), "Audio in Place: Media, Mobility & HCI - Creating Meaning in Space", In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services.

Short workshop presentation, followed by discussion and then practical activities based around capturing and using audio to highlight issues related to HCI.

The workshop was a catalyst for further discussion and debate, new collaborations betweens attendees have arisen in the form of submitted research outputs (publications).
Year(s) Of Engagement Activity 2016
 
Description Workshops with BBC, Abbey Road, Rectify, Weav 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Industry/Business
Results and Impact Small discussion meetings exploring dynamic music formats and how it relates to Digital Music Objects and Dynamic Music.
Year(s) Of Engagement Activity 2015
 
Description Workshops with Omnifone Engineering teams 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The FAST QMUL team was training the company in linked data and its advantages.
Year(s) Of Engagement Activity 2015