Semantic AudiovisuaL Entertainment
Reusable Objects

• Project
  • Overview
  • Key data
  • Detail
  • Partner List
  • Partner Information
• Showcase
  • Showcase Overview
  • Audio Processing Tools
  • Synthetic Emotional Model
  • Audio Transformation
  • Automatic Program Generation Pipeline
  • Bones Dailies
  • My Tiny Planets
  • Semantic Annotation and Search
  • Stress Tagging
  • Game Devolopment Tools
  • Vowel Builder
  • The Maskle
  • Turing Machine
  • Karaoke Revolution
  • Interactive Videojockey
  • Facial Animation
  • Full House
  • Hack the Van
  • Spark and Socket
  • Triage Simulator
  • Turing Machine Opera
  • Aspect Browser Interface
  • Speech Synthesis
• Events
  • IBC 2009
  • 4th User Group Event (Annecy)
  • 3rd User Group Event (Amsterdam)
  • 2nd User Group Event (London)
  • 1st User Group Event (Barcelona)
  • AIM@SHAPE Workshop
  • SALERO Open House
  • SMSS '07
• Resources
  • Publications
  • Deliverables
  • Information Material
  • Commercial Presentations
  • Related Projects
  • Media Object Dictionary: CGI Terms
  • Media Object Dictionary: Postproduction Terms
  • Media Object Dictionary: Game and Game Development Terms
  • Media Object Dictionary: Semantic Information Storage and Processing Terms
  • Media Object Dictionary: Media Search and Retrieval Terms
  • Media Object Dictionary: Language Processing and Speech Synthesis Terms
  • Media Object Dictionary: Audio Processing Terms
• Contact
  • Contact
  • Login

---

Public Deliverables

These are the public Deliverables produced by the SALERO project so far. This list will be updated with new documents as soon as they are availaible.

D2.1.1 - Media Object Dictionary K. Wheatley, C. Brown (CINESITE); C. Goodman (PGP); R. Hackett, R. Smithies (BLITZ); R. Schlatte, S. Russegger, G. Kienast (JRS) The dictionary is a live document, being updated throughout the lifetime of the project as new types of media objects are encountered or greater precision required from existing entries.

D2.2.1 - First Report on User Group Events O. Mayor (UPF); P. Stansfield (Wavecrest) The purpose of the User Group Events in Barcelona and London was to introduce the project to industry representatives and to gather feedback. During the event the participants got presentations on the project, hands-on demonstrations of the tools as well as future plans. Based on this, a discussion analyzed suitability of tools to the task, usability, comprehensiveness of function set, integration in the workflow process, and requirements from the users’ point of view.

D2.2.2 - Second Report on SALERO User Group Events. O. Mayor (UPF). P. Stansfield (WCR) During 2008 two User Group Events were organized. One hosted by The Music Technology Group (MTG) of the Universitat Pompeu Fabra in Barcelona coinciding with the 3GSM trade fair, and another User Group event held in Soho, an area of London containing half of the UK's Film Post production, advertising and games companies. Learning from the past and with the help and expertise of WaveCrest Systems, during the final years of the project (2008-2009) we have organized some new User Group Meetings and Events that are explained in detail in this document.

D3.1.1 - Representation Techniques for Multimedia Objects G. Kienast, H. Zeiner, P. Hofmair, R. Schlatte, G. Thallinger (JRS); T. Bürger, D. Denissenko, A. Wahler (LFUI) D3.1.1 gives an overview on the state of the art on multimedia description and semantic technologies as well as an outlook on which benefits are to be expected from a semantic extension of multimedia formats.

D3.1.4 - Evaluation of the Economic of Multimedia Ontologies T. Bürger, C. Ammendola, E. Simperl (LFUI) This document takes a closer look at specific facets of these ontologies. It aims to tackle an identified gap in the field of ontology engineering which is of utmost relevance for their use in commercial settings: the assessment of the economics of ontologies. Therefore the purpose of this deliverable is to present a model for the evaluation of the economics of ontologies in terms of costs and benefits.

D3.1.6 - Embedding of Semantic Metadata in Content Formats T. Bürger (LFUI), G. Kienast, W. Weiss (JRS), R. Villa, P. Swamy, D. Hannah (UG) This document is the successor of a deliverable which gave an introduction to ontologies, ontology languages, multimedia description standards, and which discussed interoperability issues among multimedia descriptions. Furthermore it extends the content of a set of other deliverables which introduced the design and implementation of the so-called semantic workbench which provides lifecycle support for multimedia ontologies and which introduced a set of ontologies for the description of multimedia content which have been built in the course of the SALERO project so far. In this deliverable we will detail how ontological descriptions and existing descriptions following traditional XML based schemes can be combined in one common format.

D3.1.7 - Ontologies for Multimedia Objects and Workbench. Final Version. G. Kienast, W. Weiss, P. Hofmair (JRS); T. Bürger, S. Huber (LFUI); P. Swamy, R. Villa (UG) This deliverable is the seventh and final deliverable of Work Package 03 (“Media Semantics and Ontologies”) and presents the achievements during the final phase of the SALERO project. In SALERO WP03 main partners JRS and LFUI have jointly developed a set of ontologies and tools designed for semantic annotation and search with the overall goal of allowing easy reuse of assets in digital media production.

D4.1 - Defining Media Types, Genres and Styles Used in SALERO H. Hyvärinen, M. Junnila, M. Nieminen, T. Paju (TAIK) D4.1 describes the relations of media types, genres and styles used in SALERO. These definitions, comparisons of SALERO experimental productions and an extended study on digital game genres are used in initial ontologies aimed at helping the creation of SALERO tools. The purpose of this document is to open ways to approach ontology on genres.

D5.2.1 - Multimedia Analysis and Representation Techniques and Research Roadmap R. Mörzinger, G. Kienast, G. Thallinger (JRS); X. Hilaire, J. Urban, R. Villa, F. Hopfgartner, J. Jose (UG); D. Campbell, C. Cullen (DIT); G. Holmberg, P. Cano (FBM-UPF); I. Iriondo, F. Alías, X. Gonzalvo, L. Formiga (URL) This document gives an overview on the state-of-the-art in multimedia analysis and context based information retrieval and defines the research planned in Work Package 05 for the remainder of the SALERO project.

D5.3.2 - Report on Context-Based Audio Feature Extraction P. Cano (UPF), R. Villa (UG) This document describes investigations into using audio and its context to improve the performance of multimedia, and in particular, audio annotation and retrieval systems. A background review of the role of the audio in retrieval is provided, along with the motivation for using audio information in retrieval, and the importance of the context (versus the content) in this task. Techniques for using audio in context are described, and experiments are presented to show how audio can aid in contextual retrieval.

D5.5.4 - The System Design and Implementation of the Context-Based Search Systemn R. Villa, P. Swamy, V. Strathopoulos, Y. Feng, H. Misra, J. Jose (UG), M. Tuomola, T. Korpilahti J. Pesonen (TAIK), T. Bürger (LFUI), W. Weiss (JRS), S. Miarnau (AM) The long term needs of a user while searching for some information are more likely to be satisfied by the context in which the search is performed. However, current systems typically do not make use of contextual information while presenting the results and “context-based search systems” are a promising alternative to bridge this gap. This deliverable describes the progress made in the development of a context-based search system in the last six months of the SALERO project.

D5.7.1 - Report on Search System Evaluation R. Villa, P. Swamy, V. Strathopoulos, Y. Feng, H. Misra, F. Hopfgartner, K. Athanasakos, I. Arapakis, M. Halvey, D. Hannah, A. Goyal, R. Ren, J. Jose (UG) This document describes the evaluation efforts which have occurred over the course of the SALERO project, in relation to the content-based search system which have been developed over the period of the project.

D6.2.1 - Initial Construction of a Limited Emotional Speech Corpus for Analysis C. Cullen (DIT) This document describes the design of the corpus and its associated implementation. The document defines: The rationale behind the use of Mood Induction Procedures (MIPs) to obtain natural emotional speech assets for analysis. The recording conditions used for all experiments. The specific Mood Induction Experiments that were used to obtain the assets in the corpus. The metadata used to annotate the corpus The analysis data produced in accordance with the logical rhythmic tagging framework The actual construction of the corpus itself

D9.1.1 - Experimental Productions Scenarios H. Hyvärinen, T. Paju, J. Tenhunen, M. Tuomola (TaiK); E. de Vilar, M. Campos (AM); R. Hackett, M. Matthews (BLITZ); K. Wheatley (CINESITE); C. Goodman (PGP); G. Thallinger (JRS) This deliverable states the plans for the four experimental productions to be implemneted in the course of the SALERO project. In SALERO's Description of Work experimental productions to be developed in four different categories have been defined: information and entertainment programming, cinematic content adaptation, pre-school, and interactive games.

D9.2.1 - Evaluation Methodology J. Blat, S. Sayago, D. Soto, J. Abadía (FBM-UPF) This deliverable sets forth the evaluation objectives, procedures and schedule of evaluation instruments and outputs for the initial 18 months of the SALERO project, and introducing the evaluation perspectives for the whole project. This deliverable focuses on the definition of an evaluation methodology for assessing Experimental Productions in an integrated way.

D9.3.2 - Second Phase Experimental Productions Specifications Report M. Tuomola, K. Åberg, M. Nieminen, M. Norrena (TAIK); G. Vilar (AM); C. Goodman (PGP); M. Matthews (BLITZ) This Deliverable specifies the plans for the second phase SALERO experimental productions, as they have been formulated after the evaluation experiences reported in D9.6.1 First Experimental Productions Evaluation. It responds to the task T3 in WP09. The main objective of WP09 is to guide, validate and evaluate the technological R&D by means of a series of experimental productions across a range of important media genres, based on scenarios defined by artists and creative media professionals.

D9.5.1 - First Experimental Production Prototypes C. Goodman (PGP); G. de Vilar (AM); R. Hackett (BLITZ); J. Tenhunen (TAIK) This document refers to the First Experimental Production Prototypes under construction within the context of the SALERO project.

D9.6.3 - Third Phase Experimental Productions and Evaluation Report S. Glanville, T. Korpilahti, M. Nieminen, A. Singh, T. Stolt, M. Tuomola (TAIK); C. Goodman (PGP); M. Matthews (BLITZ); S. Miarnau, A. Monroig (AM); A. Evans, S. Sayago (FBM-UPF) This Deliverable describes the execution and evaluation of the Third Experimental Productions in SALERO. The general purpose of the Experimental Productions is to test the validity of the concepts and applicability of intelligent technology to creative work in four principal genres: Information and Entertainment Programming, Pre-school, Interactive Games and Cross-media experimental work. The specific purpose is to test and evaluate the technologies and tools emerging from SALERO, and their interoperability with existing media technologies, and to guide the next stages of research and development.

D10.3.1 - Digital Media Technology, Research, and Production Trends Report M. Mathews, R. Hackett (BLITZ), P. Stansfield (WCR) This Deliverable contains the research findings on the ‘State of the Art’ today on Digital Media. It identifies many trends, some of which are now established, and others which are just beginning. Through both the Professional and Domestic sectors, we can see convergence taking place. We can see the start of ‘Intelligent Content’ happening. The overall reasons for the emergence and growth of Intelligent Content will benefit Europe as a whole. Intelligent content can be used to satisfy these needs.

D10.3.2 - Digital Media Technology, Research, and Production Trends Report. Version 2 R. Fach (GVG), P. Stansfield, T. Evans (WCR) This deliverable follows on from the D10.3.1 survey of digital media technology trends and maintains the same approach to identifying trends in the development of intelligent media technologies and services. D10.3.2 was written in November 2007 towards the end of the second year of the SALERO project, and while many of the trends have developed as predicted, some unpredicted and potentially disruptive technologies have appeared.

D10.3.3 - Digital Media Technology, Research, and Production Trends Report. Version 3 G. Vilar, S. Miarnau (AM), M. Yan (DTS), R. Fach (GVG), R. Villa (UG), T. Stolt, M. Tuomola (TAIK), G. Kienast, G. Thallinger (JRS), T. Bürger (LFUI), C. Goodman (PGP), M. Matthews (BLITZ), A. Evans (FBM-UPF), O. Mayor (UPF), C. Cullen (DIT). This deliverable follows on from the D10.3.2 survey of digital media technology trends, delivered in November 2007, and maintains the same approach to identifying trends in the development of intelligent media technologies and services. D10.3.3 was written in October 2008 towards the end of the third year of the SALERO project, and while many of the trends have developed as predicted, some unpredicted and potentially disruptive technologies have appeared. Through both the professional and domestic sectors, we continue to see convergence taking place between digital technologies to create the necessary preconditions for Intelligent Content and the funding of a significant body or research designed to add intelligence or smart functionality to media tools, products and services.

D10.3.4 - Digital Media Technology, Research, and Production Trends Report. Version 4 S. Cheung (DLLNI), S. Miarnau, A. Monroig (AM), R. Fach (DFT), R. Villa (UG), T. Stolt, M. Tuomola , T. Korpilahti (TAIK), G. Kienast, (JRS), T. Bürger (LFUI), C. Goodman (PGP), M. Matthews (BLITZ), A. Evans (FBM-UPF), O. Mayor (UPF), C. Cullen (DIT), C. Monzo (URL) This deliverable follows on from the D10.3.3 survey of digital media technology trends and maintains the same approach to identify trends in the development of intelligent media technologies/services. D10.3.4 was written towards the end of the final year of the SALERO project, and while many of the trends have developed as predicted, some unpredicted and potentially disruptive technologies have appeared. In addition to the trends, digital media research carried out within the SALERO project by individual partners and their future research direction in those areas are also outlined. The SWOT analysis on SALERO from D10.3.3 is still largely valid.

D10.5.2 - Project Presentation - Update December 2007 G. Thallinger (JRS) This is a presentation of SALERO's vision, objectives & results.

D10.5.3 - First Annual On-Line Public Report G. Thallinger, G. Kienast (JRS), J. Jose (UG), D. Campbell (URL), G. Holmberg, J. Blat (FBM-UPF), G. Vilar (AM) SALERO aims to make cross media-production for games, movies and broadcast faster, better and more cost efficient by combining computer graphics, language technology, semantic web technologies as well as content based search and retrieval.

D10.5.4 - SALERO Open House Day, June 13th, 2007, Helsinki, Finland J. Tenhunen, M. Nieminen (TAIK); C. Goodman (PGP); G. Holmberg, M: Romeo (FBM-UPF); C. Cullen (DIT); C. Monzo (URL); G. de Vilar (AM); R. Hackett (BLITZ); M. Eladhari (keynote speaker) SALERO Open House took place on 13th of June 2007 in Sampo Hall at the University of Art and Design Helsinki. Open House day was intended for the professionals and for the general public to give the public view of technological development, which is often less deep than it could be because of the lack of transparency in many fields, especially from industrial companies working in high-end technologies like digital media. The event was free of charge and open for everyone interested.

D10.5.5 - Second Annual On-Line Public Report G. Kienast, G. Thallinger (JRS), G. Holmberg (UPF), M. Yan (DTS), K. Åberg (TAIK), C. Goodman (PGP), T. Bürger (LFUI), R. Villa (UG), R. Hackett (BLITZ), F. Alias (URL), J. Blat (FBM-UPF), R. Fach (GVG) SALERO will define and develop 'intelligent content' for media production, consisting of multimedia objects with context-aware behaviours for self-adaptive use and delivery across different platforms. 'Intelligent Content' should enable the creation and re-use of complex, compelling media by artists who need to know little about the technical aspects of the tools that they use.

D10.5.6 - Third Annual On-Line Public Report G. Kienast, G. Thallinger (JRS); R. Fach (GVG); S. Miarnau Freixes (AM); O. Mayor (UPF); T. Bürger (LFUI); M. Yan (DTS); T. Stolt (TAIK); R. Villa (UG); M. Romeo (FBM-UPF); C. Goodman (PGP); M. Matthews (BLITZ); L. Formiga (URL) In the third year of the project major progress has been made in all areas. Examples are the development of advanced algorithms for facial animation, expressive speech synthesis, improved tools for game development, establishment of an ontology for modelling virtual characters and the implementation of the second phase experimental productions.

D10.5.7 - Fourth Annual On-Line Public Report G. Kienast, G. Thallinger (JRS), R. Fach (GVG), S. Miarnau Freixes (AM), O. Mayor (UPF), T. Bürger (LFUI), S. Cheung (DTS), T. Stolt (TAIK), R. Villa (UG), M. Romeo (FBM-UPF), C. Goodman (PGP), M. Matthews (BLITZ), J. Adell (URL) In the fourth and final year of the project major progress has been made in all areas. Examples are the development of advanced algorithms for facial animation, expressive speech synthesis, improved tools for game development, establishment of an ontology-based annotation and search tool taking content based and textual information also into account and the implementation and evaluation of the third phase experimental productions.

D10.5.8 - Project Showcase All partners. This deliverable showcases the final project results based on the SALERO workflow diagram. It is made up from online demos and videos of the developed tools.

D11.3.1 - Report on Professional Training Programmes K. Åberg, M. Nieminen (TAIK), J. Agenjo (FBM-UPF) The first Training for Professionals workshop for tools created within SALERO took place at the University of Art and Design Helsinki (TAIK) 13-15 May 2008. The event was intended for professionals in the 3D area; practitioners from the commercial world, academics and future designers in graduate schools, who were interested in learning about SALERO experimental software and also to try out the software for themselves. The objective of the training session was to teach working tools to the participants - and gain experiences from the process for future training events and gather feedback from the participants for the developers.

D11.2.2 - Report on Postgraduate Research and Training Programme Development C. Pritchard, B. O’Neill, D. Campbell (DIT) Based on the findings of SALERO deliverable D11.2.1, a more detailed approach to a DIT doctoral training framework has been defined. It has emerged that existing online learning environments and security measures in partner institutions are disparate in nature and would be difficult to integrate into a workable solution. A further study of online learning tools has been undertaken in conjunction with the Technology Learning Team in DIT and suitable Web 2.0 tools have been implemented and tested to provide a solution which will be used to deliver pilot elements of a selected module from the transferable skills component of the proposed doctoral training framework.

D12.1.1 - Initial Report on Commercialization and Marketing Activities R. Fach (GVG); E. Martinez (URL); G. Kienast (JRS); M. Yan (DTS), J. Payo (AM); M. Matthews (BLITZ); G. Holmberg (MTG-UPF); D. Campbell (DIT) In this report, the individual partners studied the fields of commercialization based on the first technological achievements of the SALERO project. They identified the market segments and products which could act as “early technology adopters”. Each of the partners defines his field of commercialization and the marketing activities he plans to do.

D12.1.3 - Third Report on Commercialisation, Marketing and Demonstration Activities M. Matthews (BLITZ), C. Boqué, S. Miarnau (AM); T. Korpilahti, T. Stolt, M. Tuomola (TAIK); C. Cullen (DIT); S. Cheung (DLNNI); G. Thallinger, G. Kienast (JRS); T. Bürger (LFUI); R. Villa (UG); A. Evans (FBM-UPF); C. Monzo (URL); O. Mayor (MTG-UPF); C. Goodman (PGP); R. Fach (DFT) This document reviews the partners‗ achievements in developing toolsets to meet or begin to answer these objectives. It looks in detail at each partners‗ current work to commercialise or disseminate their work and also records their future strategies and aspirations for continued commercialisation or, for some academic partners, further research.

D12.2.1 - Detailed Demonstration Plan for the Second 18-Month Period C. Goodman (PGP); J. Tenhunen (TAIK); G. de Vilar (AM); M. Matthews (BLITZ) This deliverable states the plans for the second eighteen month period of SALERO in which both the available technologies and experimental productions resulting from those technologies will be demonstrated to conferences, trade fairs, relevant trade associations and appropriate commercial or prospective commercial partners.

D12.2.2 - Second Report on Commercialization and Marketing Activities and Detailed Demonstration Plan for PM37-48 F. Andreu, G. Vilar, S. Miarnau (AM), R. Fach (GVG), M. Yan (DTS), O. Mayor (UPF), G. Kienast (JRS), C. Cullen (DIT), C. Goodman (PGP), M. Matthews (BLITZ), I. Iriondo (URL), T. Stolt (TAIK) This deliverable has two separated parts. The first one is the report on commercialization and marketing activities, and the second one, is the demonstration plan for the PM 37-48. For the report on commercialization and marketing activities, it has been explained how the SALERO results have affected the marketing plan of the commercial partners. It also describes the innovation in the commercial products and the different activities that have been carried out during the period, regarding commercialization as well as marketing. This deliverable states the plans for the next and final twelve month period of the SALERO in which both the technologies and experimental productions resulting from those technologies will be demonstrated to conferences, trade fairs, relevant trade associations and appropriate commercial or prospective commercial partners.