Information retrieval for music and motion / Meinard Müller.
| Author/creator | Müller, Meinard |
| Format | Book |
| Publication Info | New York : Springer, 2007. |
| Description | xv, 313 pages : illustrations (some color) ; 24 cm |
| Subjects |
| Contents | Introduction. Music information retrieval ; Motion retrieval ; General concepts -- Part I. Analysis and retrieval techniques for music data. Fundamentals on music and audio data. Music representations ; Fourier transform ; Digital filters -- Pitch- and chroma-based audio features. Pitch features ; Local energy (STMSP) and onset features ; Chroma and CENS features ; Further notes -- Dynamic time warping. Classical DTW ; Variations of DTW ; Multiscale DTW ; Subsequence DTW ; Further notes -- Music synchronization. Synchronization tasks ; A multiscale approach to audio synchronization ; Onset-based score: audio synchronization ; Further notes -- Audio matching. Diagonal audio matching ; Experimental results for diagonal audio matching ; Codebook selection for CENS features ; Index-based audio matching ; Experimental results for index-based audio matching ; Further notes -- Audio structure analysis. General strategy and notation ; Enhancing similarity matrices ; Path extraction ; Global structure analysis ; Experiments ; Further notes -- SyncPlayer: an advanced audio player. Overview ; SyncPlayer server ; SyncPlayer client ; Further notes -- Part II. Analysis and retrieval techniques for motion data. Fundamentals on motion capture data. Motion capture data ; Similarity aspects ; Kinematic chains ; Rotations -- DTW-based motion comparison and retrieval. Local distance measures ; DTW-based motion warping ; Motion retrieval based on self-similarity ; Further notes -- Relational features and adaptive segmentation. Relational features ; Adaptive segmentation ; Further notes -- Index-based motion retrieval. Indexing, queries, and hits ; QBE motion retrieval ; Further applications ; Further notes -- Motion templates. Basic definitions and properties ; MT learning procedure: overview ; MT learning procedure: technical details ; Experimental results -- MT-Based motion annotation and retrieval. |
| Abstract | A general scenario that has attracted a lot of attention for multimedia information retrieval is based on the query-by-example paradigm: retrieve all documents from a database containing parts or aspects similar to a given data fragment. However, multimedia objects, even though they are similar from a structural or semantic viewpoint, often reveal significant spatial or temporal differences. This makes content-based multimedia retrieval a challenging research field with many unsolved problems. The author details concepts and algorithms for robust and efficient information retrieval by means of two different types of multimedia data: waveform-based music data and human motion data. In Part I, he discusses in depth several approaches in music information retrieval, in particular general strategies as well as efficient algorithms for music synchronization, audio matching, and audio structure analysis. He also shows how the analysis results can be used in an advanced audio player to facilitate additional retrieval and browsing functionality. In Part II, he introduces a general and unified framework for motion analysis, retrieval, and classification, highlighting the design of suitable features, the notion of similarity used to compare data streams, and data organization. The detailed chapters at the beginning of each part give consideration to the interdisciplinary character of this field, covering information science, digital signal processing, audio engineering, musicology, and computer graphics. This first monograph specializing in music and motion retrieval appeals to a wide audience, from students at the graduate level and lecturers to scientists working in the above mentioned fields in academia or industry. Lecturers and students will benefit from the didactic style, and each unit is suitable for stand-alone use in specialized graduate courses. Researchers will be interested in the detailed description of original research results and their application in real-world browsing and retrieval scenarios. |
| Bibliography note | Includes bibliographical references (pages 297-308) and index. |
| LCCN | 2007932401 |
| ISBN | 9783540740476 |
| ISBN | 3540740473 |