topical media & game development
part iii. multimedia information retrieval
.. my history might well be your future ...
In the following chapters we will discuss how
we can make the various media formats,
including text, images, audio and video
amenable to search, either by analyzing content
or by providing explicit meta information.
For video, in particular, we develop a simple
annotation logic that captures both the story line
and the actors, that is persons and objects, that
figure in it.
Essential sections are section 5.1, that characterizes
scenarios for information retrieval,
section 5.3, that introduces standard information retrieval
concepts stemming from text search,
section 6.4, that defines the aforementioned annotation logic,
and section 7.2, that gives an outline of an abstract
multimedia data format.
Section 6.3 is rather technical and may safely be skipped.
Also sections 5.2, 6.1 and 7.3 may be skipped on first reading.
Apart from the many technical issues in information retrieval,
perhaps the human interaction issues are the most urgent.
As possible perspectives to look at these issues.
perspectives -- multimedia information retrieval
- application(s) -- digital dossier
- psychological -- focus
- experimental -- user interaction
- algorithmic -- (information) access
- system -- unified presentation space
- presentation -- embodied agents
- search -- semantic annotation
- commercial -- future systems
As you will see in the research directions
given for each section,
there are many proposals
to improve interaction,
for example the use of 3D virtual environments
as an alternative way of presenting information.
For further study you may want to look at
algorithms for analyzing content,
annotation schemes for pareticular application domains,
or the presentation issues mentioned before.
Possible essay titles are:
Since the retrieval problem seems to be rather
intractable in a general fashion,
you should limit your discussion to a specific
domain, for example retrieval in the domain of cultural heritage,
and relate technical issues to the requirements of users in that
- searching the web -- searching for images, video and sound
- finding a tune -- mobile music search services
- kata -- japanese martial arts picture.
- signs -- japanese coats of arms, [Signs], p. 140, 141.
- photographs -- Jaap Stahlie, two early experiments (left, and right)
You may not copy or print any of this material without explicit permission of the author or the publisher.
In case of other copyright issues, contact the author.