The system consists of three modules: natural language interpretation based on information extraction (IE) methods; a planning module that produces a geometric description of the accident; and finally a visualization module that uses Java3D to render the geometric description as animated graphics.
We performed a small user study to evaluate the quality of the visualization. The results validate our choice of methods; and since this is the first evaluation of a text-to-scene conversion system; they also provide a baseline for further studies.
CR Categories: H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems‚ÄĒAnimations; I.2.7 [Artificial Intelligence]: Natural Language Processing‚ÄĒText Analysis; I.2.8 [Artificial Intelligence]: Problem Solving; Control Methods; and Search‚ÄĒPlan execution; formation; and generation
Keywords: Text-to-scene conversion; 3D graphics; natural language processing
SIGRAD 2005 The Annual SIGRAD Conference Special Theme - Mobile Graphics
ADORNI; G.; MANZO; M. D.; AND GIUNCHIGLIA; F. 1984. Natural language driven image generation. In Proceedings of COLING 84; 495‚Äď500.
ARENS; M.; OTTLIK; A.; AND NAGEL; H.-H. 2002. Natural language texts for a cognitive vision system. In ECAI2002; Proceedings of the 15th European Conference on Artificial Intelligence; F. van Harmelen; Ed.
CARLBERGER; J.; AND KANN; V. 1999. Implementing an efficient part-of-speech tagger. Software Practice and Experience 29; 815‚Äď832.
COYNE; B.; AND SPROAT; R. 2001. WordsEye: An automatic text-to-scene conversion system. In Proceedings of the Siggraph Conference.
DUPUY; S.; EGGES; A.; LEGENDRE; V.; AND NUGUES; P. 2001. Generating a 3D simulation of a car accident from a written description in natural language: The Carsim system. In ACL2001: Workshop on Temporal and Spatial Information Processing; 1‚Äď8.
JOHANSSON; R.; BERGLUND; A.; DANIELSSON; M.; AND NUGUES; P. 2005. Automatic text-to-scene conversion in the traffic accident domain. In IJCAI-05; Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence; 1073‚Äď1078.