IEEE Kansai Section第3回技術講演会

IEEE Kansai Section第3回技術講演会



``Natural Communication with Machines''


James L. Flanagan教授
(Rutgers大学副学長、CAIPセンター所長, IEEE Fellow)

日時(Time & Date)

2000年3月3日(金) 13:30~15:00


NTTコミュニケーション科学基礎研究所 大会議室
〒619-0237 京都府相楽郡精華町光台2-4
Tel: 0774-93-5010
Fax: 0774-95-5015


Pervasive digital networking promises to bring the power of distributed computing to a broad sector of society. Concomitant is the extension of human intellect through sophisticated communication and computer-mediated collaboration. But mass deployment depends upon ease-of-use ---being able to communicate with machines in ways the human finds convenient. Sensory modalities of sight, sound and touch are favored. Hence, there is strong incentive to emulate the naturalness of face-to-face information exchange in the design of user interfaces.
Individual technologies for human/machine communication, though imperfect, have advanced to a stage where they can be profitably integrated to produce capabilities that go substantially beyond traditional mouse and keyboard. Eye tracking, visual gesture and "region-of-interest" segmentation provide new dimensions of control in the sight domain. Automatic speech recognition and text-to-speech synthesis give interactive conversational ability to machines. And, tactile force-feedback and manual gesture enable natural grasp and movement of icons in shared workspaces. Intelligent software agents are becoming adept at fusing these simultaneous sensory inputs into reliable estimates of user intent ---as the human does in face-to-face exchanges.
As these multimodal interfaces evolve, the need emerges to establish metrics to evaluate their effectiveness. Specific application scenarios are required which are transportable and reproducible. An optimum multimodal design is generally application-specific, and a methodology that quantifies advantageous configurations is an ingredient to mass deployment.
This report describes a real-time laboratory prototype system, networked on dedicated ATM transport, in which multiple interface modalities are implemented for sight, sound and touch communication. The system incorporates an automatic face-finder and a desk-mounted eye tracker for visual control of screen cursors; a microphone array for "hands free" sound capture and speech recognition and synthesis for conversational interaction; and a tactile force-feedback glove for gesture control and grasp of displayed objects. Two collaborative application scenarios are illustrated: one for civil preparedness and crisis management, and one for telemedicine and remote medical diagnoses. Data from initial human factors evaluations are reported and compared against baselines for mouse and keyboard. Two video tapes supplement the presentation and are used to demonstrate operation of the system and the synergies stemming from fusing simultaneous multisensory user inputs.


James Flanagan is Vice President of Research, Rutgers University, N.J., Director of the Center for Computer Aids for Industrial Productivity (CAIP), and is Board of Governors Professor in Electrical and Computer Engineering. CAIP is an Advanced Technology Center sponsored jointly by industry and government. It conducts research in parallel and distributed computing, image and speech processing, graphics and data visualization, human/machine communications, robotics, and software engineering.
Flanagan joined Rutgers University in 1990 after serving in a variety of research and research management positions at AT&T Bell Laboratories. He was previously Director of the Information Principles Research Laboratory, with responsibilities in digital communications and information systems. Flanagan holds the ScD degree in Electrical Engineering from the Massachusetts Institute of Technology. He has specialized in voice communications, computer techniques and electroacoustic systems, and has authored approximately 150 papers, 2 books, and 45 patents in these fields.
Flanagan is a Fellow of the IEEE and of the Acoustical Society of America. He has received technical awards which include the IEEE Edison Medal, the Medal of the European Speech Communication Association, the L. M. Ericsson International Prize in Telecommunications, presented by the King of Sweden, and the Acoustical Society Gold Medal. He is a member of the National Academy of Engineering and of the National Academy of Sciences.

参加費 (Fee)

無料 (Free)

参加申込み先 (Contact for registration)

619-288 京都府相楽郡精華町光台2-2
Yumiko Honjo (ATR MIS Labs.)
Tel: (0774) 95 1404
Fax: (0774) 95 1408

本件連絡先 (For further information)

IEEE Kansai Section Technical Program Committee Secretary
間瀬 健二(ATR知能映像通信研究所)


Copyright© IEEE Kansai Section All Rights Reserved