We are conducting research, development, and evaluation of work in both 3D display and sensing, initially aimed at Mixed/Augmented Reality-based live-virtual training, but with potential for broader impact. The first component of the work focuses on creating physically present virtual humans in 3D, without the need for HMDs or special time/phase/wavelength glasses. The second component of the work centers on a new idea for hybrid global/body-relative and cooperative estimation of full kinematic body and weapon posture, supporting multiple individuals working in close proximity during training exercises, for both kinetic and non-kinetic scenarios. This muti-institution research effort incorporates two distinct research activities that will be organized at the NPS MOVES Institute. One activity is aimed at obtaining a thorough understanding of a relevant training domain, its actors, and their specific needs (both current and projected); the domains include tactical cultural awareness training, urban warfighting (indoor and outdoor), fire drills on ships, and submarines. The second activity includes a series of user investigations on the basic elements of users acting in related environment in the context of the 3D display and sensing efforts. The latter includes a series of technology related user studies and conducting usability investigations, studies of sense of presence, and subjective acceptance of several different modalities of virtual 3D humans.

 

References

Murray N, et al: ACM Transactions on Multimedia Computing, Communications and Applications 3(4):1, 2007

Imai T, et al: Teleoperators & Virtual Environments 15(2): 123, 2006

 

key words

Virtual reality; Human factors; Game-based systems; Virtual training simulations; Domain analysis; Presence in VR;

Citizenship:  Open to U.S. citizens, permanent residents and non-U.S. citizens

Level:  Open to Postdoctoral and Senior applicants