Physically Immersive Video Gaming

1. Physically Immersive Video Gaming Sergio Haro Ceryen Tan Paul Steiner = ???

2. Can you be Mario? ? =

3. System Overview

4. Wireless Module • Transmits measurements from accelerometers • and gyroscope to FPGAs

5. CC1010 • 900 MHz, up to 76.8 kb/s

6. CC1010 • 900 MHz, up to 76.8 kb/s • 1 kb/s minus overhead

7. CC1010 • 900 MHz, up to 76.8 kb/s • 1 kb/s minus overhead • Embedded 8051 microcontroller

8. CC1010 • 900 MHz, up to 76.8 kb/s • 1 kb/s minus overhead • Embedded 8051 microcontroller • 3 channel 8-bit ADC

9. Block Diagram

10. Signal Processing Three Tasks • Distribute Data to proper places • Detect motions • Infer Actions

11. Signal Processing

12. Signal Processing • Based on Changes • Subject to RF constraints

13. Keyboard Interface • Convert actions into keyboard strokes

14. Keyboard Interface • Convert actions into keyboard strokes • Use keyboard strokes to play computer games

15. Keyboard Interface • Convert actions into keyboard strokes • Use keyboard strokes to play computer games • Two modules • KeyMapper – Maps actions into scancodes • PS/2 interface – Sends scancodes to computer

16. KeyMapper • Maps actions into scancodes

17. KeyMapper • Maps actions into scancodes • Programmable

18. KeyMapper • Maps actions into scancodes • Programmable • Test mode

19. KeyMapper Main_Menu enable menu_select enable enable Test_Mode Control_FSM Program_Menu return return enable return action next_key keymap KeyMapper KeyMap actions[5:0] keycodes keycode[15:0]

20. PS/2 Keyboard Interface • Take mapped scancodes and send them to the computer • Packets of 11-12 bits • 1 start bit • 8 data bits (scancode) • 1 parity bit • 1 stop bit • 1 acknowledge bit

21. PS/2 Keyboard Interface

22. PS/2 Keyboard Interface Device to Host communication Host to Device communication

23. PS/2 Keyboard Interface

24. Questions?