Kazuhiko HAMAMOTO Dept. of Information Media Technology,

1. Spatiotemporal Information ProcessingNo.7Information-oriented real spaceAugmented Reality and wearable computer～What is brought by miniaturization of computer～ Kazuhiko HAMAMOTO Dept. of Information Media Technology, School of Information and Telecommunication Eng., Tokai University, Japan

2. Today’s Contents • Mixed Reality • What is brought by miniaturization of computer ? • Qualitative transition by wearable computer • Wearable computer and AR

3. Mixed Reality • Mixture of virtual environment and real environment • To get augmented information which cannot be got in only one environment • Augmented Reality • Real space is augmented by virtual infor. • Augmented Virtuality • Virtual space is augmented by real infor.

4. What is brought by miniaturization of computer ? • Ability of computer • 100 times – 1000 times in 10 years • The same spec. in a smaller computer • “Miniaturization” = “quantitative transition” • “Mobile” = “qualitative transition” • Computer is spread over the space • Information occurs anywhere • Information is processed at its position. • The process is “natural”. It can be realized. Information – oriented real space

5. What is brought by miniaturization of computer ? • Computer is spread over the space. • Release of “zoning” of time and space • What is “spatiotemporal zoning” ? • To keep “specialized space” and “scheduled time” for a purpose. • Phone call at “telephone box” • Go to a factory and work

6. What is brought by miniaturization of computer ? • What is realized by “release of spatiotemporal zoning” ? • If a space is connected to another space, • Either of spaces should be a space which has special information • Classroom – field, laboratory, etc. • Keyword = mobile, wearable

7. What is brought by miniaturization of computer ? • Essence of miniaturization = integration of computer and human body • Computer, as a device which augments physical ability • “institutional” -> “personal” -> “intimate” by A.Kay

8. What is brought by miniaturization of computer ? • What is “intimate computer” ? • A computer has a deep relationship with individual information. • The computer doesn’t work, even if other person wants to use it. • The computer is unified with an individual.

9. What is brought by miniaturization of computer ? • “Intimate” and “human interface” • Man – machine interface • 1st interface • Human body – artificial object (machine) • 2nd interface • Surface between computer and network • Surface between OS and application • “Intimate” means “interface is shifted to machine side” • 1st interface is integrated into human body

10. What is brought by miniaturization of computer ? network OS・device driver application 1st interface 2nd interface Physical interface System - user More conceptual level interface “Intimate” means interface is shifted to machine. 1st interface is internalized into human body.

11. What is brought by miniaturization of computer ? Conventional human interface Task management Efficiency Organized by average value ・ human action is decomposed into basic action component ・standard working schedule is assigned. ・ work and schedule simulation is possible. Subdivision of work and shcedule Mixture of semantics Standardization is difficult.

12. What is brought by miniaturization of computer ? Next generation human interface （for intimate device） ・adaptation to diversity of individual ・no standardization on 1st interface ・standardization on 2nd interface ・intimate device is a new uniform ・the uniform can be operated by “wearing it” ・there is network protocol outside the uniform

13. What is brought by miniaturization of computer ? Institutional Personal Intimate Implant Wearable computer ・ Its metaphor is “cloth” ・When a man wears computer, he / she can join network society 　（When a man wears clothes, he / she can go out public society） The famous professor, Dr. Masahiko Tsukamoto

14. Qualitative transition by wearable computer • Always ON • Because of subdivision of period of use. • “Task unit” becomes very small. • An interface which can be used with another work is needed. • Hands free interface • Sound interface • One-hand operation keyboard (for example, mobile phone) • Unconscious interface • Unconscious input by GPS, RFID, etc.

15. Qualitative transition by wearable computer • Meaning of GPS interface Question From here to Tokai U., how long does it take ? From Here If No “from here” Unconscious input of Position by GPS Wide retrieve area Despite no perceived input Narrow retrieve area 10min Hon-atsugi 1hour 10min shinjuku 4 hours Fukuoka 4hours half Hokkaido From here 30 min. 9hours Bangkok ?

16. Qualitative transition by wearable computer • The meaning of GPS interface • Huge capacity information compression is realized • For example, the difference between mobile phone mail and conventional mail • Mobile phone mail is usually shorter than conventional mail. • A new media develops a new culture, its original style as time passes.

17. Wearable computer and AR • Use with GPS, gyro, ubiquitous computing, or environment-embedded computer. • Information of an object in front of eyes is displayed in real space • Information of a building or encyclopedia information such as view or flower • Superimpose work manual on work area • Life log • Position information with GPS and RFID, for not only outside but inside building • Information-oriented real space

18. Application of AR with GPS and Gyro GPS, Gyro • Measurement of position and direction of viewpoint • Computer has a database of the town • When use looks up at a building, the information of the building is displayed MicroDisplay computer

19. GPS ForestField Science Education GPS • User has PDA with GPS and Wi-Fi • User can know a position of user-own position (navigation). • User can walk though no road in woods • User can get information related to user’s position (contents). • For example, user can learn what tree it is. PDA

20. GPS Forest : SystemField Science Education user GPS Wireless LAN server forest

21. GPS Forest : NavigationField Science Education user GPS PDA

22. GPS Forest : ContentsField Science Education GPS Hot Spot

23. GPS Forest : ContentsField Science Education

24. What is brought by miniaturization of computer ? New service of Rakuten travel（2009.12.2） ・User can see hotel information by iPhone, Air Tag ・User can book a room directly from the Air Tag http://japan.cnet.com/mobile/story/0,3800078151,20388457,00.htm http://japan.internet.com/busnews/20091202/15.html?rss

25. Application of AR with GPS and RFID Outside Use of GPS information Inside Use of RFID and pedometer Nara Institute of Science and Technology

26. Life Log : record of experience • User who wears wearable computer with camera, microphone and various sensors can record use-own experience unconsciously. • If 8 hours a day, the resolution is not so high, required capacity is 10Tbytes in 70 years. • What do you want to use it for ? • A sense of experience can be analyzed quantitatively • The subjective experience is analyzed quantitatively. • Multiple person can have the experience in common.

27. Life Log : record of experience Body temperature, beat rate, air temperature, humidity are measured and recorded and the correlation among these experience.

28. Information-oriented real spaceexperiment space for barrier free in Univ. of Tokyo • 1300 active RFID Tags are embedded in floor of 1700 m2, in pitch of 1.2m • Each tag has own ID and sends information every 0.2 second • User with wearable computer and antenna for RFID tag can be detected in real time. The resolution is less than 1m. • Hot spot is set every 5m • Some hot spots have network camera and record and analyze spatiotemporal information in real time

29. Information-oriented real spaceexperiment space for barrier free in Univ. of Tokyo

30. Information-oriented real spaceexperiment space for barrier free in Univ. of Tokyo • Navigation for deaf-blindness person • Active studded paving block to aid the blind • Not only user information but environment information is also obtained in real time. • Leading path is decided every 100ms. • The decided path is transmitted to user by the special device. Wearable computer for user Finger-braille interface

31. Information-oriented real spacea plan of area-exhibition in the 2005 World Exposition • A plan of exhibition system which doesn’t use “building” • The real space (natural space) is used for exhibition space for ecology • User can access information by using wearable computer and HMD. • It couldn’t be realized due to the cost of devices, quality of information and the sense of incompatibility about “wearing anything”

32. Information-oriented real spacea plan of area-exhibition in the 2005 World Exposition