Augmented Reality Real-time Drawing Application

Posted on December 26, 2022 ·

Augmented Reality (AR) is a technology that can combine real and virtual objects. Interaction is essential in AR, allowing the user to interact with a virtual object in the natural environment. There is various type of gesture interaction that can be applied in AR. Drawing space can also be related to AR technology with the use of provided gesture interaction. The use of gesture interaction in drawing space has become a popular topic among researchers to apply this concept to AR technology by using bare hands to interact directly with AR. However, the visual and spatial complexity of the canvas requires rethinking how to develop a real-time drawing canvas for AR using real hand gestures on a handheld device. The compatibility to convert from traditional drawing into digital drawing space and the use of hand gestures as input is challenging. Therefore, this paper will discuss the designing and development process to actualize the real-time drawing in handheld AR using the user’s real hand.

Read more : https://ieeexplore.ieee.org/abstract/document/9666439

AR Drawing on handheld device with leap motion
human-teleportation-in-XR
mr-meet-mixed-reality
More recent project
Filed Under: Augmented Reality, Extended Reality, Mixed Reality

Human Teleportation in Extended Reality (xR) application

Posted on December 26, 2022 ·

Extended Reality (xR) encapsulates various computer-altered reality technologies that cover virtual reality (VR), augmented reality (AR), and mixed reality (MR). xR is a technology that merges a virtual element into the real-world with the aims to enhance reality on the virtual world immerse onto real-world space. xR has been improved from time to time as the advanced immersive technologies to extend the reality we experience by either combining the virtual and real worlds or by generating a fully immersive experience. Remote collaboration in xR is a challenge since both parties need to have the same system and to set to parallel to xR environments. In a collaborative interface context, the user can be in a remote collaboration or face-to-face to sense the immersive environment. Human teleportation is transferring a human from a local location to a remote location, where the reconstruction of a human appears in a realistic visual representation. However, creating a fully realistic representation of the human figure need a complex 3D reconstruction method. Therefore, the paper describes the human teleportation in the xR environment using the advanced RGB-D sensor devices. It explains the phases to develop the real human teleportation in xR.

Read more : https://iopscience.iop.org/article/10.1088/1757-899X/979/1/012005/pdf

Urban Planning Case Study

More posts

Filed Under: Augmented Reality, Extended Reality, Mixed Reality

MR-MEET: Mixed Reality Collaborative Interface for HMD and Handheld Users

Posted on December 26, 2022 ·

Mixed Reality (MR) collaborative interface allows remote collaboration between an HMD (Head Mounted Display) user in Virtual Reality (VR) and a non-HMD user in Augmented Reality (AR). Both users to have a meeting with each other despite the distance between one another. It enables users to interact in a virtual environment that can replace the traditional way of physical meeting by using appropriate collaborative tools. However, the problem arises when the user is far apart from each other and needs an effective way or tools to collaborate. This paper discusses about a collaborative tool and proposed a prototype called MR-Meet as a collaborative MR interface. MR-Meet has been designed with a tool that can aid both users from different settings to work together. It provides the designing stage to actualize MR collaborative interface with two basic tools such as sticky notes and a whiteboard to help distant …

Read more : https://ieeexplore.ieee.org/abstract/document/9938307

Filed Under: Augmented Reality, Mixed Reality Tagged With: ,

Questions about VR, AR and MR

Posted on December 10, 2018 ·

** this questions are being discussed with my students during the Real-time Computer Graphics course.

What is 6DOF VR? How to develop in mobile HMD such as using mobile VR headset with controller?

  • 3 degrees of freedom: pitch, yaw, and roll. Thus, 3 types of translation + 3 types of rotation = 6 DOF! There are 2 ‘directions’ in which an object is free to move inside any particular DOF. The 6 DOF will have forward/back, up/down, left/right, yaw, pitch, roll.
  • Mobile HMD using Google Cardboard – make sure your mobile’s specification and requirement good to go for VR. Reconsider the resolution, refresh rate (higher is the smoother the image will be), and field of view (it should be around 100 degree).
  • Controller if it was an external hardware not customize / built-in with mobile, you may require several method to integrate them. For example sending the event handler (button is press) to your mobile VR apk apps, you may need network protocol to retrieve, send or receive the action from controller to your apk.

What the difference between Mixed Reality (MR) and Extended Reality (XR)?

  • XR consists of VR, AR and MR technologies on how to extend, improve our reality using these technologies. MR is a technology we can use to extend reality, it reacts and responds to real world.

360 degree Live Video is it considering as VR?

  • The basis behind the argument is viewing with Google Cardboard are really cool, but they’re not VR. Looking at photos on Flickr VR is really cool; also not VR. VR headset, you can feel immersive and presence it runs in real-time – 360 degree video is not the same thing as VR and you can watch most of these videos and photos on a regular flat 2D screen.

Nowadays, VR headset often need cable connected to the PC. If we go wireless, what are the limitation?

  • Freeing users from wires will give them a truly immersive experience, connect with wire limits your walking range and can get caught under your feet. To answer your questions – until today it was considered near-impossible to wirelessly stream vast amounts of data to a VR headset . Existing wireless systems such as Wi-Fi cannot support this transfer data rate, and trying to compress the video stream so it fits into the available bandwidth takes a few milliseconds, which can make users feel sick. The range of anything approaching real-world conditions limit to wireless connection. Other attempts to put everything into the headset.

Sekarang, hardware untuk VR/MR mahal dsb..How long before technology ini menjadi sesuatu yang affordable and accessible untuk kegunaan orang ramai? (Translation – Nowadays VR/MR hardware expensive, how long before this technology becomes affordable and accessible to public usage?)

  • How long it may take – perhaps when it comes to entering the mainstream and transforming lives, it will become cheaper, may be given for free with selling VR product/package and when comes to mainstream it was ready to most everyone can have it same as smartphone, bluetooth, and external drive – accommodate almost everyone today. Headset VR is available in various type but there’s no great reason to buy a headset yet even they are selling in affordable price.
Filed Under: Augmented Reality, Mixed Reality, Teaching, Virtual Reality