Personal Automated Sleeping Helper Using IoT

Nor Azman Ismail, Noor Adiba Shahrina Johan Shah, Muhammad Fikri Mohamad Samsi, Azam Firdaus Ahmad Yaziz, Ar-Rabbani Amanullah Mohd Nazari

Faculty of Computing, Universiti Teknologi Malaysia

Abstract

This study addresses to what devices can be invented to makes a better lifestyle for living. A smart pillow has been proposed to wake users up from sleep instead of having an external alarm clock or mobile phone as alarm clock. This devices containing vibrator as the source of vibration for the waking up process. Experiments show that users are sensitive with sense of vibration. Futher, experiments show that vibration can improve user’s positive response. Thus, we are providing an external compartment outside the pillow consisting all the main devices. Those compartment is connected to the vibrator in the pillow through a wire sealed by a zipper. Vibration alarm wil be functioning when the main device is activated.

Introduction

Roughly the purpose of the pillow is to waking up a user from sleep. The pillow provided with vibrator alarm and buzzer. The device is located inside the pillow and connected with vibrator and buzzer. Those devices are located in some compartment, depends on the good position of those devices. The vibrator and buzzer are connected and the operation is followed by alarm clock and sensor. Thus, if the user lie down to the pillow, the sensor will be work. Moreover, the user can set the vibrator alarm through the alarm clock set. Thus the vibrating device and the buzzer are electrically connected to the alarm clock so that the alarm clock activates the vibrating device and sound when an alarm of the alarm device is activated.

A Hybrid Mobile Application for Real-Time In-Campus University Bus Tracking System

Nor Azman Ismail, Mohd Shafri Amir Mohd Sharif, Muhammad Irsyad Kamil Riadz, Mohd Sufi Mohd Suhaimi, Nurul Nazihah Jamal

Faculty of Computing, Universiti Teknologi Malaysia

Abstract

This site presents the architecture and implementation of an application that can track living things or non-living things. Our system is focused on tracking a vehicle in campus University. Among all vehicle services, bus service is the main transportation used by university students. Nowadays, university buses have a very poor service. The bus accuracy and functionality are crucial for the users. We also describe our proposed prototype, a Hybrid Mobile Application for Real-Time In-Campus University Bus Tracking system that enables students and staff members on knowing the time estimation and the location of university buses by implementing the Global Positioning System (GPS) and Google APIs. Besides that, our objective is to improvise the bus services to a new level. We are creating a platform which will ease the students and staff members’ movement.


Figure 1.0: UTM bus tracker prototype

Video 1.0: UTM bus tracker prototype

 

 

 

 

 

IoT-Based Light Control for University Lecture Room

Nor Azman Ismail, Muhammad Faris Akmar Abdul Mutalib, Fikri Haziq Azman, Naufal Azim Yusof, Muhammad Al Fateh Mohammad Hizal.

Faculty of Computing, Universiti Teknologi Malaysia

Abstract

The IoT or Internet of Things allow expenditure of creativity and the world of technology being explored by everyone thus making all kinds of smart devices to be created. The inter-networking of connected devices comprise of embedded electronics, sensors and network connectivity, allowing an exchange of data which lead to a look or step of what our future may look like. Making full use of this is vital in ensuring not being left behind by the advancement of technology.

Introduction

Currently, the lecture rooms are using physical switches to toggle the light appliances and apparently, the students or staffs tend to forget to switch off the lights of the rooms before going out. Therefore, a smart system is proposed by using Arduino as the microprocessor of the product to allow the staffs to monitor all the light appliances through the ENVIO mobile application. The light appliances of each lecture room can be controlled by using speech recognition to toggle the current light status on or off. This will bring a new way of smart appliances and innovation to the lecture rooms in universities. Despite that, this innovation will also help to the university to avoid electrical energy being wasted.

ENVIO Mobile Application

System Architecture & Lecture Room Floor Plan

Video

 

PhD Viva of Dr Zeyad from Iraq

Congratulation Dr. Zeyad Al Mamary! With Prof Dr. Naomie Salim and Assoc Prof Dr Shahrizal Sunar

University Live Poster

Nor Azman Ismail,Muhammad Thaqif Bin Mohd Yusoff, Muhamad Syarafi Iqbal Bin Norashikin, Awangku Muhammad Affif Omar Bin Awang Raduan, Muhamad Naqib Bin Bokhari.

Faculty of Computing, Universiti Teknologi Malaysia

Abstract

In augmented reality (AR) systems, graphics video or texts are added to the real scene to improve the user experience. Real information and virtual must be aligned strictly in the combination of scenes. The key of augmented reality is 3D registration technology which is based on tracking the artificial marker. Using linear programming theory, this paper presents a tracking method which can recognize the market that we have set in the programming.

Introduction

UTM Live Poster is a mobile application that enables user to view videos by using their mobile devices on an image tracker, thus creating a live poster effect. The application is delivered through mobile-based application which allows users to hover their mobile device’s camera through the application onto the image tracker where a video would then play automatically by using Augmented Reality technology. The application is aimed to create an engaging effect towards the users where they can get more information on the pictures that act as markers, as well as to promote Universiti Teknologi Malaysia.

Video

Usability Study of Kitchen app with Multimodal Interaction Among Beginner & Intermediate Cookers

Nor Azman Ismail, Nor Azrini Jaafar, Masitah Ghazali, Nurul Aiman Ab. Majid, Nur Zurriyyati Imani Zamri and Yohgamalar Naidu Gunasegaran

Department of Software Engineering, Faculty of Computing, Universiti Teknologi Malaysia

Abstract

This project presents the usability study of a cooking application, KitchenGeek with a wearable device, Smart M between two user groups, beginner and intermediate cookers to test if the application and device lowers the gap of time taken for both of the user groups to complete the cooking tasks. The results of this paper indicates that KitchenGeek and Smart M did lower the gap of time taken for task completion and it helps beginners to cook better than not being able to cook at all. An independent-samples t-test was conducted to compare the score of beginner and intermediate groups of cooker. The result shows that there was no significant difference in time taken to complete all cooking tasks for beginner and intermediate group of cookers (p= 0.85). This research suggests that beginners should use KitchenGeek and Smart M to improve their cooking skills and they will be able to cook at the same rate as intermediate cookers.

KitchenGeek Equipment

Our equipment are KitchenGeek Application on a smartphone using Android platform and Smart M, a wearable technology. KitchenGeek application is a mobile application that has a database of dish recipes along with the instruction on how to cook the dishes. Other than that, user can also create their profile to save and rate recipes as well as post their own recipes on social media. Smart M is a wearable device, inspired from a Kinect Technology that allows user to control the app through hand gestures and voice technology. It is equipped with IR Emitter and IR Sensor that senses hand gestures, Touchpad that allows user to scroll or click, Speakers for user to listen to recipes, Camera that detect hand gestures and Microphone that allows user to say out the dish name or the ingredients name.

Paper: Usability Study of Kitchen app with Multimodal Interaction Among Beginner & Intermediate Cookers

Universiti Sains Islam Malaysia (USIM) Corporate Comm. Strategic Visit

Meeting with our counterpart from Universiti Sains Islam Malaysia (USIM).
Our relationship (UTM-USIM Corporate Communication) is getting closer with the
existence of an event like this. In Photo with Dr Faizal and Mohd Asri from USIM

image

image

Enhancing Research Impact and Visibility Forum (9th and 10th August 2017)

Meet the invitation as keynote speaker and panellist in the forum on Enhancing Research Impact 
and Visibility at Universiti Teknologi Petronas (UTP). In photo with UTP Deputy VC (Research &
Innovation), Registrar, Dean of Graduate Studies, Library Senior Manager, Senior Executive and
my Inspiring leader Prof Dr.
Ahmad Kamal Idris
Image may contain: 1 person, standing
Image may contain: 7 people, people sitting

Viva Success: Riyad Hassouneh, Faculty of Computing

Congratulations to Riyad Hassouneh Ali-Rousan who have passed his PhD viva with minor corrections on 25 May 2017. His thesis was on “Non Photorealistic Rendering” supervised by Associate Professor Dr. Shahrizal Sunar (see his video presentation).

The external examiner was Professor Dr. Rahmita Wirza O.K Rahmat (Universiti Putra Malaysia), and the internal examiners was Associate Professor Dr. Nor Azman Ismail. The viva session was chaired by Professor Dr. Mat Uzir Wahit and recorded by Dr. Norhaida Suaib.

Find out more about the Faculty of Computing at the Universiti Teknologi Malaysia (UTM).

2Riyad phd viva

 

Journal Papers

Journal Papers

  1. Yen Lee Choo, Nor Azman Ismail and Yee Yong Pang (2016). Ability Of Children To Draw Mathematical Numbers Through Computer Mouse, Research Journal of Applied Sciences, Engineering and Technology 13(1): 1-6.
  2. Ismail, N. A., & Pang, Y. Y. (2015). A multimodal interaction for map navigation and evaluation study of its usability. ARPN Journal of Engineering and Applied Sciences, 10(23), 17962-17970.
  3. Jaafar, N. A., Ismail, N. A., & Yusoff, Y. A. (2015). An investigation of motion tracking for solat movement with dual sensor approach. ARPN Journal of Engineering and Applied Sciences, 10(23), 17981-17986
  4. Hui Hui Wang, Dzulkifli Mohamad, N.A Ismail (2012). An Efficient Parameters Selection for Object Recognition Based Colour Features in Traffic Image Retrieval. International Arab Journal of Information Technology (IAJIT) [Full paper]
  5. Hui Hui Wang, Dzulkifli Mohamad, N.A Ismail (2010). Semantic Gap in CBIR: Automatic Objects Spatial relationships Semantic Extraction and Representation. International Journal of Image Processing (IJIP). Vol.4. Issue 3 [Full paper]
  6. Hui Hui Wang, Dzulkifli Mohamad, N.A Ismail (2010). Approaches, Challenges and Future Direction of Image Retrieval. Journal of Computing. Vol.2.Issue 6.June 2010 [Full paper]
  7. Gilbert Phuah Leong Siang, Nor Azman Ismail, Pang Yee Yong (2010). A Study on Potential of Integrating Multimodal Interaction into Musical Conducting Education. Journal of Computing, Volume 2, Issue 5, ISSN 2151-9617, pp48-52 [Full Paper]
  8. Ramlan, S. A. and Ismail, N. A. (2010). A Study of User’s Performance And Satisfaction on The Web Based Photo Annotation With Speech Interaction. Journal of Computing, Volume 2, Issue 6, June 2010. (impact factor: 0.45)
  9. N.A. Ismail and Ann O’Brien, (2009). Web-Based Personal Digital Photo Collections: Multimodal Retrieval, IIUM Engineering Journal. Volume 10, Issue 1, ISSN: 1511- 788X, pp 40-53
  10. N.A. Ismail and Ann O’Brien, (2008). Flexphores : A Flexible Interaction for Web Based Personal Digital Photo Retrieval System, Jurnal Teknologi Maklumat, FSKSM, UTM, JTM, Jld. 18:2
  11. Siti Azura Ramlan, Nor Azman Ismail, Sharir Daut (2009). Small-Scale Evaluation of Photo Management: Understanding Users’ Needs. N. A. Ismail, N.Z. S. Othman, S. A. Ramlan. Advances in Human-Computer Interaction: Technology and Application (pp.1 –8). Johor Bahru, Malaysia: Penerbit Universiti Teknologi Malaysia.
  12. Siti Azura Ramlan, Nor Azman Ismail (2009). Bridging the Personal Digital Photo Annotation and Retrieval Gap in User Oriented Image Query. N. A. Ismail, N.Z. S. Othman, S. A. Ramlan. Advances in Human-Computer Interaction: Technology and Application (pp.9 –28). Johor Bahru, Malaysia: Penerbit Universiti Teknologi Malaysia.
  13. N. A. Ismail, A.O’Brien (2009). Incorporating Multimodal Interaction in Web Based Personal Digital Photo Retrieval System. N. A. Ismail, N.Z. S. Othman, S. A. Ramlan. Advances in Human-Computer Interaction: Technology and Application (pp.75 –98). Johor Bahru, Malaysia: Penerbit Universiti Teknologi Malaysia.
  14. N. A. Ismail, Siti Azura Ramlan (2009). Personal Digital Photo Annotation Using Multimodal Interaction, Advances in Speech Processing: Techniques and Technologies pp 38-55. Johor Bahru, Malaysia: Penerbit Universiti Teknologi Malaysia.

 

Conference Proceedings

1. Masitah Ghazali, Tetsuo Okamura, Taufiq Abdullah, Mohd Shahrizal Sunar and Nor Azman Ismail, (2016). In The Quest Of Defining Smart Digital City In Medini Iskandar Malaysia, Iskandar Puteri, Malaysia, SEACHI 2016 Proceedings of the SEACHI 2016 on Smart Cities for Better Living with HCI and UX, San Jose, CA, USA, May 07 – 12 Pages 19-23

2. Nor Azman Ismail, Nor Azrini Jaafar, Yusman Azimi Yusoff, Kamarul Azmi Jasmi, Abd. Khamim Ismail, Mohd Shahrul Hafiz Razak & Mohd Ismail Mustari, (2016). Solatlab: Identifying Salat Error With Cooperative Multisensor And Motion Recognition To Assist Muslims In Salat Movements, 7th Exposition on Islamic Innovation (i-INOVA) 2016, 8-9th November, USIM, Malaysia

3. Y. Y. Pang, N. A. Ismail (2015), Users’ Preferences for Map Navigation Gestures, ICCDVE 2015 : XIII International Conference on Collaborative Design, Visualization and Engineering Istanbul,Turkey Jan 26-27, 2015, pp 2636- 2642

4. Nor Azrini Jaafar and N. A. Ismail, (2013) A New Approach in Islamic Education: Computer Vision Based Techniques in Supporting Solat, 2nd International Conference on Interactive Digital Media (ICIDM 2013), Kuching, Malaysia.

5. Arif, A and N. A. Ismail (2012), Web Impact Factor for Malaysian Public Universities. 4th International Conference on Information and Multimedia Technology, Kuala Lumpur, Malaysia.

6. Qais Al-nuzaili, Dzulkifli Mohamad, N.A Ismail, (2012), Feature Extraction in Holistic Approach for Arabic Handwriting Recognition System: a preliminary study, IEEE 8th International Colloquium on Signal Processing & its Applications (CSPA 2012), 23- March 2012, Malacca. (Accepted)

7. Y.Y. Pang, N.A. Ismail, and P.L. Gilbert, (2010), A Real Time Vision-Based Hand Gesture Interaction, Fourth Asia International Conference on Mathematical/Analytical Modelling and Computer Simulation, 2010, Kota Kinabalu ,Sabah, pp. 237-242.

8. Ramlan, S. A. Daud, S. and Ismail, N. A. (2008). Group Annotation For Digital Photos Using Multimodal Interaction. Proceedings of the 4th International Conference on Information & Communication Technology and Systems (ICTS 2008). August 15. Surabaya, Indonesia

9. Ramlan, S. A. and Ismail, N. A. (2009). 4w’s Framework in Speech Photo Annotation. Proceedings of the 4th International Conference on Research and Innovation in Information Systems (ICRIIS2009). December 14, 2009. Johor Bahru, Malaysia.

10. Hui Hui Wang, Dzulkifli Mohamad, N.A Ismail. (2009) Image Retrieval : Techniques, Challenge, and Trend. The International Conference on Machine Vision, Image Processing, and Pattern Analysis. 25-27 December 2009, Bangkok, Thailand.

12. Hui Hui Wang, Dzulkifli Mohamad, N.A Ismail. (2010), Towards semantic based Image Retrieval : A Review. The 2nd International Conference on Digital Image Processing (ICDIP 2010) – 26-28 February 2010, Singapore. (ISI and Scopus indexed)

13. N.A. Ismail and O’Brien, E.A., (2008), Multimodal Interaction for Visual Example Searching in Web-Based Personal Digital Photo Repository, Proceedings of the 5th International Conference on Information Technology and Applications (ICITA 2008), Australia, June 2008. (ISI and Scopus indexed)

14. N.A. Ismail and O’Brien, E.A., (2008), Enabling Multimodal Interaction in Webbased Personal Digital Browsing Ismail, Proceedings of the 2nd International Conference on Computer and Communication Engineering (ICCCE08), Kuala Lumpur, IEEE Society, May 2008. (ISI and Scopus Indexed)

15. N.A. Ismail and O’Brien, E.A., Towards an understanding of user needs in organising and retrieving photos from personal digital photo collections, Innvoations Through Information Technology: proceedings of the 15th Information Resources Management Association International Conference, Khosrow-Pour, M. (ed), New Orleans, United State of America, May 2004, pp 2045-1047. (ISI Indexed)

10.N.A. Ismail and O’Brien, E.A., An investigation into how people organize their personal digital photo collections, Proceedings of the 2nd Malaysian Research Group Annual Conference (MRG-AC 2003), Manchester, United Kingdom, December 2003.

11.Aminah, N.A. Ismail, Noraniah & Hamidah, Web Based Learning Application: Basic Business Mathematics, International Conference on Computer in Education (ICCE), ICCE/SchoolNet 2001, Asia-Pacific of AACE, Korea, 15 November 2001.

12. Ramlan, S. A. Daud, S. And Ismail, N. A. (2008). Web-based Semi-Automatic Annotation for Digital Photographs Using Speech and Graphic User Interface. Proceedings of the 4th Postgraduate Anual Research Seminar (PARS’2009). Universiti Teknologi Malaysia,Johor Bahru, Malaysia

13. Gilbert Phuah Leong Siang, Nor Azman Ismail, Pang Yee Yong (2010). The Potential of Integrating Multimodal Interaction into Musical Conducting Education, Postgraduate Annual Research Seminar (PARS2010). Johor: Universiti Teknologi Malaysia.

14. N.A. Ismail, T. Jumail and H. C. Luan, Web-Based Content Based Image Retrieval (CBIR) using RGB color histogram techniques, Proceeding of The First National Conference on Computer Graphics and Multimedia (CoGRAMM02), Kuala Lumpur, 2002.

15. N.A. Ismail, Technology of Web 2.0: Web Design and Development, Conference of Web/Portal Management for Johor State Government, Johor Bahru, March 2007.

Books and Book Chapters

1. Md. Hafiz Selamat, Ali Selamat & Nor Azman Ismail, (2012) Human Computer Interaction, UTM Press (approved and waiting for publication process)

2. Nor Azman Ismail, Nur Zuraifah Syazrah Othman, Siti Azura Ramlan, (2008), Advances in Human-Computer interaction Technology and Application, ISBN:978- 983-52-0617-7

3. Abd Manan Ahmad, Nor Azman Ismail, Loh Mun Yee, Cheang Soo Yee, (2008), Advances in Speech Processing: Techniques and Technology, ISBN:978-983-52- 0628-3

4. Abd Manan Ahmad, Nor Azman Ismail, Loh Mun Yee, Cheang Soo Yee, (2008), Advances in Speaker Recognition: Techniques and Technology, ISBN:978-983-52- 0629-0

Technical Reports and Other Publications

1. Alia, Idiana Hamidi & N. A. Ismail, WordPress Content Management System Manual (2011), Universiti Teknologi Malaysia.

2. N. A. Ismail and M.R. Samingan, (2007), World Universities Ranking: Optimizing University Web Presence to Make More Visible and Useful to the Internet Users, Invited Lecture at Chancellery, Universiti Technologi Malaysia, January 2007

3. N. A. Ismail, (2007), Design and Development of Academic Webpage, Invited Lecture at Kolej Science and Technology (KST), Kuala Lumpur, May 2007

4. N.A. Ismail, (2002), Distributed Multimedia Interactive, Undergraduate Teaching Module, Faculty of Computer Science & Information System, Universiti Teknologi Malaysia.

5. N.A. Ismail, (2002), Planning and Development of Multimedia Application, Faculty of Computer Science & Information System, Universiti Teknologi Malaysia.

6. N.A. Ismail, (2001), The Role Of Computer Graphic & Multimedia In Education, Konvensyen Pendidikan 2001, UNIPEN, University Technology Malaysia, 7 November, 2001

7. Ghazali Sulong, Nor Azman Ismail, Dzulkifli Mohamad, Norhaida Mohd. Shuaib, Cik Suhaimi Yusof, Suriati Sadimon, Mohd Shahrizal Sunar, Sarudin Kari, Daut Daman (1999). Asas Grafik Komputer. Monograf, FSKSM, UTM

8. N.A. Ismail, (1999), Multimedia Computer Lab Management in Faculty of Computer Science & Information System, University Technology Malaysia, 1999