A mobile augmented reality-based assembly guidance application for LEGO

Anne Marielle Bagamaspad, John Israel Caingles, Kingston Anthony Koa, Juan Lorenzo Simeon, Conrado Ruiz

Producción científica: Capítulo del libroContribución a congreso/conferenciarevisión exhaustiva

2 Citas (Scopus)

Resumen

Usually LEGO structures are created by following an instruction manual in paper or digital form that depicts the LEGO model at different stages of assembly. Some instructions can be very complex and difficult to represent using plain illustrations. Consequently, this makes it difficult to follow and assemble a LEGO structure. Augmented reality (AR) is a technology that adds perceptual information into the physical world and it has recently been gaining popularity. This study explores the use of AR for assembly through ARGO, a mobile application for Android smartphones that serves as an assembly guide for LEGO structures. It can enhance instructions and provide more details that assist users during the construction process. The system can recognize the current step of the LEGO assembly using data captured via Microsoft Kinect while providing visual feedback through the mobile application. To identify the current step, the system obtains the color and depth data from the Kinect camera and converts the data into a point cloud. The point cloud undergoes segmentation to isolate the physical LEGO model and compares it to the point clouds of a preloaded model to check if the brick is placed correctly. The system was evaluated using 3 models and can recognize when to advance to the next step during assembly and estimate the orientation of the step differing an average angle of 48.27 degrees. For each step, it takes an average of a few seconds to decide on the recognition, leading to a short delay for the feedback to appear on the phone.

Idioma originalInglés
Título de la publicación alojadaMCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018
EditoresKatherine Blashki, Luis Rodrigues, Yingcai Xiao
EditorialIADIS
Páginas237-244
Número de páginas8
ISBN (versión impresa)9789898533791
EstadoPublicada - 2018
Publicado de forma externa
Evento12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018 - Madrid, Espana
Duración: 18 jul 201820 jul 2018

Serie de la publicación

NombreMCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018
Volumen2018-July

Conferencia

Conferencia12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018
País/TerritorioEspana
CiudadMadrid
Período18/07/1820/07/18

Huella

Profundice en los temas de investigación de 'A mobile augmented reality-based assembly guidance application for LEGO'. En conjunto forman una huella única.

Citar esto