A mobile augmented reality-based assembly guidance application for LEGO

Anne Marielle Bagamaspad, John Israel Caingles, Kingston Anthony Koa, Juan Lorenzo Simeon, Conrado Ruiz

Producció científica: Capítol de llibreContribució a congrés/conferènciaAvaluat per experts

2 Cites (Scopus)

Resum

Usually LEGO structures are created by following an instruction manual in paper or digital form that depicts the LEGO model at different stages of assembly. Some instructions can be very complex and difficult to represent using plain illustrations. Consequently, this makes it difficult to follow and assemble a LEGO structure. Augmented reality (AR) is a technology that adds perceptual information into the physical world and it has recently been gaining popularity. This study explores the use of AR for assembly through ARGO, a mobile application for Android smartphones that serves as an assembly guide for LEGO structures. It can enhance instructions and provide more details that assist users during the construction process. The system can recognize the current step of the LEGO assembly using data captured via Microsoft Kinect while providing visual feedback through the mobile application. To identify the current step, the system obtains the color and depth data from the Kinect camera and converts the data into a point cloud. The point cloud undergoes segmentation to isolate the physical LEGO model and compares it to the point clouds of a preloaded model to check if the brick is placed correctly. The system was evaluated using 3 models and can recognize when to advance to the next step during assembly and estimate the orientation of the step differing an average angle of 48.27 degrees. For each step, it takes an average of a few seconds to decide on the recognition, leading to a short delay for the feedback to appear on the phone.

Idioma originalAnglès
Títol de la publicacióMCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018
EditorsKatherine Blashki, Luis Rodrigues, Yingcai Xiao
EditorIADIS
Pàgines237-244
Nombre de pàgines8
ISBN (imprès)9789898533791
Estat de la publicacióPublicada - 2018
Publicat externament
Esdeveniment12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018 - Madrid, Spain
Durada: 18 de jul. 201820 de jul. 2018

Sèrie de publicacions

NomMCCSIS 2018 - Multi Conference on Computer Science and Information Systems; Proceedings of the International Conferences on Interfaces and Human Computer Interaction 2018, Game and Entertainment Technologies 2018 and Computer Graphics, Visualization, Computer Vision and Image Processing 2018
Volum2018-July

Conferència

Conferència12th International Conference on Interfaces and Human Computer Interaction 2018, 11th International Conference on Game and Entertainment Technologies 2018 and 12th International Conference on Computer Graphics, Visualization, Computer Vision and Image Processing 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018
País/TerritoriSpain
CiutatMadrid
Període18/07/1820/07/18

Fingerprint

Navegar pels temes de recerca de 'A mobile augmented reality-based assembly guidance application for LEGO'. Junts formen un fingerprint únic.

Com citar-ho