Skip to main content Skip to main navigation


Interactive structure--robotic repositioning of vertical elements in man-machine collaborative assembly through vision-based tactile sensing

B. Wibranek; B Belousov; A. Sadybakasov; J Peters; O. Tessmann
In: Architecture in the age of the 4th industrial revolution. eCAADe and SIGraDi Conference, September 9-13, Porto, Portugal, Pages 11-13, Vol. 2, eCAADe, 2019.


The research presented in this paper explores a novel tactile sensor technology for architectural assembly tasks. In order to enable robots to interact both with humans and building elements, several robot control strategies had to be implemented. Therefore, we developed a communication interface between the architectural design environment, a tactile sensor and robot controllers. In particular, by combining tactile feedback with real-time gripper and robot control algorithms, we demonstrate grasp adaptation, object shape and texture estimation, slip and contact detection, force and torque estimation. We investigated the integration of robotic control strategies for human-robot interaction and developed an assembly task in which the robot had to place vertical elements underneath a deformed slab. Finally, the proposed tactile feedback controllers and learned skills are combined together to demonstrate applicability and utility of tactile sensing in collaborative human-robot architectural assembly tasks. Users were able to hand over building elements to the robot or guide the robot through the interaction with building elements. Ultimately this research aims to offer the possibility for anyone to interact with built structures through robotic augmentation.