Internet of robotic things with a local LoRa network for teleoperation of an agricultural mobile robot using a digital shadow

Abstract In unstructured agricultural fields where autonomous navigation is challenging and demands additional safety, the operator’s experience and knowledge are essential for supervising operations and making decisions beyond the robot’s autonomous capabilities. Local networks with long-range wireless communication combined with digital twin concepts are promising solutions that can be used for robot teleoperation. The purpose of this study was to demonstrate the feasibility of supervising a mobile robot inside berry orchards using a digital shadow from a long-range distance (between 300 and 3000 m), with the primary objective of assisting the robot in navigating in complex situations such as row-end turning. This involved creating a virtual representation of the robot that mirrors its state and actions, allowing the remote operator to monitor and guide the robot effectively. The system comprised a GPS-based navigation controller with collision avoidance sensors, two sets of LoRa transmitters and repeaters, a simulation environment with a digital shadow of the robot, and a graphical user interface for the remote operator. Information about the digital shadow’s state, including location, orientation, and distances to obstacles, was received as a message by the LoRa gateway and was used to update the path for the actual robot that interfaced with the Robot Operating System (ROS). The main research hypothesis aimed to test the quality of the LoRa communication link between the robot and the operator, as well as the robustness of the robot’s control system, with an emphasis on the architecture, communication link, and situation awareness creation. Preliminary results showed that depending on the environment, the average packet loss was 12% at distances of approximately 2300 m. Our results highlight some of the core technical challenges that need to be addressed for an effective teleoperation system, including latency, stability, and the limited range of wireless communication. Future works involves evaluating the performance and reliability of the proposed method under different field conditions and scenarios, as well as considering the use of the 5G network for a significant improvement in data transmission speed, navigation efficiency, and visual feedback. Upon successful implementation, this study has the potential to enhance the efficiency and safety of robot navigation, providing a practical solution for remote supervision in challenging environments.