=========================================================== Workshop on Benchmarking Autonomous Service Robotics in Real Life =========================================================== 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems October 15th 2024, Abu Dhabi, UAE https://sites.google.com/view/iros-2024-benchmarking-asr ______________________________________________________________ Autonomous service robots are increasingly prevalent in real-world settings, assuming various roles to supplement human capabilities. Mobile platforms such as Walker, H1, Cobiot, TIAGo, and Figure-01 have captured the interest of non-expert users, eager to integrate robots into everyday environments. With this growing presence, researchers must consider various aspects of integrating robots within inhabited spaces, including factors such as verbal and nonverbal communication, social behavior and navigation, or robot morphologies. The expansion of research in this domain poses the challenge of developing new benchmarks to assess performance realistically beyond the confines of research laboratories. This workshop aims to foster dialogue surrounding the future of research and its benchmarking in autonomous service robotics. Using keynotes, participants, and organizers’ experiences of real-world robotic competitions, we plan to steer the conversation to address core components of recent advancements and put forth a set of voluntary draft guidelines for autonomous service roboticists concerning test procedures and benchmarking. The sessions' results will be synthesized into a set of draft frameworks for setting realistic testing scenarios and utilizing them in testing and benchmarking. This workshop seeks to enhance the reporting standards within real-world autonomous robotics research and propel the field toward more structured research practices.

Contributions are invited on all topics relevant to *real-life testing and benchmarking* advancements in autonomous service robots and topics that can help to inform this core idea, including (but not limited to) *testing and benchmarking in*:

- Human-Robot-Interaction and Cooperation - Navigation and Mapping in dynamic environments - Service Robots - Solving Service Robot Tasks - General-Purpose Service Robots - Foundation Models - Computer Vision and Object Recognition under natural light conditions - Object Manipulation - Adaptive Behaviors - Behavior Integration - Ambient Intelligence - Standardization and System Integration

*Submission deadline*: *August 31st, 2024* Acceptance notification: October 1st, 2024 Final version due: October 8th, 2024 Workshop date: October 15th, 2024

The contributions should be in the IROS standard pdf format and include short work-in-progress and position papers (2-4 pages) or long-format papers (4-8 pages). All papers are to be considered for both oral presentations and posters. Posters will be presented during the scheduled poster session. Every paper will be reviewed in a single-blind process. The selection of accepted papers will be done by the organizing committee, based on the reviews. Based on the number and quality of submissions, selected papers may be published in a special section or issue of Advanced Robotics https://www.tandfonline.com/journals/tadr20, the international journal of the Robotics Society of Japan.

The submissions should be done here: https://easychair.org/conferences/?conf=basr2024

The Organizers - Justin Hart, University of Texas - Austin, USA - Matteo Leonetti, King's College London, UK - Katarzyna Pasternak, University of Miami, USA - Komei Sugiura, Keio University, Japan - Ubbo Visser, University of Miami, USA - Sven Wachsmuth, University of Bielefeld, Germany