=========================================================== Workshop on Benchmarking Autonomous Service Robotics in Real Life =========================================================== 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems October 15th 2024, Abu Dhabi, UAE https://sites.google.com/view/iros-2024-benchmarking-asr ______________________________________________________________

Dear RoboCup@Home Community,

We are pleased to invite you to participate in the IROS workshop on *Benchmarking Autonomous Service Robotics in Real Life* that will take place on *Tuesday, October 15th 2024 in ADNEC, Abu Dhabi, UAE. *The workshop will be located in conference *room 8 *from *8:00am till 12:00pm*.

We will be hosting talks by invited speakers, break-out discussion sessions as well as a poster session. You can find more details in the abstract below as well as at our website https://sites.google.com/view/iros-2024-benchmarking-asr.

We are looking forward to meeting you there!

Best regards, The Organizers - Justin Hart, University of Texas - Austin, USA - Matteo Leonetti, King's College London, UK - Katarzyna Pasternak, University of Miami, USA - Komei Sugiura, Keio University, Japan - Ubbo Visser, University of Miami, USA - Sven Wachsmuth, University of Bielefeld, Germany

------------------------------------ Abstract: Autonomous service robots are increasingly prevalent in real-world settings, assuming various roles to supplement human capabilities. Mobile platforms such as Walker, H1, Cobiot, TIAGo, and Figure-01 have captured the interest of non-expert users, eager to integrate robots into everyday environments. With this growing presence, researchers must consider various aspects of integrating robots within inhabited spaces, including factors such as verbal and nonverbal communication, social behavior and navigation, or robot morphologies. The expansion of research in this domain poses the challenge of developing new benchmarks to assess performance realistically beyond the confines of research laboratories. This workshop aims to foster dialogue surrounding the future of research and its benchmarking in autonomous service robotics. Using keynotes, participants, and organizers’ experiences of real-world robotic competitions, we plan to steer the conversation to address core components of recent advancements and put forth a set of voluntary draft guidelines for autonomous service roboticists concerning test procedures and benchmarking. The sessions' results will be synthesized into a set of draft frameworks for setting realistic testing scenarios and utilizing them in testing and benchmarking. This workshop seeks to enhance the reporting standards within real-world autonomous robotics research and propel the field toward more structured research practices.