Research Output
Publication Types
- Journal Articles24
- Conference Papers51
- Workshop Papers5
- Book Chapters1
- Theses6
Author Roles
Yearly Activity
Publication Breakdown
Featured Awards
2025 Advanced Robotics Best Paper Award
2025 Annual Conference of the Robotics Society of Japan (RSJ 2025)
2024 · ResearchBest Paper Award
2024 IEEE International Conference on Robotic Computing (IRC 2024)
2021 · Competition1st Place (METI Minister's Award for Excellence in WRS)
2020 WRS Future Convenience Store Challenge (FCSC 2020)
2016 · ResearchThe Best of IET and IBC 2016-2017
2016 IBC Conference
2016 · Competition1st Place
2016 Airbus Shopfloor Challenge
- HSRコミュニティ 優秀発表賞
- 2nd Place (WRS Executive Committee Chairperson's Award for Excellence)
- Stock Task Winner
- SICE Award
- Stock & Disposal Task Daily Winner (July 18, 2025)
- Stock Task Daily Winner (July 18, 2025)
- Stock Task Daily Winner (July 16, 2025)
- Stock Task Daily Winner (July 14, 2025)
- Stock & Disposal Task 3rd Place
- IVA 100 List 2024
- Excellent Research and Technology Award
- HSRコミュニティ 優秀論文賞
- Stock & Disposal Task 2nd Place
- ロボカップ 研究賞
- Best Paper Award
- Stock & Disposal Winner
- HSRコミュニティ 研究奨励賞
- @ホーム Domestic Standard Platform League Technical Challenge 準優勝 (ロボカップ日本委員会 表彰状)
- @ホーム Domestic Standard Platform League Technical Challenge 準優勝 (@ホームリーグ実行委員会 賞状)
- @ホーム Domestic Standard Platform League 敢闘賞
- Stock & Disposal Task 1st Place (NEDO Chairman's Award for Excellence in WRS)
- Restroom Cleaning Task 1st Place (NEDO Chairman's Award for Excellence in WRS)
- Eastern Asia + South Eastern Asia Regional Prize Winner 2nd Place
- Phase 1 Finalist
Featured Publications
Public Evaluation on Potential Social Impacts of Fully Autonomous Cybernetic Avatars for Physical Support in Daily-Life Environments: Large-Scale Demonstration and Survey at Avatar Land
Proceedings of 2025 IEEE International Conference on Advanced Robotics and its Social Impacts (ARSO 2025)
2024 · Conference PaperReal-World Instance-specific Image Goal Navigation: Bridging Domain Gaps via Contrastive Learning
Proceedings of 2024 IEEE International Conference on Robotic Computing (IRC 2024)
2023 · Journal ArticleActive Exploration based on Information Gain by Particle Filter for Efficient Spatial Concept Formation
Advanced Robotics (AR)
2023 · Conference PaperInferring Place-Object Relationships by Integrating Probabilistic Logic and Multimodal Spatial Concepts
Proceedings of 2023 IEEE/SICE International Symposium on System Integration (SII 2023)
2016 · Conference PaperGaze Tracking using Corneal Images Captured by a Single High-Sensitivity Camera
Proceedings of 2016 International Broadcasting Convention (IBC 2016)
- Autonomous Service Robot for Fast Restock and Intelligent Straightening of Food Products in Convenience Stores
- Spatial Concepts-based Prompts with Large Language Models for Robot Action Planning
- Multi-Robot Task Planning for Multi-Object Retrieval Tasks with Distributed On-Site Knowledge via Large Language Models
- Toward Ownership Understanding of Objects: Active Question Generation with Large Language Model and Probabilistic Generative Model
- 大規模言語モデルによる複数ロボットの知識統合とタスク割当を用いた現場学習のコスト削減
- A Gesture-based Behaviour-driven Development Approach for End-User Cobot Programming
- Toward Adaptive Human-Robot Collaboration in Manipulation Tasks via Fine-Tuned Robotic Foundation Models
- Control Interfaces for Human-Robot Collaboration in Extended Reality
- GPTAlly: A Safety-oriented System for Human-Robot Collaboration based on Foundation Models
- Integrating Multimodal Communication and Comprehension Evaluation during Human-Robot Collaboration for Increased Reliability of Foundation Model-based Task Planning Systems
- Object Instance Retrieval in Assistive Robotics: Leveraging Fine-tuned SimSiam with Multi-View Images based on 3D Semantic Map
- Ownership Information Acquisition of Objects in the Environment by Active Question Generation with Multimodal Large Language Models and Probabilistic Generative Models
- HSRT-X: コミュニティを活用したロボット基盤モデルの構築
- マルチモーダル大規模言語モデルによる複数ロボットの知識統合とタスク割当を用いた現場学習のコスト削減
- ロボット間の現場知識の差を考慮した基盤モデルによる物体探索の言語指示におけるタスク分解と割当
- Hippocampal Formation-inspired Global Self-Localization: Quick Recovery from the Kidnapped Robot Problem from an Egocentric Perspective
- GPTAlly: A Safety-oriented System for Human-Robot Collaboration based on Foundation Models
- Task Planning System using Foundation Models in Multimodal Human-Robot Collaboration
- Mixed Reality-based 6D-Pose Annotation System for Robot Manipulation in Retail Environments
- Visual-Language Decision System through Integration of Foundation Models for Service Robot Navigation
- Interactive Learning System for 3D Semantic Segmentation with Autonomous Mobile Robots
- Integrating Probabilistic Logic and Multimodal Spatial Concepts for Efficient Robotic Object Search in Home Environments
- Toward Safe and Efficient Human-Robot Teams: Mixed Reality-based Robot Motion and Safety Index Visualization
- 現場環境で学習した知識に基づく曖昧な発話からの生活物理支援タスク
Featured Talks
Large Language Models to Manage Personalized Human-Robot interactions
Wallonia-Brussels Week at Expo 2025 Osaka, Kansai
2019 · TalkStrategies for Deploying Large Cross-Institutional Robotics Projects
Hikone Data Science 2019 (HDS2019)
2018 · ModerationFirst Japanese-German-French Symposium for International Research and Applications on Artificial Intelligence
German Centre for Research and Innovation Tokyo (DWIH Tokyo)
Featured Mentions
Beyond the Lab: Interview with Dr. Lotfi El Hafi on AI, Robotics, and Life in Nara!
en.ritsumei.ac.jp
2026 · InterviewResearch Associate Professor - Lotfi El Hafi
be.emb-japan.go.jp
2022 · Web ArticleCoarobo GK: The Bridge between Academic Research and Industrial Integration in the Fields of Service Robotics and Artificial Intelligence
kyoto-obc.jp
- <世界から立命館へ!> 研究室だけじゃない—奈良での生活、AI、ロボティクスについて:エル・ハフィ・ロトフィ(Lotfi El Hafi)先生
- 研究日和
- Forskningsprojekt om kollaborativa robotar med på IVA:s 100-lista
- 立命館大、少し先のロボ動作見える化 拡張仮想性ソフト開発
- 萩原良信准教授が「優秀研究・技術賞」を受賞
- ロボット作業で重要な「力感覚」…AI学習で試行錯誤、日本リードも海外猛追
- A new era for collaborative industrial robots
- Can you compete in robotics?
- 立命館大など、ロボットに3D姿勢教示 MRシステム開発
- 大学倶楽部・立命館大:「RoboCup Japan Open 2023」で受賞
- Coarobo: Pioneering Robotics Solutions with AI
- RADIANT
- 総合科学技術研究機構の教員3名が参加するロボット競技チーム「NAIST-RITS-Panasonic」がWRSのFCSC競技会にて優勝
- 立命館大、家庭用ロボに拡張現実で日用品教示 “仕事の指示”効率化
- WRSの競技会でR-GIRO「次世代人工知能記号学の国際融合研究拠点」が多数入賞
- 奈良先端大、立命館大学、パナソニック株式会社の合同チーム ワールド・ロボット・サミット2020のフューチャーコンビニエンスストアチャレンジ競技において、総合優勝を獲得
- 奈良先端大、立命館大学、パナソニック株式会社の合同チーム OpenCV AI Competition 2021において、「東アジア+東南アジア地域競技」2位を獲得
- World Robot Summitの競技会でR-GIRO「次世代人工知能と記号学の国際融合研究拠点」が多数入賞
- Kyoto: The Japanese Start-Up Community Powering the Future of Smart Cities (Part 2)
- The Kyoto Start-Ups Shaping Smart and Sustainable Cities
- WRS・ロボット愛知大会 コロナへの挑(2)リモート開発―工夫で成果
- WRSで見えた!次代の産業の形
- 最新ロボット技術、技術者もレベルアップ 社会実装に課題も 上位入賞者喜びの声【WRS】
- コンビニ競技でエキシビション、会場沸かせる【ワールド・ロボット・サミット】
Full Biography
Lotfi El Hafi, PhD, is the President & Founder of Coarobo GK, Japan, and a former Research Associate Professor at Ritsumeikan University, Japan.
He received his MScEng in Mechatronics from the Université catholique de Louvain (UCLouvain), Belgium, in 2013, and his PhD in Engineering from the Nara Institute of Science and Technology (NAIST), Japan, in 2017. His master's thesis contributed to TICO compression, now standardized as JPEG XS, for Ultra HD 4K/8K video distribution during an internship at intoPIX SA, Belgium, and later as a Sales Engineer while completing the AWEX International Business & Management EXPLORT Program. He then joined the Robotics Laboratory at NAIST as a recipient of the MEXT Scholarship in 2014. His PhD thesis proposed a novel eye-tracking method, "Simultaneous Tracking and Attention Recognition from Eyes (STARE)," which leveraged deep learning to extract behaviors from scene images reflected in the eyes, earning him the "Best of IET and IBC 2016–2017."
He joined the Ritsumeikan Global Innovation Research Organization (R-GIRO) of Ritsumeikan University, Japan, for the "International and Interdisciplinary Research Center for the Next-Generation Artificial Intelligence and Semiotics (AI+Semiotics)" project as a Senior Researcher in 2017, later becoming a Research Assistant Professor in 2019. His research activities included service robotics, AI, and system integration, with a particular interest in multimodal interaction in extended reality (XR). In this regard, he received 2 research awards from JST CREST: the "Best Award for Research Proposal Breaking Hagita-CREST Shell: Visualization of Emergent Reality in Robotics for Future Harmonious Interaction" and the "Best Award for Forecasting Research Proposal: Toward Early Realization of Harmonious Human-Robot Interaction."
He has also won numerous international robotics competition prizes, including the "1st Place" in the Airbus Shopfloor Challenge at IEEE ICRA 2016, the "Finalist Prize" in the Amazon Robotics Challenge 2017, the "NEDO Chairman's Award for Excellence in World Robot Summit" (2018, 2020), the "SICE Award for WRS Future Convenience Store Challenge" (2018, 2025), the "METI Minister's Award for Excellence in World Robot Summit" (2020), the "WRS Executive Committee Chairperson's Award for Excellence" (2025), the "2nd Place Regional Prize in Eastern Asia + South Eastern Asia" in the OpenCV AI Competition 2021, and multiple "1st Place" finishes in the WRS Future Convenience Store Challenge since 2018, including at IEEE/RSJ IROS 2022 and at the Osaka-Kansai Expo 2025. These contributions addressed both the technological and theoretical challenges of super-smart societies (Society 5.0), in collaboration with the Robotics Hub of Panasonic Corporation, Japan, where he served as a Research Advisor for Robotics Competitions from 2019 to 2026. There, he contributed to the development of AMIS, or "Autonomous Manipulation for Intelligence Services," a human-centered robotic platform, also in collaboration with NAIST.
His recognized achievements in competitions also led to his appointment as a Specially Appointed Researcher of HSR Community by Toyota Motor Corporation, Japan, from 2020 to 2022, during which he developed a containerized Software Development Environment (SDE) using cloud-first, open-source technologies to accelerate cross-institutional collaborative R&D. More than 20 institutions across Japan and the EU are known to have tested the SDE, with half adopting it for research. This endeavor earned him the inaugural "HSR Community Research Encouragement Award" from RSJ in 2022.
He then served as a Research Associate Professor at the Research Organization of Science and Technology of Ritsumeikan University, Japan, from 2023 to 2026. His contributions to the development of large-scale cognitive architectures for the JST CREST project "Symbol Emergence in Robotics for Future Human-Machine Collaboration" and the JST Moonshot R&D Program "The Realization of an Avatar-Symbiotic Society where Everyone Can Perform Active Roles without Constraint" led him to investigate the mechanisms of multimodal robot learning in XR. His work on probabilistic inference, contrastive learning, and concept formation for service robots earned the "Excellent Research and Technology Award" from RSJ in 2024 and the "Best Paper Award" at IEEE/SICE SII 2023, IEEE IRC 2024, and from the RSJ Advanced Robotics journal in 2025.
Over the years, he has authored over 80 academic publications and holds an h-index of 14 on Google Scholar, with more than 600 citations. As a Principal Investigator, he helped build a vibrant research environment at Ritsumeikan University through successful grant applications, including a competitive JSPS KAKENHI Grant-in-Aid for Early-Career Scientists titled "Emergent Reality: Knowledge Formation from Multimodal Learning through Human-Robot Interaction in Extended Reality," securing over 15 million JPY in cumulative internal and external funding. In addition to informally supervising graduate students and international interns in the Emergent Systems Laboratory at Ritsumeikan University, he formally supervised 4 international master's theses with UCLouvain. An active member of IEEE (since 2015) and RSJ (since 2017), and a former member of JSME (2017–2022), he has peer-reviewed over 35 manuscripts for prestigious journals and conferences and served as Associate Editor for IEEE RO-MAN 2021 and Publicity Chair for IEEE/SICE SII 2026.
Since 2026, he has dedicated himself to Coarobo GK, Japan, a company he founded in 2019 that now brings physical AI to real-world robots by providing containerized SDE solutions for researchers and developers in the fields of service robotics and AI. There, he supervises the development of OpenRoIS, an open-source middleware implementing the OMG Robotic Interaction Service (RoIS) framework, so that a service application written once runs on physical robots, virtual avatars, and AI services alike.
Beyond his work, he is a devoted husband and father, and he holds his commitment to his family as a core value. He lives in Nara with his wife, whom he met during his PhD at NAIST, and their three children, to whose pursuits he dedicates most of his time off.
[Last updated: September 2026.]
