Faculty Profiles - OUYANG Xiaomin | The Hong Kong University of Science and Technology

Xiaomin OUYANG
歐陽小敏

PhD in Information Engineering
The Chinese University of Hong Kong, 2023

Assistant Professor
Department of Computer Science and Engineering

Google Scholar

y7oUVucAAAAJ

ORCID

0000-0003-0710-0963

ResearcherID

HZD-9992-2023

Scopus ID

57225991731

Research Interest

Mobile computing
Cyber-physical systems
Artificial intelligence
Embedded systems

Publications

2025 7

An Overview on Economic Analysis of Internet of Everything

IEEE Communications Surveys and Tutorials, April 2025, p. 1
Ding, Ningning; Ouyang, Xiaomin; Gao, Lin; Huang, Jianwei; Xing, Guoliang
Article

Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis

SenSys '25: Proceedings of the 23rd ACM Conference on Embedded Networked Sensor Systems / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 720-721
Zhang, Liyu; Wang, Yizhen; Du, Wenjie; Liu, Kwun Ho; Ouyang, Xiaomin
Conference paper

InfoMAE: Pair-Efficient Cross-Modal Alignment for Multimodal Time-Series Sensing Signals

WWW '25: Proceedings of the ACM on Web Conference 2025 / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 3084 -3095
Kimura, Tomoyoshi; Li, Xinlin; Hanna, Osama; Chen, Yatong; Chen, Yizhuo; Kara, Denizhan; Wang, Tianshi; Li, Jinyang; Ouyang, Xiaomin; Liu, Shengzhong; Srivastava, Mani; Diggavi, Suhas; Abdelzaher, Tarek
Conference paper

MMBind: Unleashing the Potential of Distributed and Heterogeneous Data for Multimodal Learning in IoT

SenSys '25: Proceedings of the 23rd ACM Conference on Embedded Networked Sensor Systems / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 491 -503
Ouyang, Xiaomin; Wu, Jason; Kimura, Tomoyoshi; Lin, Yihan; Verma, Gunjan; Abdelzaher, Tarek; Srivastava mani
Conference paper

MMEdge: Real-time Multimodal Inference via Cross-Modal Speculative Sensing and Encoding

HotMobile '25: Proceedings of the 26th International Workshop on Mobile Computing Systems and Applications / Association for Computing Machinery. New York, NY : Association for Computing Machinery, 2025, p. 132
Huang, Runxi; Ouyang, Xiaomin
Conference paper

SensorBench: Benchmarking LLMs in Coding-Based Sensor Processing

HotMobile '25: Proceedings of the 26th International Workshop on Mobile Computing Systems and Applications / Association for Computing Machinery. New York, NY : Association for Computing Machinery, 2025, p. 25-30
Quan, Pengrui; Ouyang, Xiaomin; Jeyakumar, Jeya Vikranth; Wang, Ziqi; Xing, Yang; Srivastava, Mani
Conference paper

Toward Foundation Models for Online Complex Event Detection in CPS-IoT: A Case Study

FMSys 2025 - Proceedings of the 2025 2nd International Workshop on Foundation Models for Cyber-Physical Systems and Internet of Things, 2025 Cyber-Physical Systems and Internet-of-Things Week, CPS-IoT Week 2025 Workshops / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 1-6
Han, Liying; Dong, Gaofeng; Ouyang, Xiaomin; Kaplan, Lance; Cerutti, Federico; Srivastava, Mani
Conference paper

2024 5

ADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer’s Disease

ACM MobiCom '24: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking / Association for Computing Machinary. New York, NY : Association for Computing Machinary, 2024, p. 404-419
Ouyang, Xiaomin; Shuai, Xian; Li, Yang; Pan, Li; Zhang, Xifan; Fu, Heming; Cheng, Sitong; Wang, Xinyan; Cao, Shihua; Xin, Jiang; Mok, Hazel; Yan, Zhenyu; Yu, Doris Sau Fung; Kwok, Timothy; Xing, Guoliang
Conference paper

Are Time Series Foundation Models Ready to Revolutionize Predictive Building Analytics?

Mulayim, Ozan Baris; Quan, Pengrui; Han, Liying; Ouyang, Xiaomin; Hong, Dezhi; Bergés, Mario; Srivastava, Mani
Conference paper

Fedkit: Enabling Cross-Platform Federated Learning for Android and iOS

IEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) / IEEE. Piscataway, NJ : Institute of Electrical and Electronics Engineers, 2024, Article number: 10620662
He, Sichang; Tang, Beilong; Zhang, Boyan; Shao, Jiaoqi; Ouyang, Xiaomin; Nugraha, Daniel Nata; Luo, Bing
Conference paper

FlexLoc: Conditional Neural Networks for Zero-Shot Sensor Perspective Invariance in Object Localization with Distributed Multimodal Sensors

IEEE International Conference on Intelligent Robots and Systems / IEEE. Piscataway, NJ : IEEE, 2024, p. 8563 -8570, article number 10802096
Wu, Jason; Wang, Ziqi; Ouyang, Xiaomin; Jeong, Ho Lyun; Samplawski, Colin; Kaplan, Lance M.; Marlin, Benjamin; Srivastava, Mani
Conference paper

LLMSense: Harnessing LLMs for High-level Reasoning over Spatiotemporal Sensor Traces

Proceedings - 2024 IEEE 3rd Workshop on Machine Learning on Edge in Sensor Systems, SenSys-ML 2024, Institute of Electrical and Electronics Engineers Inc., 2024, p. 9-14
Ouyang, Xiaomin; Srivastava, Mani
Conference paper

2023 4

Optimization Design for Federated Learning in Heterogeneous 6G Networks

IEEE Network, v. 37, (2), March 2023, p. 38-43
Luo, Bing; Han, Pengchao; Sun, Peng; Ouyang, Xiaomin; Huang, Jianwei; Ding, Ningning
Article

Design and Deployment of Multi-Modal Federated Learning Systems for Alzheimer's Disease Monitoring

MobiSys 2023 - Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services, Association for Computing Machinery, Inc, 2023, p. 612-614
Ouyang, Xiaomin
Conference paper

Harmony: Heterogeneous Multi-Modal Federated Learning through Disentangled Model Training

MobiSys 2023 - Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services, Association for Computing Machinery, Inc, 2023, p. 530-543
Ouyang, Xiaomin; Xie, Zhiyuan; Fu, Heming; Cheng, Sitong; Pan, Li; Ling, Neiwen; Xing, Guoliang; Zhou, Jiayu; Huang, Jianwei
Conference paper

Mozart: A Mobile ToF System for Sensing in the Dark through Phase Manipulation

MobiSys 2023 - Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services, Association for Computing Machinery, Inc, 2023, p. 163-176
Xie, Zhiyuan; Ouyang, Xiaomin; Pan, Li; Lu, Wenrui; Xing, Guoliang; Liu, Xiaoming
Conference paper

2022 3

ClusterFL: A Clustering-based Federated Learning System for Human Activity Recognition

ACM Transactions on Sensor Networks, v. 19, (1), December 2022, article number 3554980
Ouyang, Xiaomin; Xie, Zhiyuan; Zhou, Jiayu; Xing, Guoliang; Huang, Jianwei
Article

Cosmo: Contrastive Fusion Learning with Small Data for Multimodal Human Activity Recognition

Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM, Association for Computing Machinery, 2022, p. 324-337
Ouyang, Xiaomin; Shuai, Xian; Zhou, Jiayu; Shi, Ivy Wang; Xie, Zhiyuan; Xing, Guoliang; Huang, Jianwei
Conference paper

Hitof: A tof camera system for capturing high-resolution textures

MobiCom '22: Proceedings of the 28th Annual International Conference on Mobile Computing And Networking / Association for Computing Machinery. New York, NY : Association for Computing Machinery, 2022, p. 764-765
Xie, Zhiyuan; Ouyang, Xiaomin; Pan, Li; Lu, Wenrui; Liu, Xiaoming; Xing, Guoliang
Conference paper

2021 3

ClusterFL: A similarity-aware federated learning system for human activity recognition

MobiSys 2021 - Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services, Association for Computing Machinery, Inc, 2021, p. 54-66
Ouyang, Xiaomin; Xie, Zhiyuan; Zhou, Jiayu; Huang, Jianwei; Xing, Guoliang
Conference paper

FedDL: Federated Learning via Dynamic Layer Sharing for Human Activity Recognition

SenSys 2021 - Proceedings of the 2021 19th ACM Conference on Embedded Networked Sensor Systems, Association for Computing Machinery, Inc, 2021, p. 15-28
Tu, Linlin; Ouyang, Xiaomin; Zhou, Jiayu; He, Yuze; Xing, Guoliang
Conference paper

UltraDepth: Exposing High-Resolution Texture from Depth Cameras

SenSys 2021 - Proceedings of the 2021 19th ACM Conference on Embedded Networked Sensor Systems, Association for Computing Machinery, Inc, 2023, p. 302-315
Xie, Zhiyuan; Ouyang, Xiaomin; Liu, Xiaoming; Xing, Guoliang
Conference paper

Article 1

An Overview on Economic Analysis of Internet of Everything

IEEE Communications Surveys and Tutorials, April 2025, p. 1
Ding, Ningning; Ouyang, Xiaomin; Gao, Lin; Huang, Jianwei; Xing, Guoliang

Conference paper 6

Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis

SenSys '25: Proceedings of the 23rd ACM Conference on Embedded Networked Sensor Systems / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 720-721
Zhang, Liyu; Wang, Yizhen; Du, Wenjie; Liu, Kwun Ho; Ouyang, Xiaomin

InfoMAE: Pair-Efficient Cross-Modal Alignment for Multimodal Time-Series Sensing Signals

WWW '25: Proceedings of the ACM on Web Conference 2025 / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 3084 -3095
Kimura, Tomoyoshi; Li, Xinlin; Hanna, Osama; Chen, Yatong; Chen, Yizhuo; Kara, Denizhan; Wang, Tianshi; Li, Jinyang; Ouyang, Xiaomin; Liu, Shengzhong; Srivastava, Mani; Diggavi, Suhas; Abdelzaher, Tarek

MMBind: Unleashing the Potential of Distributed and Heterogeneous Data for Multimodal Learning in IoT

SenSys '25: Proceedings of the 23rd ACM Conference on Embedded Networked Sensor Systems / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 491 -503
Ouyang, Xiaomin; Wu, Jason; Kimura, Tomoyoshi; Lin, Yihan; Verma, Gunjan; Abdelzaher, Tarek; Srivastava mani

MMEdge: Real-time Multimodal Inference via Cross-Modal Speculative Sensing and Encoding

HotMobile '25: Proceedings of the 26th International Workshop on Mobile Computing Systems and Applications / Association for Computing Machinery. New York, NY : Association for Computing Machinery, 2025, p. 132
Huang, Runxi; Ouyang, Xiaomin

SensorBench: Benchmarking LLMs in Coding-Based Sensor Processing

HotMobile '25: Proceedings of the 26th International Workshop on Mobile Computing Systems and Applications / Association for Computing Machinery. New York, NY : Association for Computing Machinery, 2025, p. 25-30
Quan, Pengrui; Ouyang, Xiaomin; Jeyakumar, Jeya Vikranth; Wang, Ziqi; Xing, Yang; Srivastava, Mani

Toward Foundation Models for Online Complex Event Detection in CPS-IoT: A Case Study

FMSys 2025 - Proceedings of the 2025 2nd International Workshop on Foundation Models for Cyber-Physical Systems and Internet of Things, 2025 Cyber-Physical Systems and Internet-of-Things Week, CPS-IoT Week 2025 Workshops / Association for Computing Machinery. New York, United States : Association for Computing Machinery, 2025, p. 1-6
Han, Liying; Dong, Gaofeng; Ouyang, Xiaomin; Kaplan, Lance; Cerutti, Federico; Srivastava, Mani

Conference paper 5

ADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer’s Disease

ACM MobiCom '24: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking / Association for Computing Machinary. New York, NY : Association for Computing Machinary, 2024, p. 404-419
Ouyang, Xiaomin; Shuai, Xian; Li, Yang; Pan, Li; Zhang, Xifan; Fu, Heming; Cheng, Sitong; Wang, Xinyan; Cao, Shihua; Xin, Jiang; Mok, Hazel; Yan, Zhenyu; Yu, Doris Sau Fung; Kwok, Timothy; Xing, Guoliang

Are Time Series Foundation Models Ready to Revolutionize Predictive Building Analytics?

Mulayim, Ozan Baris; Quan, Pengrui; Han, Liying; Ouyang, Xiaomin; Hong, Dezhi; Bergés, Mario; Srivastava, Mani

Fedkit: Enabling Cross-Platform Federated Learning for Android and iOS

IEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS) / IEEE. Piscataway, NJ : Institute of Electrical and Electronics Engineers, 2024, Article number: 10620662
He, Sichang; Tang, Beilong; Zhang, Boyan; Shao, Jiaoqi; Ouyang, Xiaomin; Nugraha, Daniel Nata; Luo, Bing

FlexLoc: Conditional Neural Networks for Zero-Shot Sensor Perspective Invariance in Object Localization with Distributed Multimodal Sensors

IEEE International Conference on Intelligent Robots and Systems / IEEE. Piscataway, NJ : IEEE, 2024, p. 8563 -8570, article number 10802096
Wu, Jason; Wang, Ziqi; Ouyang, Xiaomin; Jeong, Ho Lyun; Samplawski, Colin; Kaplan, Lance M.; Marlin, Benjamin; Srivastava, Mani

LLMSense: Harnessing LLMs for High-level Reasoning over Spatiotemporal Sensor Traces

Proceedings - 2024 IEEE 3rd Workshop on Machine Learning on Edge in Sensor Systems, SenSys-ML 2024, Institute of Electrical and Electronics Engineers Inc., 2024, p. 9-14
Ouyang, Xiaomin; Srivastava, Mani

Article 1

Optimization Design for Federated Learning in Heterogeneous 6G Networks

IEEE Network, v. 37, (2), March 2023, p. 38-43
Luo, Bing; Han, Pengchao; Sun, Peng; Ouyang, Xiaomin; Huang, Jianwei; Ding, Ningning

Conference paper 3

Design and Deployment of Multi-Modal Federated Learning Systems for Alzheimer's Disease Monitoring

MobiSys 2023 - Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services, Association for Computing Machinery, Inc, 2023, p. 612-614
Ouyang, Xiaomin

Harmony: Heterogeneous Multi-Modal Federated Learning through Disentangled Model Training

MobiSys 2023 - Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services, Association for Computing Machinery, Inc, 2023, p. 530-543
Ouyang, Xiaomin; Xie, Zhiyuan; Fu, Heming; Cheng, Sitong; Pan, Li; Ling, Neiwen; Xing, Guoliang; Zhou, Jiayu; Huang, Jianwei

Mozart: A Mobile ToF System for Sensing in the Dark through Phase Manipulation

MobiSys 2023 - Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services, Association for Computing Machinery, Inc, 2023, p. 163-176
Xie, Zhiyuan; Ouyang, Xiaomin; Pan, Li; Lu, Wenrui; Xing, Guoliang; Liu, Xiaoming

Article 1

ClusterFL: A Clustering-based Federated Learning System for Human Activity Recognition

ACM Transactions on Sensor Networks, v. 19, (1), December 2022, article number 3554980
Ouyang, Xiaomin; Xie, Zhiyuan; Zhou, Jiayu; Xing, Guoliang; Huang, Jianwei

Conference paper 2

Cosmo: Contrastive Fusion Learning with Small Data for Multimodal Human Activity Recognition

Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM, Association for Computing Machinery, 2022, p. 324-337
Ouyang, Xiaomin; Shuai, Xian; Zhou, Jiayu; Shi, Ivy Wang; Xie, Zhiyuan; Xing, Guoliang; Huang, Jianwei

Hitof: A tof camera system for capturing high-resolution textures

MobiCom '22: Proceedings of the 28th Annual International Conference on Mobile Computing And Networking / Association for Computing Machinery. New York, NY : Association for Computing Machinery, 2022, p. 764-765
Xie, Zhiyuan; Ouyang, Xiaomin; Pan, Li; Lu, Wenrui; Liu, Xiaoming; Xing, Guoliang

Conference paper 3

ClusterFL: A similarity-aware federated learning system for human activity recognition

MobiSys 2021 - Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services, Association for Computing Machinery, Inc, 2021, p. 54-66
Ouyang, Xiaomin; Xie, Zhiyuan; Zhou, Jiayu; Huang, Jianwei; Xing, Guoliang

FedDL: Federated Learning via Dynamic Layer Sharing for Human Activity Recognition

SenSys 2021 - Proceedings of the 2021 19th ACM Conference on Embedded Networked Sensor Systems, Association for Computing Machinery, Inc, 2021, p. 15-28
Tu, Linlin; Ouyang, Xiaomin; Zhou, Jiayu; He, Yuze; Xing, Guoliang

UltraDepth: Exposing High-Resolution Texture from Depth Cameras

SenSys 2021 - Proceedings of the 2021 19th ACM Conference on Embedded Networked Sensor Systems, Association for Computing Machinery, Inc, 2023, p. 302-315
Xie, Zhiyuan; Ouyang, Xiaomin; Liu, Xiaoming; Xing, Guoliang

No Publications

Teaching Assignment

COMP2011

Programming with C++

COMP4971A	Independent Work
COMP4981	Final Year Project
UROP1000	Undergraduate Research Opportunities
UROP2100P	Undergraduate Research Opportunities Series 2

COMP4971C	Independent Work
COMP6611C	Advanced Topics in Embedded AI Systems
UROP1100O	Undergraduate Research Opportunities Series 1

COMP4971A

Independent Work

COMP4971A

Independent Work

No Teaching Assignments

Research Postgraduate (RPG) Supervision

From January 2022 to December 2025 (As of 29 August 2025)

Current RPGs

Doctor of Philosophy

WANG, Yizhen
Computer Science and Engineering
WANG, Yuchen (co-supervision)
Computer Science and Engineering
ZHANG, Liyu
Computer Science and Engineering
HUANG, Runxi
Computer Science and Engineering

Master of Philosophy

LIU, Haoxian
Computer Science and Engineering

Projects

From January 2023 to December 2025

No Projects.
Foundation Model-Assisted Complex Sensing and Personalized Feedback on Mobile Devices

大模型輔助的移動設備上的復雜感知和個性化反饋 Leading

Huawei Technologies Co., Ltd.
Project Team (HKUST)
OUYANG Xiaomin (Lead)
2024 -

Research Interest

Publications

2025 7

2024 5

2023 4

2022 3

2021 3

Article 1

Conference paper 6

Conference paper 5

Article 1

Conference paper 3

Article 1

Conference paper 2

Conference paper 3

Teaching Assignment

Research Postgraduate (RPG) Supervision

From January 2022 to December 2025 (As of 29 August 2025)

Current RPGs

Projects

From January 2023 to December 2025

Your browser is out of date!