Trustworthy AI and Federated Learning for Sustainable Smart Cities

Written by Pao-Ann Hsiung, Sapdo Utomo, John A, Adarsh Rouniyar, Hsiu-Chun Hsu, GuoHao Jiang, Chang ChunHao, and Tang Kai Chun

The growth of the AI model is not commensurate with public confidence. Some AI models contain bias or discrimination, which can be detrimental to some decision-making processes or populations. Researchers are currently attempting to tackle issues with credibility. Smart cities and artificial intelligence have been intertwined for many years, but smart citizens are concerned about the system's privacy protections. Therefore, if a system's credibility cannot be enhanced, it is a problem.


These issues can be resolved by the development of a trustworthy AI system. In this article, eight criteria for trustworthy AI systems are discussed. According to the community, federated learning may solve privacy difficulties. Due to the fairness metrics, federated clients with disparate data may be excluded from the aggregate process. Consequently, a new global model will employ only trustworthy data and models. These two technologies could enable a smart city application that is sustainable and their applications for smart cities will flourish if all stakeholders have faith in the system.

 

Introduction

Smart cities have been evolving worldwide for more than a decade [1]. Many nations are building or improving their own smart cities. AI technologies are linked to smart city applications, yet trust in AI systems is still contested [2]. Smart cities cannot reach their full potential until key stakeholders trust them. In some previous applications, AI systems exhibited bias against marginalized groups [3][4]. Deep learning is always called a "black box" model since users do not comprehend why it produces that output [2]. System robustness and privacy protection remain unanswered in some smart city applications. Researchers suggested trustworthy AI (TAI) and federated learning (FL) to address these concerns.

 

Trustworthy AI (TAI)

TAI solutions in academia or industry must include legal, social, ethical, public opinion, and environmental issues. Many TAI recommendations, ideas, and toolkits haven't been used on the ground because people don't have enough information, skills, or resources [5].

To overcome the aforementioned difficulties in the introduction, TAI systems must meet certain requirements. Fairness-enabled systems should address AI-induced discrimination. A fair AI system requires good data governance throughout the collection, cleaning, and preprocessing before model training. This process should address privacy, sensitive data, and data balance concerns [6]. Good data governance helps with traceability and transparency. However, to help stakeholders understand AI output, an explainable AI approach should be devised. Explainable AI would boost transparency and stakeholder trust in AI systems, making them more accountable [2]. With understandable output, tracing problems when a decision or prediction goes wrong is easier. Stakeholders will also gain more control over the systems as well as autonomy over when and why they should either trust the systems or vice versa. Robustness ensures system safety and robust systems can detect, defend, and mitigate threats. This requires adversarial model training [7].

As summarized, the eight criteria of TAI are: (a) explainability; (b) transparency and traceability; (c) privacy and data governance; (d) fairness and non-discrimination; (e) safety; (f) autonomy and control; (g) common good and well-being; and (h) accountability and communication.

 

Federated Learning (FL)

Federated Learning is called "privacy by design." As TAI also considers privacy protection, so what distinguishes it from FL? TAI might send all data to the server, but FL applications save data in client silos [8][9]. FL ensures data privacy by not exchanging data between clients or servers. TAI's data governance will safeguard privacy. TAI and FL improve data security and privacy. Why has FL improved security? A centralized system's data will be compromised if it's attacked. Figure 1 shows that a decentralized system like FL will only affect the node that is being targeted because the FL server does not have any client data. FL may also use aggregation algorithms that assess data fairness for each client to make the global model fair. Thus, only clients with sufficient and balanced data could aggregate. It would also help clients with bad data get the same good model.

 

figure 1 comparison of centralized architecture and federated learning

 Figure 1: Comparison of Centralized Architecture and Federated Learning.

 

TAI and FL Integration Strategy

 

fig 2 the strategy of integration between tai and fl

 Figure 2: The strategy of integration between TAI and FL..

 

 

Figure 2 illustrates how to combine TAI and FL in sequential order. With this set of procedures, TAI and FL's integration meets the eight criteria. Finally, these requirements will aid in the development of more effective, sustainable smart city systems that benefit society (the common good and well-being). As Taiwan AI labs have demonstrated, these methods can be applied to the medical field [10] as well as other application domains, such as traffic management and environmental monitoring, on which our research team is currently concentrating [11].

 

Conclusion

This article showed how the integration of two crucial technologies, namely trustworthy artificial intelligence and federated learning, will aid in the development of sustainable smart cities. If all stakeholders have complete faith in the systems, smart city applications will yield their full benefits. Consequently, the common welfare and the prosperity of society will ultimately be realized.

 

 

References

  1. Chapter 1, What is Smart City? in Chun Sing Lai, Loi Lei Lai, and Qi Hong Lai, Smart Energy for Transportation and Health in a Smart City, IEEE Press / Wiley, Nov. 2022.
  2. M. T. Ribeiro, S. Singh, and C. Guestrin, “‘Why Should I Trust You?’: Explaining the Predictions of Any Classifier.” arXiv, Aug. 09, 2016. Accessed: Jun. 22, 2022. [Online]. Available: http://arxiv.org/abs/1602.04938
  3. V. S. Lokhande, A. K. Akash, S. N. Ravi, and V. Singh, “FairALM: Augmented Lagrangian Method for Training Fair Models with Little Regret,” in Computer Vision – ECCV 2020, Cham, 2020, pp. 365–381. doi: 10.1007/978-3-030-58610-2_22.
  4. K. Yang, K. Qinami, L. Fei-Fei, J. Deng, and O. Russakovsky, “Towards fairer datasets: filtering and balancing the distribution of the people subtree in the ImageNet hierarchy,” in Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, New York, NY, USA, Jan. 2020, pp. 547–558. doi: 10.1145/3351095.3375709.
  5. K. A. Crockett, L. Gerber, A. Latham, and E. Colyer, “Building Trustworthy AI Solutions: A Case for Practical Solutions for Small Businesses,” IEEE Trans. Artif. Intell., pp. 1–1, 2021, doi: 10.1109/TAI.2021.3137091.
  6. M. Janssen, P. Brous, E. Estevez, L. S. Barbosa, and T. Janowski, “Data governance: Organizing data for trustworthy Artificial Intelligence,” Gov. Inf. Q., vol. 37, no. 3, p. 101493, Jul. 2020, doi: 10.1016/j.giq.2020.101493.
  7. “Adversarial Robustness Toolbox (ART) v1.10.” Trusted-AI, May 11, 2022. Accessed: May 11, 2022. [Online]. Available: https://github.com/Trusted-AI/adversarial-robustness-toolbox
  8. M. Aledhari, R. Razzak, R. M. Parizi, and F. Saeed, “Federated Learning: A Survey on Enabling Technologies, Protocols, and Applications,” IEEE Access, vol. 8, pp. 140699–140725, 2020, doi: 10.1109/ACCESS.2020.3013541.
  9. S. Abdulrahman, H. Tout, H. Ould-Slimane, A. Mourad, C. Talhi, and M. Guizani, “A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and Beyond,” IEEE Internet Things J., vol. 8, no. 7, pp. 5476–5497, Apr. 2021, doi: 10.1109/JIOT.2020.3030072.
  10. “Federated Learning - Taiwan Medical Imaging,” Apr. 25, 2022. https://www.taimedimg.tw/federated_learning_framework/ (accessed Nov. 09, 2022).
  11. S. Utomo, A. John, A. Rouniyar, H.-C. Hsu, and P.-A. Hsiung, “Federated Trustworthy AI Architecture for Smart Cities,” in 2022 IEEE International Smart Cities Conference (ISC2), Sep. 2022, pp. 1–7. doi: 10.1109/ISC255366.2022.9922069.

 

 

This article was edited by Qi Lai.

To view all articles in this issue, please go to January 2023 eNewsletter. For a downloadable copy, please visit the IEEE Smart Cities Resource Center.

Pao Ann Hsiung
Pao-Ann Hsiung, Ph.D., received his Ph.D. in Electrical Engineering from the National Taiwan University, Taipei, Taiwan, ROC, in 1996. Since August 2007, he has been a full professor at the National Chung Cheng University (CCU), Taiwan. Currently, he is the Dean of Information Technology, CCU, the Director of the Research Center on AI and Sustainability, CCU and the Director of the Taiwan-India Joint Research Center on Artificial Intelligence at IIT Ropar and CCU. Previously, he was the department chair, Dean of International Affairs, and the Director-General of Intelligence Technologies Department for the Chiayi City Government. He has published 300 papers in international journals and conferences. He was the recipient of the 2010 CCU Outstanding Research Award, 2001 ACM Taipei Chapter Kuo-Ting Li Young Researcher, and 2004 CCU Young Scholar Research Award. He helped Chiayi to achieve 2018 TOP7 Smart City in the Intelligence Community Forum world competition. He has also helped obtain a financial budget of NT$300 million dollars. Dr. Hsiung is a fellow of the IET, a Senior Member of IEEE and the ACM, and a life member of the IICM. Dr. Hsiung’s main research interests include smart system design, deep learning, AIoT, smart city technology such as smart traffic and smart grid, and embedded real-time system design. 
sapdo
Sapdo Utomo is a researcher at the National Research and Innovation Agency, Jakarta, Indonesia. He is working on his Ph.D. at the Graduate Institute of Ambient Intelligence and Smart Systems at National Chung Cheng University in Min-Hsiung, Chiayi County, 621, Taiwan, R.O.C. His primary research interests include machine learning, federated learning, and trustworthy AI. Utomo received his B.E. in electronics engineering from the Electronic Engineering Polytechnic Institute of Surabaya, Indonesia in 2009, and his M.S. degree in  electrical engineering from  Bandung Institute of Technology, Indonesia in 2012. Contact him at sapdo.utomo@gmail.com
adarsh rouniyar
Adarsh Rouniyar was born in Dewangunj, Nepal. He graduated with a B.Tech degree  in Computer Science and Engineering from Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, India. He is currently a postgraduate student in the Department of Computer Science and Information Engineering at  the National Chung Cheng University (CCU) in Taiwan. He was awarded the Guinness World Record and Asia Book of Records certificate of attendance for the creation of the greatest human image of a wheelchair accessible symbol. He is working on a project entitled "Sustainable Smart Cities Applications" owned by NSTC and CCU, Taiwan. His area of interest includes Federated Learning, Machine Learning, AQI predictions, Data Privacy.
john a
John A, Ph.D., is currently doing Postdoctoral Research in AI and Sustainable Development at Research Lab, National Taiwan University, Taipei, Taiwan. He received his undergraduate degree B.Tech in Computer Science and Engineering Discipline at Pondicherry University. He finished a postgraduate degree in M.Tech in Computer Science and Engineering at Pondicherry University, India. In 2019, he completed a Ph.D under Computer Science and Engineering discipline at Manononmaniam Sundaranar University, India. His research areas of interest are real time applications, Machine Learning, Data analysis and prediction, and Spatial and Temporal Data Management.
GuoHao Jiang
GuoHao Jiang is a student at the National Chung Cheng University in Min-Hsiung, Chiayi County, 621, Taiwan, R.O.C. His primary research interests include the KPI of sustainability, federated learning, machine learning, and trustworthy AI. Jiang received his bachelor’s degree in marine and environment engineering at National Sun Yat-sen University, Taiwan in 2014. Contact him at stanley.gh.jiang@gmail.com
chunhao chang
ChunHao Chang is a student at National Chung Cheng University in Min-Hsiung, Chiayi County, 621, Taiwan, R.O.C. His primary research interests include operation systems, federated learning, machine learning, and transfer learning. He received his bachelor degree in Management Information Systems of National Chung Cheng University, Taiwan in 2021. Contact him at howard31124@gmail.com

IEEE Smart Cities Publications Journals and Magazines Special Issues

This web page displays the effort of IEEE Smart Cities Publications Committee in proposing and guest editing special issues for IEEE Journals and Magazines which is of interests to IEEE Smart Cities Community. Please click here to view.

Past Issues

To view archived articles, and issues, which deliver rich insight into the forces shaping the future of the smart cities. Older eNewsletter can be found here. To download full issues, visit the publications section of the IEEE Smart Cities Resource Center.