TensorICE - Tensor Methods for Interpretable, Controllable, and Efficient Multimodal Foundation Models
Foundation Models have emerged as a dominant paradigm in Artificial Intelligence, demonstrating remarkable capabilities across various domains. However, their massive scale and complexity present significant challenges, including overparameterization leading to a hefty computational cost, lack of interpretability, and potential biases. The technological progress of AI makes these challenges more urgent, with financial and societal impacts that are already observed, including exhibiting biased decision making that may disadvantage underrepresented populations, undesired behavior that is not aligned with user intent, while carrying a significant computational and financial cost for training and inference. The TensorICE project aims to mitigate these challenges by developing novel frameworks and network architectures for interpretable, controllable, and efficient multimodal foundation models. This will be achieved by devising tensor-based optimization problems that can efficiently factorize existing models, while proposing new layers that will exhibit desirable properties by construction, while being able to handle data sources of varying geometry.
As proof-of-concept, TensorICE will develop a novel Multimodal Foundation Model for Climate and Earth Observation Data, integrating diverse data sources such as satellites, ground stations, and simulations. By addressing critical weaknesses in current state-of-the-art AI models, TensorICE has the potential to contribute significantly to advancing our understanding and control of large-scale AI models, the development of more reliable, efficient, and trustworthy AI systems for critical inter-disciplinary applications, hence enhancing efforts towards sustainable development of AI.
CyI Principal Investigator: Assoc. Prof. Dr. Mihalis Nicolaou
Additional Info
- Acronym: TensorICE
- Website: Under construction
- Center: CaSToRC
- Funding Source: RIF/EXCELLENCE/0524
- CyI Funding: €191.400
- Funding Period: --
- Starting Date: 01/05/2025
- End Date: 30/04/2027
- Coordinator: THE CYPRUS INSTITUTE
-
Partners:
Foreign Research Organizations: IMPERIAL COLLEGE LONDON, ATHENA RC – ARCHIMEDES UNIT
