Foundation models for Science: A paradigm shift in AI
0Foundation models represent a paradigm shift in artificial intelligence (AI), offering large-scale, pre-trained machine learning models that serve as adaptable starting points for various specialized applications. Unlike traditional models focused on specific tasks, these models leverage extensive pre-training on diverse datasets to recognize patterns across data, significantly enhancing their flexibility and efficiency for different scientific purposes. This method reduces the need for large, task-specific labeled datasets and lengthy training times, allowing a single foundation model to excel in numerous scientific tasks, often surpassing traditional models, especially in scenarios with limited labeled data. Successful implementation and advancement of foundation models in science necessitate collaborative efforts across interdisciplinary teams, drawing from different research groups, academic and governmental institutions, and technology companies. Emphasizing open science principles, such collaboration promotes transparency, reproducibility, and shared knowledge, enabling broader access to datasets, models, and fine-tuning code. This collective approach not only fosters the development of more effective and versatile foundation models but also ensures their broader acceptance and application within the scientific community, paving the way for accelerated scientific discovery and innovation. This joint presentation will give an overview of the “playbook” to develop Foundation Models for Science grounded in the principles described above. Examples of Foundation models already released as well as the ones being developed will also be presented. These models include the Large Language Model focussed on NASA Science Mission Directorate corpus, Prithvi - Geospatial HLS model as well as new Weather and Climate (WxC) FM. \n\nSpeakers:\n\nDr. Rahul Ramachandran \nNASA MSFC \n\nDr. Sujit Roy \nUniversity of Alabama in Huntsville \n\nThe AI for Good Global Summit is the leading action-oriented United Nations platform promoting AI to advance health, climate, gender, inclusive prosperity, sustainable infrastructure, and other global development priorities. AI for Good is organized by the International Telecommunication Union (ITU) – the UN specialized agency for information and communication technology – in partnership with 40 UN sister agencies and co-convened with the government of Switzerland.\n\nJoin the Neural Network!\n👉 https://aiforgood.itu.int/neural-network/\nThe AI for Good networking community platform powered by AI. \nDesigned to help users build connections with innovators and experts, link innovative ideas with social impact opportunities, and bring the community together to advance the SDGs using AI.\n\n🔴 Watch the latest #AIforGood videos!\n\n\n📩 Stay updated and join our weekly AI for Good newsletter:\nhttp://eepurl.com/gI2kJ5\n\n🗞 Check out the latest AI for Good news:\nhttps://aiforgood.itu.int/newsroom/\n\n📱 Explore the AI for Good blog:\nhttps://aiforgood.itu.int/ai-for-good-blog/\n\n🌎 Connect on our social media:\nWebsite: https://aiforgood.itu.int/\nTwitter: https://twitter.com/AIforGood\nLinkedIn Page: https://www.linkedin.com/company/26511907 \nLinkedIn Group: https://www.linkedin.com/groups/8567748 \nInstagram: https://www.instagram.com/aiforgood \nFacebook: https://www.facebook.com/AIforGood\n\nDisclaimer:\nThe views and opinions expressed are those of the panelists and do not reflect the official policy of the ITU.