Amazon Research Awards: Foundation Model Development

AWS offers a broad and deep set of services for organizations to create meaningful machine learning solutions faster. Our mission is to share our learnings and ML capabilities as fully managed services, and put them into the hands of every scientist and developer.

AWS is soliciting funding proposals related to foundation model (FM) development, including enhancements for dialogue, factual questioning and answering, text generation, document summarization, image generation, and more. Proposals should be expanding the state of the art in terms of training methods, with a focus on one of the following areas: 1) to reduce incorrect or nonsensical answers, 2) to reduce the sensitivity to tweaks to the input prompt, 3) ask clarifying questions when facing ambiguous questions, 4) develop efficiency enhancements across the training and hosting FM lifecycle.

AWS invites work that both critiques and enhances the state-of-the-art in FM, including but not limited to the following topics:
Reinforcement learning with human feedback
Scaling laws and their inverse, including for model fine-tuning
Novel datasets and training methods
Distillation with enhanced reasoning
Foundation models in novel modalities and domains, such as biology, manufacturing, fashion, etc.
Bias detection and mitigation throughout the foundation model lifecycle
AWS aims to advance foundation model development by funding the creation of open-source artifacts, datasets and code that benefit the research community at large, or impactful research that uses machine learning tools. AWS will provide credits for use on EC2 instances powered by AWS Trainium chips to help researchers develop and test solutions at scale.

Award details
Selected Principal Investigators (PIs) may receive the following:
$250,000 in AWS Promotional Credits, which can be used on generally available EC2 instances that are powered by AWS Trainium chips
AWS Trainium training resources, including AWS tutorials and hands-on sessions with Amazon scientists and engineers
Awards are structured as one-year unrestricted gifts. The budget should include a list of expected costs specified in USD, and should not include administrative overhead costs. Your receipt and use of AWS Promotional Credits is governed by the AWS Promotional Credit Terms and Conditions, which may be updated by AWS from time to time.

Please contact Sara Salmon if you are interested in applying to this opportunity.