Applied Scientist, Silicon and Systems Group Edge AI

Amazon Devices is an inventive research and development company that designs and engineers high-profile devices like Echo, Fire Tablets, Fire TV, and other consumer devices. We are looking for exceptional scientists to join our Applied Science team to advance the state-of-the-art in developing efficient multimodal language models across our product portfolio. Through close hardware-software integration, we design and train models for resource efficiency across the hardware and software tech stack.

The Silicon and Solutions Group Edge AI team is looking for a talented Applied Scientist who will develop new evaluation methods for multimodal language models and agents for our devices, including audio and vision experiences.

Key job responsibilities include:

• Collaborate with cross-functional engineers and scientists to advance the state of the art in multimodal model evaluations for devices, including audio, images, and videos
• Invent and validate reliability for novel automated evaluation methods for perception tasks, such as fine-tuned LLM-as-judge
• Develop and extend our evaluation framework(s) to support expanding capabilities for multimodal language models
• Analyze large offline and online datasets to understand model gaps, develop methods to interpret model failures, and collaborate with training teams to enhance model capabilities for product use cases
• Work closely with scientists, compiler engineers, data collection, and product teams to advance evaluation methods

A day in the life: As a Scientist with the Silicon and Solutions Group Edge AI team, you'll contribute to innovative methods for evaluating new product experiences and discover ways to enhance our model capabilities and enrich our customer experiences.

- PhD, or a Master's degree and experience in CS, CE, ML or related field
- Experience in patents or publications at top-tier peer-reviewed conferences or journals
- Experience programming in Java, C++, Python or related language
- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
- Experience in building machine learning models for business application

- Experience using Unix/Linux
- Experience in professional software development
- Experience with popular deep learning frameworks such as MxNet and Tensor Flow

Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.