Principal Applied Scienctist

Job Description

Overview

Microsoft’s Applied Sciences Group is seeking a visionary and hands-on Principal Applied Scientist to lead research and development in multimodal AI, with a dual focus on image understanding and autoregressive generation across language and vision. This role is ideal for candidates passionate about building real-world systems that unify visual and textual modalities to power next-generation user experiences across devices and platforms.
As a senior member of the team, you will drive innovation across model architecture, training, and deployment, especially for scalable autoregressive models that handle both language and image generation in a unified framework. You will also play a key role in converting cutting-edge research into practical applications and experiences for users across the globe.Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Design and prototype unified token-based architectures that treat text and image data as sequences for coherent multimodal generation

• Lead development of multimodal autoregressive models for tasks such as image captioning, visual question answering, and text-to-image generation.

  • Research, design, and implement state-of-the-art generative models (diffusion, auto-regressive, etc.) for high-quality image and video generation.
  • Build scalable training pipelines for large-scale image-text datasets using discrete tokenisation (e.g. VQ-VAE, DALL·E-style encoders).
  • Optimize deep neural networks for deployment on Neural Processing Units (NPUs) and cloud environments, maximizing efficiency and performance.
  • Collaborate with cross-functional teams to integrate models into Microsoft products and services.
  • Publish research in top-tier venues (CVPR, ICCV, NeurIPS, ICLR) and contribute to the scientific community.
  • Mentor junior scientists and engineers, fostering a collaborative and innovative research environment.

Qualifications

• • Experience deploying models to production or on-device environments.
  • Experience optimizing models for Neural Processing Units (NPUs) or other hardware accelerators.
  • Knowledge of quantization, pruning, and efficient fine-tuning techniques.
  • Experience with prompt engineering, instruction tuning, and RLHF.
  • Exposure to video generation and temporal modeling.
  • Experience mentoring junior scientists or engineers.
  • Strong collaborative skills across cross-functional teams.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.