Cambridge Research Intern – Evaluating LLM Agent Systems

Job Description

Are you a PhD student passionate about AI and eager to make a tangible impact on real-world products? Join us at Microsoft Research and M365 Research for a unique opportunity to advance the development of AI through cutting-edge research. Our work directly influences the future of AI products, and we are looking for talented individuals to help us push the boundaries even further. At MSR Cambridge and M365 Research, we are dedicated to pioneering advancements in AI technology. This internship focuses on evaluating and enhancing LLM-based agent systems. For example, consider Microsoft Copilot, an LLM-based agent system that has already revolutionized user experiences. Our research aspires to further improve the experiences of such systems, driving innovation and excellence in AI.

We are seeking ML/NLP PhD students who have a keen interest in evaluation for LLM-based agent systems. Join us in Cambridge for the spring/summer of 2025. You will be part of a welcoming and highly collaborative environment, working on creative and challenging problems throughout your internship.

Responsibilities

· Participate in a 12-week internship program designed to provide hands-on experience and professional development.

· Collaborate with mentors, other interns, and researchers to conduct cutting-edge research and develop AI algorithms and models.

· Present your findings in publications and actively contribute to the vibrant life of the research community.

· Engage in various research areas to broaden your expertise.

Qualifications

Required Qualifications

In addition to the qualifications below, you’ll need to submit a minimum of two reference letters for this position. After you submit your application, a request for letters may be sent to your list of references on your behalf. Note that reference letters cannot be requested until after you have submitted your application, and furthermore, that they might not be automatically requested for all candidates. You may wish to alert your letter writers in advance, so they will be ready to submit your letter.

· Currently enrolled in a PhD program in Computer Science, Mathematics, or a related STEM field.

· Must have at least 1 year of experience in conducting research, writing peer-reviewed publications and software development.

· Experience with one or more of the following: LLM training, inference, architectures, chain-of-thought, prompt-tuning, evaluation, reasoning.

· Interns are expected to be physically located in Cambridge UK, and commence their internship between 1 April – 30 June 2025 Preferred Qualifications

· Publications in top conferences/journals, in at least one of the following areas: natural language processing, statistics, machine learning, and optimization.

· Strong programming skills, preferable in Python.

· Excellent written and verbal communication skills.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.