Reality Labs Research is looking for an intern to help us develop the next generation assistance systems that guide the users in contextual and adaptive future AR/VR systems. In particular, we are seeking candidates who have experience with either of the following: vision language model, LLM interpretability, multimodal LLM.Work with researchers to help enable their work across the following research disciplines: - Improving the performance of VLM in product-related scenarios- Building white-box mechanisms to better evaluate the capabilities of VLMsOur internships are twelve (12) to twenty-four (24) weeks long and we have various start dates throughout the year. Some projects may require a minimum of 16 consecutive weeks.

Research Scientist Intern, Vision Language Model (PhD) Responsibilities:

• Develop, implement, and evaluate methods for improving the performance/interpretability of VLMs.
• Make use of Meta's large infrastructure to scale and speed up experimentation.
• Write modular research code that can be reused in other contexts.
• Collaborate with other researchers.
• Work towards taking on big problems and deliver clear, compelling, and creative solutions to solve them at scale.
• The work should result in publishable research to appear in a top-tier ML or CV conference (e.g., NeurIPS, ICLR, CVPR, ECCV).

• Currently has or is in the process of pursuing a PhD in machine learning, computer vision, speech processing, applied statistics, computational neuroscience, or relevant technical field.
• Excellent research skills involving defining problems, exploring solutions, and analyzing and presenting results.
• Proficiency in python and machine learning libraries (pytorch, numpy, scikit-learn, scipy, pandas, matplotlib, etc.).
• Deep understanding of vision-language models, supported by quality first-authored publications in related domains.
• Interpersonal skills: cross-group collaboration and cross-culture collaboration.
• Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment.

• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as NeurIPS, ICML, ICLR, CHI, UIST, IMWUT, CVPR, ICCV, ECCV, AAAI, ICRA, SIGGRAPH, ETRA, or similar.
• Experience with VLM/LLM training/fine-tuning.
• Experience on solving traditional CV problems, including but not limited to hand/body pose estimation, object detection, image classification/segmentation, image/video understanding, etc.
• Experience working and communicating cross functionally in a team environment.
• Availability for minimum 16 consecutive week internship.