Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

ML and CV for Audio

AT Meta
Meta

ML and CV for Audio

Redmond, WA

The Audio team within RL Research is looking for a Researcher Engineer with experience in efficient multimodal machine learning to join our team. You will be building technologies that improve the listener's hearing and conversational experiences under challenging listening conditions using wearable computing. We are looking for expertise in building efficient representation models using audio, visual and speech signals; bridge and integrate AI models with conversational context and domain understanding. You will operate at the intersection of large-scale machine learning systems design and development, and egocentric audio-visual learning and computer vision, and partnering with experts in systems processing; and hardware/software co-design.

Want more jobs like this?

Get Data and Analytics jobs in Redmond, WA delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.


ML and CV for Audio Responsibilities:
  • Work with AI researchers and audio/acoustics domain experts on designing and building novel low-compute, low-power ML and CV for egocentric audio-visual learning
  • Design and build efficient AI engineering frameworks supporting large-scale benchmarking of low-compute, low-power ML and CV models.
  • Implement large-scale benchmarking, online and offline evaluation mechanisms, and related hyper-parameter optimizations for efficient audio-visual learning models
  • Support ML models integration and real-time online testing on research & development platforms for wearables.
  • Support quick prototyping, proof of concept, or proof-of-experience and demonstrations via the real-time integration of ML and CV models into research & development platforms for wearables.
  • Contribute as relevant to datasets designs and large-scale data processing for real-time evaluations of efficient audio-visual machine learning methods.
  • Contribute to technical directions on novel ML research supporting source tracking, source localization, source diarization, and relevant semantic scene understanding with application into egocentric wearable computing in AR and VR.
Minimum Qualifications:
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • Masters degrees or equivalent experience in Computer Sciences, Computer Engineering, Deep Learning, Artificial Intelligence, Machine Learning, Robotics, Computer Vision, Computational Neuroscience, Signal Processing, Speech and Language technologies, or a related field, or equivalent practical experience.
  • Bachelor's degree in computer science, computer engineering, or relevant technical field.
  • 2+ years of research experience working on applied computer vision methods.
  • 1+ years of research experience working on efficient multimodal machine learning algorithms for low-compute and low-power devices.
  • Research-oriented software engineering skills, including fluency with machine learning (e.g., PyTorch, TensorFlow, Scikit-learn, Pandas) and libraries for scientific computing (e.g. SciPy ecosystem).
  • Experience in Python or C++
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.
  • Experience of building collaborative relationships that lead to impact
Preferred Qualifications:
  • PhD in Computer Sciences, Computer Engineering, Deep Learning, Artificial Intelligence, Machine Learning, Robotics, Computer Vision, Computational Neuroscience, Signal Processing, Speech and Language technologies, or a related field, or equivalent practical experience.
  • 3+ yrs of experience working on efficient machine learning or computer vision algorithms.
  • Experience with end-to-end real-time ML pipelines, large-scale ML benchmarking, real-time statistical modeling including heuristics-driven computer vision methods.
  • Experience working on evaluation and benchmarking for vision based LLamas, or related generative AI models
  • Experience working with datasets on preprocessing methods, dataloaders, data tooling and related software engineering platforms.
  • Experience with large-scale or distributed cluster computing for training, development and offline inference of machine learning models.
  • Experience working and communicating cross functionally in a team environment.
  • Experience solving complex problems and comparing alternative solutions, tradeoffs, and diverse points of view to determine a path forward.
  • Demonstrated research and software engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub).
  • Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as publications at leading workshops, journals or conferences such as ACL, NeurIPS, ICLR, EMNLP, CVPR, ICCV, ICML, ECCV, ICASSP, InterSpeech, or similar.
About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.

$70.67/hour to $208,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Client-provided location(s): Redmond, WA, USA
Job ID: a1KDp00000E2TACMA3
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Health Reimbursement Account
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • FSA
    • FSA With Employer Contribution
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
  • Parental Benefits

    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Fertility Benefits
    • Adoption Assistance Program
    • Family Support Resources
  • Work Flexibility

    • Flexible Work Hours
    • Remote Work Opportunities
    • Hybrid Work Opportunities
  • Office Life and Perks

    • Commuter Benefits Program
    • Casual Dress
    • Happy Hours
    • Snacks
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Unlimited Paid Time Off
    • Paid Holidays
    • Personal/Sick Days
    • Sabbatical
    • Leave of Absence
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Pension
    • Company Equity
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
  • Professional Development

    • Learning and Development Stipend
    • Promote From Within
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
    • Lunch and Learns
    • Internship Program
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)

Company Videos

Hear directly from employees about what it is like to work at Meta.