Description

As a Research Engineer focused on Multi-Modal Understanding, you will develop advanced algorithms that integrate computer vision with other modalities such as language, audio, and sensor data. You will also drive the curation of multi-modal datasets and ground truth annotation pipelines to support model training and evaluation. You will work closely with our research team to bring innovative multi-modal solutions to production, bridging the gap between visual perception and holistic contextual understanding for immersive applications.

Research Engineer, Computer Vision Responsibilities:

• Design and implement multi-modal understanding systems that combine vision, language, and other sensory inputs to enable richer contextual awareness
• Develop algorithms for cross-modal learning, fusion, and reasoning to improve human-AI interaction
• Lead the curation and management of multi-modal datasets, ensuring data quality and diversity across vision, language, and sensor modalities
• Design and oversee ground truth annotation workflows and quality assurance processes for multi-modal data
• Complete medium to large features spanning multiple tasks independently with minimal to no guidance
• Collaborate with researchers and engineers across computer vision and machine learning teams to drive multi-modal innovation
• Develop well-organized code with proper testing and documentation, building production-ready multi-modal systems

Minimum Qualifications:

• Proven experience with C++ and/or Python, including experience with modern features
• Experience working with deep learning frameworks such as PyTorch and TensorFlow
• Demonstrated experience working collaboratively in cross-functional teams

Preferred Qualifications:

• Master's degree in Computer Science, Computer Vision, Machine Learning, or related field
• Experience with vision-language models or multi-modal transformers
• Publications or contributions to multi-modal understanding research
• Familiarity with large language models and their integration with visual understanding systems
• Experience with data curation, annotation tools, or ground truth labeling pipelines

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [email protected].

$121,992/year to $181,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.