AI Resident - Learning From Videos (LFV)
Toyota Research Institute (TRI) is focused on improving the quality of human life through advanced AI and robotics. The AI Resident position is a year-long research role for early-career researchers and engineers to contribute to the development of foundation models in embodied AI, particularly in multi-modal learning and spatio-temporal reasoning.
Responsibilities
- Develop, integrate, and deploy algorithms for Multi-Modal and 4D reasoning targeting physical applications
- Handle the ingestion of large-scale datasets for training, including streaming, online, and continual learning
- Contribute innovative solutions at the intersection of machine learning, computer vision, and robotics to improve real-world task performance
- Work closely with robotics and machine learning researchers and engineers to understand theoretical and practical needs
- Follow best practices producing maintainable code, both for internal use as well as for open-sourcing to the scientific community
- Contribute to research publications and technical reports
Skills
- Bachelor's or Master's degree in Computer Science, Electrical Engineering, Robotics, or a related technical field
- Exceptional candidates with equivalent research experience (e.g., strong publication record, open-source contributions, or industry research experience) are encouraged to apply
- Strong background in computer vision and its applications to robotics and embodied systems
- Demonstrated research experience through publications, technical projects, or open-source contributions
- Strong communication skills and a collaborative mindset, with the ability to learn quickly and contribute to team research efforts
- Passionate about assisting and amplifying older adults and those in need through dexterous manipulation, human-robot collaboration, and physical assistance innovation
- Spatio-temporal (4D) computer vision, including multi-view geometry, 3D/4D reconstruction, video generation, self-supervised learning, occlusion reasoning, etc
- Large-scale training of multi-modal deep learning methods, both in terms of dataset sizes and model complexity, context length extension, and efficient attention, distributed computing, etc
- Application of machine learning and computer vision to embodied applications
Benefits
- Medical, dental, and vision insurance
- Paid time off benefits (including holiday pay and sick time)
Company Overview
Company H1B Sponsorship