AI Research Scientist/Engineer Multimodal VLM and MLLM

Position Overview

As an AI Research Scientist at Autodesk Research, you will be doing fundamental and applied research that will help our customers imagine, design, and make a better world.

We are a team of scientists, researchers, engineers, and designers working together on projects that range from learning-based design systems, computer vision, graphics, robotics, human-computer interaction, sustainability, simulation, manufacturing, architectural design and construction.

This role will report to a Research Manager in the AI Lab.

Location: UK/EMEA, US or Canada Remote or Hybrid

Responsibilities

• Develop new ML models and AI techniques

• Lead on research projects within a global team

• Review relevant AI/ML literature to identify emerging methods, technologies, and best practices

• Explore new data sources and discover techniques for best leveraging data

Minimum Qualifications

• A Master's or PhD in a field related to AI/ML, such as: Computer Science, Mathematics, Statistics, Physics, Linguistics, Mechanical Engineering, or related disciplines

• Strong background applying Deep Learning techniques (including implementing custom architectures, optimizing model performance, developing novel loss functions, metrics, and benchmarks, and deploying production-ready solutions)

• Familiarity in statistical methods for Machine Learning (e.g. Bayesian methods, HMMs, graphical models, dimension reduction, clustering, classification, regression techniques, etc.)

• Familiarity with PyTorch, PyTorch Lightning, or similar frameworks

• Strong coding abilities in Python

• Strong Software development skills and familiarity with GPUs, MLOps, Git, High-performance large-scale ML systems and platforms

• Experience with Transformers, LLMs, NLP, Multi-modal Deep Learning, and VLMs/MLLMs

• Publication track record in machine learning conferences and/or journals

Preferred Qualifications

• Significant post-graduate research experience, or five or more years of work experience (actual job title/position will be commensurate with experience)

• Experience with foundation and open-source models, meta/transfer learning, fine-tuning, distillation, multi-task/continual learning, RL, RLxF, and/or image/audio/video/3D generation/understanding

• Experience or familiarity with the 3D Graphics/Animation, Manufacturing, Engineering, Architecture, and/or Construction domain