AI Deployment Engineer / Generative AI / ML / LLM

Generative AI Deployment Engineer

About the Role

To keep pace in this exciting, multi-disciplinary field, we’re looking for a skilled software engineer to join our team in developing our next-generation software stack for distributed AI computing at scale. This role calls for a dynamic individual who understands how to shape and architect scalable and high-performance software to accelerate generative AI workloads on our custom hardware accelerators

Where you’d help us:

• AI Stack Development: Contribute to the design and implementation of the software stack that will drive the next generation of high-performance, low-power AI inference hardware.
• Hardware-Software Co-Design: Participate in the co-design of our hardware and software stack, particularly in the area of parallelizing AI models over many devices.
• Future Requirements of ML: Collaborate closely with machine learning engineers to identify the requirements of future machine learning workloads.
• Performance Optimization: Benchmark, analyze, and optimize the performance of key software components of our AI deployment software stack.

Qualifications:

• Experience: 3+ years of relevant software engineering experience.
• Programming Languages: Proficiency in C++, Python, and modern machine learning frameworks.
• ML Deployment: Experience in optimizing and deploying machine learning models, preferably LLMs, for efficient inference.
• Distributed systems: A good understanding of and ideally experience with high-performance distributed computing.
• Hardware Compilation: Familiarity with hardware accelerators (GPUs, TPUs) will help. Experience with open-source compiler technologies such as TVM, XLA, MLIR, or LLVM is a big plus.

Reasons to consider joining:

Ground floor opportunity with the team; be part of shaping one of the most exciting new AI products.

• Learning and development opportunities from a highly diverse and talented peer group, including experts in a wide range of fields, from Artificial Intelligence to Systems & Device Engineering.
• Perks including meals, snacks, drinks and us!
• Sharp, motivated co-workers in a fun office environment
• Employee Stock Purchase Plan
• Flexible work hours & generous PTO policies

Apply for the Generative AI Deployment Engineer today! mk@eu-recruit.com