Generative AI Deployment Engineer

(Senior) Generative AI Deployment Engineer | AI Start-up | AI interference Solutions / Autonomous Driving | Munich

Are you a Senior-level Engineer with expertise in Generative AI?

This is an opportunity to join a highly funded and expanding startup, working on cutting-edge projects at the forefront of autonomous driving and AI!

We’re looking for a skilled software engineer to join the team in developing a next-generation software stack for distributed AI computing at scale. This role calls for a dynamic individual who understands how to shape and architect scalable and high-performance software to accelerate generative AI workloads on our custom hardware accelerators

Responsibilities:

• AI Stack Development: Contribute to the design and implementation of the software stack that will drive the next generation of high-performance, low-power AI inference hardware.
• Hardware-Software Co-Design: Participate in the co-design of our hardware and software stack, particularly in the area of parallelizing AI models over many devices.
• Future Requirements of ML: Collaborate closely with machine learning engineers to identify the requirements of future machine learning workloads.
• Performance Optimization: Benchmark, analyze, and optimize the performance of key software components of our AI deployment software stack.

Qualifications:

• Experience: 3+ years of relevant software engineering experience.
• Programming Languages: Proficiency in C++, Python, and modern machine learning frameworks.
• ML Deployment: Experience in optimizing and deploying machine learning models, preferably LLMs, for efficient inference.
• Distributed systems: A good understanding of and ideally experience with high-performance distributed computing.
• Hardware Compilation: Familiarity with hardware accelerators (GPUs, TPUs) will help. Experience with open-source compiler technologies such as TVM, XLA, MLIR, or LLVM is a big plus.

What’s on offer?

• The opportunity to play a key role in shaping one of the most exciting and impactful startups globally, revolutionizing a future-defining market like autonomous driving.
• Competitive benefits package including medical, vision, dental and an employee stock purchase plan.
• Flexible work hours & generous PTO policy.

If interested in this role please apply here or send your email directly to george@eu-recruit.com

By applying to this role, you understand that we may collect your personal data and store and process it on our systems. For more information please see our Privacy Notice (https://eu-recruit.com/wp-content/uploads/2020/04/Privacy-Notice.pdf).