toronto-dev
CentML

Senior Software Engineer - Compiler

CentML • Train and deploy your own ML models while reducing compute and maintaining model accuracy.

Toronto
3 months ago

About Us

We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.

Our founding team is made up of experts in AI, compilers, and ML hardware, having led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems, holding multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.

Overview

Do you want to help drive the development of high-performance, power-efficient datacenter solutions for Deep Learning? Do you have an interest in how system architecture across GPU, networking, CPU, and IO relates to brand-new generative AI capabilities? Come join our team and bring your experience and interests to help us optimize our next generation of inference and training frameworks, and redefine the deep learning industry once again.

Responsibilities

  • Communicate with our product teams and profile ML/DL workloads to acquire an in-depth understanding of the problems (e.g., slow kernels).
  • Identify bottlenecks in slow GPU kernels using profilers.
  • Optimize GPU kernels.
  • Write tests and benchmarks to validate and evaluate our solutions.

Who You Are

  • Bachelor's or higher degree in Computer Science or Engineering.
  • Excellent communication skills and the ability to work in a team.
  • Strong coding skills (in at least one of Python or C++).
  • Solid fundamentals in computer science and engineering topics: algorithms, data structures, operating systems, computer architecture, etc.
  • Strong academic records for candidates with bachelor’s degrees.

You Will Stand Out If You Have

  • 5+ years of experience researching or contributing to HPC/ML/DL systems, frameworks, or libraries (including time as a graduate student).
  • Experience with GPU architecture and GPGPU programming:
    • NVIDIA GPUs: CUDA programming, libraries, and toolkits (e.g., cuDNN, cuBLAS, CUTLASS, nvprof, Nsight Compute, Nsight Systems, etc.).
    • AMD GPUs: ROCm and related libraries and toolkits.
    • OpenCL.
  • Experience developing high-performance kernels for CPUs.
  • Experience developing ML or traditional compilers.
  • Experience with TPU.
  • Strong publication records in top HPC/ML/DL or computer system and architecture venues.

Benefits & Perks

  • An open and inclusive work environment.
  • Employee stock options.
  • Best-in-class medical and dental benefits.
  • Parental Leave top-up for 6 months.
  • Professional development budget.
  • Flexible vacation time to promote a healthy work-life balance.

We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, or any other protected ground under applicable human rights legislation.

CentML strives to respect the dignity and independence of people with disabilities and is committed to providing the same opportunity to succeed as all other employees. Inclusiveness is core to our culture at CentML, and we ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.