Skip to content
View ezhulenev's full-sized avatar
🎯
Focusing
🎯
Focusing
661 followers · 1 following

Achievements

Achievement: Pair Extraordinairex2Achievement: YOLOAchievement: QuickdrawAchievement: Arctic Code Vault ContributorAchievement: Starstruckx3Achievement: Pull Sharkx3

Achievements

Achievement: Pair Extraordinairex2Achievement: YOLOAchievement: QuickdrawAchievement: Arctic Code Vault ContributorAchievement: Starstruckx3Achievement: Pull Sharkx3

Organizations

@llvm @jax-ml @openxla @iree-org

Block or report ezhulenev

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ezhulenev/README.md

LinkedIn profile   OpenXLA

About me

I'm a Senior Staff Software Engineer at Google and a core OpenXLA contributor. My primary focus is scaling XLA:GPU for large-scale pretraining across tens of thousands of NVIDIA GPUs.

  • I build the distributed XLA:GPU compiler and runtime infrastructure that keeps pretraining workloads efficient at cluster scale: thunks, command buffers, asynchronous execution, and communication/compute overlap.
  • My recent work spans NCCL collectives and symmetric memory, multi-peer synchronization, dynamic slice fusion, and GPU allocator and buffer-assignment improvements.
  • I also lead a small team making XLA:CPU work exceptionally well on modern x86 and Arm CPUs at millions-of-QPS scale, and build heterogeneous TPU/GPU + CPU execution for single JAX programs.

Scaling XLA:GPU pretraining

XLA GPU Pretraining at Scale 10,000s of GPUs NCCL Collectives GPU Runtimes Command Buffers Comm / Compute Dynamic Slice Fusion CUDA OpenXLA JAX C++



Additional compiler work

XLA CPU MLIR LLVM Python



Earlier work

TensorFlow Scala Apache Spark


Animated terminal profile highlighting XLA:GPU pretraining at tens-of-thousands-of-GPUs scale

Generated with github-readme-terminal and refreshed weekly by GitHub Actions.

Pinned Loading

  1. openxla/xla openxla/xla Public

    A machine learning compiler for GPUs, CPUs, and ML accelerators

    C++ 4.4k 864

  2. jax-ml/jax jax-ml/jax Public

    Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

    Python 36k 3.7k

  3. triton-lang/triton triton-lang/triton Public

    Development repository for the Triton language and compiler

    MLIR 19.7k 3k

  4. llvm/llvm-project llvm/llvm-project Public

    The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

    LLVM 39.3k 17.8k

  5. iree-org/iree iree-org/iree Public

    A retargetable MLIR-based machine learning compiler and runtime toolkit.

    C++ 3.8k 952

  6. tensorflow/tensorflow tensorflow/tensorflow Public

    An Open Source Machine Learning Framework for Everyone

    C++ 196k 75.6k