GPU

Presented the FASTEN work for accelerating segmented matrix multiplication

Review Triton’s Interpreter’s progress and future plans

Went through Proton’s design overview

This paper introduces two extensions to the popular PyTorch machine learning framework, TorchDynamo and TorchInductor, which implement …

High-level overview of PyTorch 2.0 and Triton integration

Our tool provides a profile view and a trace view for GPU-accelerated applications. The profile view identifies where GPU APIs are invoked in CPU calling context, approximates calling context for GPU execution, and analyzes instruction mix for GPU kernels. The tool traces CPU and GPU activities for a large number of processes and threads with minimal overhead.

Triton is a language and compiler for writing highly efficient custom Deep-Learning primitives. The aim of Triton is to provide an open-source environment for expressing tensor math workloads that offers high flexibility, developer productivity and end to end performance.

Advancements in deep learning are often associated with increasing model sizes. Training and deploying large models require …

Presented a talk about Triton and requested feedback from Intel engineers

Presented a talk about Triton and called for contributions to improving the language