About

I am currently a member of the technical staff at Anthropic. I recently completed a PhD in computer science at Stanford University, focusing on compilers and parallel programming systems. I was advised by Alex Aiken and Fredrik Kjolstad. During my PhD, I was also a part-time researcher at NVIDIA working with Michael Garland and Mike Bauer. Before that, I was a software engineer at Cockroach Labs. I completed my undergraduate at Carnegie Mellon University, where I was advised by Sam Westrick and Umut Acar.

Outside of work, you can find me lifting weights, playing tennis, cooking and (over) eating.

My resume is available here.

(New) I wrote a new blog post about a recent experience using LLM’s for formal verification of proofs here.

I’ve started a blog, which is available here. I have a variety of articles:

• Technical articles about prior research projects (warp specialization, distributed computing, using LLMs for verification)
• My experiences as a PhD student (the academic job hunt)
• Advice for PhD students and other young researchers (building prototypes, picking research problems)

Research

I’m broadly interested in programming languages and computer systems. My research focuses on the intersection of these fields, in the topic of parallel computing. I’ve been involved in a variety of research directions, including programming systems for modern distributed and accelerated machines, compilation of dense and sparse tensor algebra, and parallel functional languages. See my publications and blog for more information.

Some links to software projects I have taken a part in developing, some more than others:

• The Legate ecosystem (Legate Core, cuNumeric, Legate Sparse)
• DISTAL/SpDISTAL
• TACO
• Legion
• CockroachDB

Publications

• [Preprint] On the Duality of Task and Actor Programming Models. Rohan Yadav, Joseph Guman, Sean Treichler, Michael Garland, Alex Aiken, Fredrik Kjolstad, Michael Bauer (PDF)

• Optimal Software Pipelining and Warp Specialization for Tensor Core GPUs. Proceedings of the Symposium on Operating System Design and Implementation (OSDI) 2026. Rupanshu Soi, Rohan Yadav, Fredrik Kjolstad, Alex Aiken, Maryam Dehnavi, Michael Garland, Michael Bauer (PDF)

• KDRSolvers: Scalable, Flexible, Task-Oriented Krylov Solvers. Proceedings of the Workshop on the Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM) 2025. David Zhang, Rohan Yadav, Alex Aiken, Fredrik Kjolstad, Sean Treichler (PDF)

• Task-Based Tensor Computations on Modern GPUs. ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) 2025. Rohan Yadav, Michael Garland, Alex Aiken, Michael Bauer (PDF)

• Automatic Tracing in Task-Based Runtime Systems. International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2025. Rohan Yadav, Michael Bauer, David Broman, Michael Garland, Alex Aiken, Fredrik Kjolstad (PDF)

• Composing Distributed Computations Through Task and Kernel Fusion. International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) 2025. Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad (PDF)

• Legate Sparse: Distributed Sparse Computing in Python, Proceedings of the International Conference on Supercomputing (SC) 2023. Rohan Yadav, Wonchan Lee, Melih Elibol, Manolis Papadakis, Taylor Lee-Patti, Michael Garland, Alex Aiken, Fredrik Kjolstad, Michael Bauer (PDF, 60 Minute Talk Video, SC 2023 slides)

• Automated Mapping of Task-Based Programs onto Distributed and Heterogeneous Machines, Proceedings of the International Conference on Supercomputing (SC) 2023. Thiago S. F. X. Teixeira, Alexandra Henzinger, Rohan Yadav, Alex Aiken (PDF)

• SpDISTAL: Compiling Distributed Sparse Tensor Computations, Proceedings of the International Conference on Supercomputing (SC) 2022. Rohan Yadav, Alex Aiken, Fredrik Kjolstad (PDF, SC 2022 slides).

• DISTAL: The Distributed Tensor Algebra Compiler, ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) 2022. Rohan Yadav, Alex Aiken, Fredrik Kjolstad (PDF, PLDI 2022 Talk Video, PLDI 2022 slides, 60 minute talk slides).

• Compilation of Sparse Array Programming Models, ACM SIGPLAN Conference on Systems, Programming, Languages, and Applications (SPLASH/OOPLSA) 2021. Rawn Henry, Olivia Hsu, Rohan Yadav, Stephen Chou, Kunle Olukotun, Saman Amarasinghe, Fredrik Kjolstad (PDF, video).

• Disentanglement in Nested-Parallel Programs, ACM SIGPLAN Symposium on Principles of Programming Languages (POPL) 2020. Sam Westrick, Rohan Yadav, Matthew Fluet, Umut A. Acar (PDF, video).

• Disentanglement, Theory and Practice. Undergraduate Thesis. Rohan Yadav (PDF).

• Brief Announcement: A Parallel Algorithm for Subgraph Isomorphism, ACM Symposium on Parallel Algorithms and Architectures (SPAA) 2019. Rohan Yadav, Umut A. Acar (PDF).

Degree Thesis

• PhD Thesis: Building Composable Distributed And Accelerated Software (PDF)

Other writings

• My application statement for the NVIDIA Graduate Fellowship (PDF).
• My qualifying examination report on distributed task-based runtime systems (PDF).
• Blog post about online schema changes in CockroachDB (link).
• Blog post about cockroach demo, a demo database for CockroachDB (link).
• Some RFC’s for major features in CockroachDB:
  • Primary Key Changes
  • Enums and Infrastructure for User Defined Types
  • User Defined Schemas

Teaching

At Carnegie Mellon, I served as a teaching assistant for Principles of Functional Programming, and a multiple time head teaching assistant for Parallel and Sequential Algorithms and Data Structures. At Stanford, I’ve been a CA for Programming Languages and Compilers.

Additionally, I contributed to the starting and development of the Diderot project, a new educational platform developed at Carnegie Mellon that is used by over 500 students and faculty daily. I used to develop and manage the cloud infrastructure for the project.