Hide navigation sidebar

Hide table of contents sidebar

Toggle site navigation sidebar

Tile Language
0.1.0 documentation

Toggle table of contents sidebar

Tile Language
0.1.0 documentation

GET STARTED

Installation Guide
The Tile Language: A Brief Introduction

TUTORIALS

Writing High-Performance Kernels with the Tile Library
Writing High-Performance Kernels with Thread Primitives
Annotate Memory Layout
Debugging Tile Language Programs
Auto-Tuning Techniques for Performance Optimization
Just In Time Compilation
Pipelining Computation and Data Movement

DEEP LEARNING OPERATORS

ElementWise Operators
General Matrix-Vector Multiplication (GEMV)
Triton implementation
Naive Implementation in TileLang
More concurrency
Vectorized Reads
tvm_thread_allreduce Instead of atomicAdd
Autotune
Conclusion
General Matrix-Matrix Multiplication with Tile Library
General Matrix-Matrix Multiplication with Dequantization
Flash Attention
Flash Linear Attention
Convolution
TMAC: Look Up Table Based Mixed Precision Computing

LANGUAGE REFERENCE

Tile Language AST
Tile Language: Primitives
Tile Language: TileLibrary

API Reference

Python API
Toggle child pages in navigation
- tilelang package
  Toggle child pages in navigation
  - tilelang.autotuner package
  - tilelang.cache package
    Toggle child pages in navigation
    - tilelang.cache.kernel_cache module
  - tilelang.carver package
    Toggle child pages in navigation
    - tilelang.carver.arch package
      Toggle child pages in navigation
      - tilelang.carver.arch.driver package
        Toggle child pages in navigation
        
        tilelang.carver.arch.driver.cuda_driver module
      - tilelang.carver.arch.arch_base module
      - tilelang.carver.arch.cdna module
      - tilelang.carver.arch.cpu module
      - tilelang.carver.arch.cuda module
    - tilelang.carver.roller package
      Toggle child pages in navigation
      - tilelang.carver.roller.policy package
        Toggle child pages in navigation
        
        tilelang.carver.roller.policy.common module
        
        tilelang.carver.roller.policy.default module
        
        tilelang.carver.roller.policy.tensorcore module
      - tilelang.carver.roller.shape_inference package
        Toggle child pages in navigation
        
        tilelang.carver.roller.shape_inference.common module
        
        tilelang.carver.roller.shape_inference.tir module
      - tilelang.carver.roller.bestfit module
      - tilelang.carver.roller.hint module
      - tilelang.carver.roller.node module
      - tilelang.carver.roller.rasterization module
    - tilelang.carver.template package
      Toggle child pages in navigation
    - tilelang.carver.analysis module
    - tilelang.carver.common_schedules module
    - tilelang.carver.matmul_analysis module
    - tilelang.carver.utils module
  - tilelang.common package
    Toggle child pages in navigation
    - tilelang.common.transform_kind module
  - tilelang.contrib package
    Toggle child pages in navigation
  - tilelang.engine package
    Toggle child pages in navigation
  - tilelang.intrinsics package
    Toggle child pages in navigation
  - tilelang.jit package
    Toggle child pages in navigation
    - tilelang.jit.adapter package
      Toggle child pages in navigation
      - tilelang.jit.adapter.ctypes package
        Toggle child pages in navigation
        
        tilelang.jit.adapter.ctypes.adapter module
      - tilelang.jit.adapter.cython package
        Toggle child pages in navigation
        
        tilelang.jit.adapter.cython.adapter module
        
        tilelang.jit.adapter.cython.cython_wrapper module
      - tilelang.jit.adapter.base module
      - tilelang.jit.adapter.dlpack module
      - tilelang.jit.adapter.libgen module
      - tilelang.jit.adapter.utils module
      - tilelang.jit.adapter.wrapper module
    - tilelang.jit.env module
    - tilelang.jit.kernel module
  - tilelang.language package
    Toggle child pages in navigation
  - tilelang.layout package
    Toggle child pages in navigation
  - tilelang.math package
  - tilelang.primitives package
    Toggle child pages in navigation
    - tilelang.primitives.gemm package
      Toggle child pages in navigation
      - tilelang.primitives.gemm.base module
      - tilelang.primitives.gemm.gemm_mma module
  - tilelang.profiler package
    Toggle child pages in navigation
    - tilelang.profiler.bench module
  - tilelang.testing package
  - tilelang.tools package
    Toggle child pages in navigation
    - tilelang.tools.Analyzer module
    - tilelang.tools.plot_layout module
  - tilelang.transform package
    Toggle child pages in navigation
    - tilelang.transform.simplify module
  - tilelang.utils package
    Toggle child pages in navigation
  - tilelang.env module

Privacy

Privacy

Back to top

Toggle table of contents sidebar

tilelang.language.memscope module#

Made with Sphinx and @pradyunsg's Furo