fa3-fwd

library0.0.3pypypiunverified

fa3-fwd provides a forward-only implementation of FlashAttention-3 for efficient attention computation on GPUs. Version 0.0.3, pre-release, no stable release cadence.

ai-ml

pip install fa3-fwd

package ↗

INSTALL

IMPORT

SIG · FA3-FWD

fa3-fwd

ai-mlpythonv0.0.3

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

flash_attn_forward

✓ from fa3_fwd import flash_attn_forward

✗ from fa3fwd import flash_attn_forward

Package uses underscores in module name, not hyphen.

Basic usage of flash attention forward pass.

import torch from fa3_fwd import flash_attn_forward q = torch.randn(1, 8, 64, 128, device='cuda', dtype=torch.bfloat16) k = torch.randn(1, 8, 64, 128, device='cuda', dtype=torch.bfloat16) v = torch.randn(1, 8, 64, 128, device='cuda', dtype=torch.bfloat16) out = flash_attn_forward(q, k, v) print(out.shape)

Debug

Known issues

breakingOnly forward pass is implemented; no backward pass. Cannot be used for training.

fix

Use full FlashAttention-3 library if backward is needed.

affects: all

deprecatedThe API is experimental and may change without notice in future versions.

fix

Pin version if stability is required.

affects: <1.0.0

gotchaRequires CUDA-capable GPU and PyTorch with CUDA. Will raise RuntimeError on CPU.

fix

Ensure tensors are on CUDA device.

affects: all

Upgrade

Version history

0.0.3latest on PyPI · released May 7, 2026

Audit

Dependencies

No dependency data recorded yet.

Agent activity

12 hits · last 30 days

node

Amazon

OpenAI (training)

Resources

packagehttps://pypi.org/project/fa3-fwd/ ↗