xformers

Форк

Jeremy Francis Reizenstein
memory_efficient_attention_partial
2 года назад
fe0526b

Описание

Hackable and optimized Transformers building blocks, supporting a composable construction.

В избранном0

Форки0

Языки

Python58,6%
C++25,1%
Cuda16,1%
Shell0,2%

[refactor] Update checkpoint to call into torch.utils.checkpoint (fairinternal/xformers#954)

2 года назад

.github

update flash-attention to v2.5.2 (fairinternal/xformers#995)

2 года назад

docs

[fmha] Added `LocalAttentionFromBottomRightMask`

2 года назад

examples

whitespace fixes

2 года назад

packaging

[ci] fix compute_wheel_version.py

2 года назад

stubs

[CI] Bumping up black (#315)

4 года назад

tests

memory_efficient_attention_partial

2 года назад

third_party

update flash-attention to v2.5.2 (fairinternal/xformers#995)

2 года назад

xformers

memory_efficient_attention_partial

2 года назад

.clang-format

Initial commit

4 года назад

.coveragerc

Refactor3: Embed flash's PY files as xformers._flash_attn

3 года назад

.editorconfig

Initial commit

4 года назад

.flake8

Revamp CI (mostly conda builds)

3 года назад

.gitignore

[feat] cutlass FlashAttention bias+dropout support (#587)

3 года назад

.gitmodules

Update FlashAttention v2

2 года назад

.isort.cfg

Refactor3: Embed flash's PY files as xformers._flash_attn

3 года назад

.markdownlint.json

Initial commit

4 года назад

.pre-commit-config.yaml

Update flake8 version in CI from 3.8.4 (May 2020) to 6.1.0 (July 2023)

2 года назад

.pyre_configuration

Refactor3: Embed flash's PY files as xformers._flash_attn

3 года назад

BENCHMARKS.md

Fix some internal lints

2 года назад

CHANGELOG.md

Export recent MHA changes from fbcode

2 года назад

4 года назад

2 года назад

Remove NVFuser from xFormers (#843)

2 года назад

LICENSE

Adding the license title (#507)

3 года назад

MANIFEST.in

[sdist] Fix detection of flash-attention verison. Remove some junk from cutlass as well

2 года назад

README.md

Add Luca, Jeremy and Grigory as a contributors (#986)

2 года назад

codecov.yml

Remove experimental folder (#851)

2 года назад

requirements-benchmark.txt

(empty commit message)

2 года назад

requirements-lra.txt

[feat] Compositional attention (#178)

4 года назад

requirements-test.txt

Don't install Triton nightly separately in CI

2 года назад

requirements.txt

[refactor] Update checkpoint to call into torch.utils.checkpoint (fairinternal/xformers#954)

2 года назад

setup.cfg

Initial commit

4 года назад

setup.py

update flash-attention to v2.5.2 (fairinternal/xformers#995)

2 года назад

version.txt

Bumpp dev version to 0.0.25 (fairinternal/xformers#1024)

2 года назад

xFormers - Toolbox to Accelerate Research on Transformers Installing xFormers Benchmarks Using xFormers Citing xFormers Credits

README.md

Описание

Hackable and optimized Transformers building blocks, supporting a composable construction.

Языки

Python58,6%
C++25,1%
Cuda16,1%
Shell0,2%

Сообщить о нарушении

xformers

Jeremy Francis Reizensteinmemory_efficient_attention_partial2 года назадfe0526b

Описание

Языки

Описание

Языки

Jeremy Francis Reizenstein
memory_efficient_attention_partial
2 года назад
fe0526b