Skip to content
This repository has been archived by the owner on Aug 7, 2024. It is now read-only.

Pull requests: pytorch-labs/float8_experimental

22 Open 283 Closed
22 Open 283 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[wip] add axiswise granularity to Float8Tensor CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#352 opened Jul 29, 2024 by vkuzo Loading…
[wip] add scaling granularity CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#338 opened Jul 25, 2024 by vkuzo Loading…
[DISCUSSION] fix float8 all-gather in FSDP2 + TP: DTensor(WeightWithDynamicFloat8CastTensor) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#326 opened Jul 24, 2024 by weifengpy • Draft
7
bring back torch.autograd.Function CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#316 opened Jul 16, 2024 by vkuzo Loading…
8
Add rowwise scaling to Float8Inference module CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#305 opened Jul 3, 2024 by drisspg Loading…
Add utility for filtering out skipped tests in large cross-product groups CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#303 opened Jul 3, 2024 by drisspg Loading…
Thread the scaling type argument throughout fp8 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#301 opened Jul 3, 2024 by drisspg Loading…
6
Adds a test comparing the output of torch.compile and export CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#295 opened Jul 1, 2024 by drisspg Loading…
make testing better on amd CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#289 opened Jun 24, 2024 by drisspg Loading…
[not for land] enumerate breakages with module hooks + compile CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#270 opened May 29, 2024 by vkuzo Loading…
1
[not for land] standalone repro of memory leak on float8 + compile + … CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#260 opened May 15, 2024 by vkuzo Loading…
Try dispatching to the decomposed OpOverload to account for inference mode CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#251 opened Apr 10, 2024 by drisspg Loading…
5
Add gpu test config to ci/cd CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#239 opened Mar 19, 2024 by drisspg Loading…
add option for using fused kernel CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#227 opened Feb 27, 2024 by drisspg • Draft
1
Use for each in sync_float8_scales CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#213 opened Feb 14, 2024 by drisspg Loading…
Checkpoint to reduce fp8_weight tensor saved for backwards CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#193 opened Jan 23, 2024 by drisspg Loading…
1
add test for FSDP mixed precision CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#191 opened Jan 18, 2024 by vkuzo Loading…
Add option for recomputing the casted weight during backwards CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#186 opened Jan 13, 2024 by drisspg Loading…
9
update matmul and linear benchmarks with 7B and 13B shapes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#179 opened Jan 4, 2024 by vkuzo Loading…
2
[wip] add option to do activation/grad cast from hooks CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#170 opened Dec 26, 2023 by vkuzo Loading…
5
enumerate breakages of torch.compile + Float8Linear + FSDP/TP/SP CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#168 opened Dec 20, 2023 by vkuzo Loading…
fp8 benchmark testing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#148 opened Nov 18, 2023 by ipiszy • Draft
ProTip! Type g i on any issue or pull request to go back to the issue listing page.