Commit Graph

Select branches

Hide Pull Requests

3d-parallelism

argparse

better-err

big_api

check-docs

check-for-nccl

composable-tp

context-parallel

context-parallel-experiments

context-parallel-flex-attn

cp-dataloader

cp-pc

dataloader-log

debug-tests

deepspeed-inference

deepspeed-version

device_map_xla_support

disable-seedale-rs

enable-dash

feat-decorator-to-purge-modified-accelerate-env-vars

feat/async-checkpointing

feat/distributed-e2e-tests-phase-0

fix

fix-compile-regions

fix-deepspeed-autobs

fix-dispatch-model-tied-params-memory

fix-fp8

fix-generate

fix-grad-norm

fix-pjrt_device

fix-prod

fix-warnings

fork-tester

fp8-gradient-checkpointing

fp8-stuff

fsdp2-ep-integration

fsdp2-tp

fully-remove-accelerate-config

grad-acc-optimizer-fixes

grad-accum-test

import-util

llama-to-mistral

load-model-across-devices

low-bit-fsdp2

main

make-version-tests-better

mishig25-patch-1

mishig25-patch-2

mixed-precision-experiments

ms-amp

muellerzr-ds-debugging

muellerzr-fix-1.0

muellerzr-fp8-deepspeed-support-v2

muellerzr-msamp-ds-fsdp

muellerzr-nightly-fixings

muellerzr-stateful-dl

new-instance-type

nouamane/context-parallel

parallelism-config

pin-ruff

pip-uv

pippy-duplicates

pippy-integration

reaction-based-runs

release-v0.6.1

release-v0.6.2

revert-3671

revert-fsdp-improv

revert-pr

rm-112

runner

safetensors-default

security-fix/-github-workflows-build_pr_documentation-yml-1775658591

security-fix/-github-workflows-gaudi3_scheduled-yml-1775658612

security-fix/-github-workflows-integration_tests-yml-1775658629

security-fix/-github-workflows-pr_style_bot-yml-1775658646

security-fix/-github-workflows-trufflehog-yml-1775658670

slack-reporter

sp-accelerate-fix-warning

sp-ulysses-accelerate

speedup-docker

test-data

test-deepspeed-unpin

test/doc-bucket-push

torch-22

trainer-tests

transformers-nd-parallel

ulysses-sp

ulysses-torch-backend

unfreeze-4090

use-partialstate

use-supports-context-parallel

uv-take2

v0.12-release

v0.13-release

v0.14-release

v0.15-release

v0.16-release

v0.17-release

v0.18-release

v0.19-release

v0.20-release

v0.21-release

v0.22-release

v0.23-release

v0.24-release

v0.25.0-release

v0.26.0-release

v0.26.1-release

v0.27.0-release

v0.28.0-release

v0.29.0-release

v0.30.0-release

v0.31.0-release

v0.32.0-release

v0.33.0-release

v0.34.0-release

v0.7-release

v1.0.0-release

v1.1.0-release

v1.10.0-release

v1.11.0-release

v1.12.0-release

v1.13.0-release

v1.14.0-release

v1.15.0-release

v1.2.0-release

v1.3.0-release

v1.4.0-release

v1.5.0-release

v1.6.0-release

v1.7.0-release

v1.8.0-release

v1.9.0-release

wip-from-pretrained

xla-gpu-runners

#1

#10

#1000

#1001

#1002

#1003

#1007

#1008

#1009

#1010

#1011

#1013

#1014

#1015

#1016

#1017

#1018

#1020

#1023

#1024

#1025

#1026

#1027

#1028

#1030

#1031

#1035

#1036

#1037

#1039

#104

#1042

#1043

#1045

#1046

#1047

#1049

#105

#1052

#1053

#1055

#1059

#106

#1060

#1061

#1062

#1063

#1064

#1065

#1068

#1069

#107

#1070

#1071

#1074

#1075

#1077

#1079

#108

#1080

#1081

#1082

#1084

#1086

#1087

#1090

#1091

#1094

#1097

#1100

#1107

#1108

#1109

#1111

#1113

#1118

#1121

#1122

#1123

#1124

#1125

#1126

#1127

#1128

#1132

#1134

#1138

#1140

#1141

#1143

#1144

#1145

#1146

#115

#1150

#1151

#1153

#1155

#1156

#1158

#1162

#1164

#1165

#1166

#1168

#1169

#1172

#1175

#1176

#1177

#1179

#1180

#1181

#1184

#1187

#1188

#1189

#1198

#1202

#1203

#1204

#1208

#121

#1211

#1212

#1218

#1219

#1220

#1222

#1224

#1226

#1227

#1229

#1233

#1235

#1236

#1237

#1240

#1241

#1247

#1249

#1250

#1251

#1255

#1259

#1262

#1264

#1267

#1268

#127

#1270

#1272

#1273

#1278

#1279

#1283

#1284

#1285

#1286

#1287

#1288

#1292

#1293

#1295

#1296

#1297

#13

#1304

#1308

#1312

#1313

#1314

#1315

#1318

#1319

#1321

#1322

#1323

#1329

#1332

#1337

#1339

#134

#1340

#1341

#1342

#1348

#1349

#1350

#1352

#1355

#1356

#1361

#1363

#1364

#1367

#1376

#1378

#1379

#138

#1380

#1381

#1385

#1386

#1387

#139

#1391

#1392

#1393

#1397

#1399

#140

#1403

#1406

#1410

#1411

#1413

#1426

#1431

#1433

#1434

#1436

#1437

#1438

#1439

#1440

#1441

#1444

#1446

#1447

#1448

#1449

#1450

#1452

#1453

#1455

#1456

#1457

#1458

#1461

#1465

#1466

#1467

#1468

#1470

#1472

#1477

#1478

#1483

#1484

#149

#1490

#1491

#1492

#1493

#1494

#1495

#1496

#1497

#15

#150

#1502

#1503

#1505

#1506

#1508

#151

#1511

#1512

#1513

#1514

#1517

#152

#1521

#1523

#1525

#1526

#1527

#1529

#1531

#1535

#1536

#1537

#1538

#1539

#1540

#1541

#1542

#1543

#1544

#1545

#1547

#1549

#1551

#1552

#1553

#1554

#1555

#1556

#1557

#1558

#1560

#1561

#1562

#1564

#1565

#1566

#1566

#1567

#1568

#1569

#1570

#1571

#1575

#1576

#1577

#1578

#1579

#1580

#1581

#1582

#1585

#1586

#1587

#1593

#1594

#1595

#1596

#1597

#16

#1603

#1609

#1615

#1616

#1617

#1618

#1623

#1624

#1625

#1626

#1627

#1631

#1632

#1633

#1634

#1636

#1637

#1638

#1639

#164

#1640

#1641

#1642

#1646

#1648

#1650

#1651

#1652

#1653

#1654

#1656

#1657

#1658

#1659

#1660

#1661

#1662

#1664

#1668

#1670

#1671

#1672

#1676

#1678

#1679

#168

#1682

#1689

#1690

#1691

#1692

#1694

#1696

#1697

#1698

#1699

#17

#170

#1701

#1702

#1705

#1706

#1708

#1709

#1712

#1715

#1716

#1717

#1718

#1719

#1720

#1723

#1724

#1725

#1726

#1728

#173

#1731

#1733

#1734

#1735

#1736

#1738

#1740

#1741

#1742

#1745

#1746

#1747

#1748

#1749

#175

#1753

#1755

#1756

#1759

#1760

#1762

#1769

#177

#1771

#1775

#1776

#1777

#1779

#1784

#179

#1790

#1796

#1798

#1799

#180

#1800

#1803

#1806

#1808

#1810

#1812

#1813

#1817

#1819

#1820

#1822

#1824

#1825

#1826

#1827

#1829

#183

#1833

#1834

#1838

#1842

#1846

#1850

#1852

#1853

#1855

#1856

#1868

#187

#1871

#1872

#1874

#1875

#1876

#1877

#1880

#1881

#1884

#1885

#1886

#1887

#189

#1891

#1892

#1894

#1895

#1896

#1898

#1899

#19

#1901

#1904

#1905

#1906

#1909

#1910

#1911

#1913

#1914

#1915

#1916

#1919

#1926

#1935

#1936

#1937

#1939

#1940

#1941

#1947

#1949

#1951

#1953

#1954

#1957

#1959

#1960

#1961

#1963

#1964

#1968

#1969

#1971

#1972

#1973

#1974

#1975

#1976

#1988

#1989

#199

#1992

#1994

#2

#20

#2001

#2005

#2008

#2021

#2026

#2033

#2034

#2036

#2037

#204

#2041

#2042

#2043

#2044

#2045

#2047

#2048

#2050

#2052

#2053

#2054

#2055

#2057

#2058

#206

#2060

#2066

#2069

#2072

#2073

#2075

#2077

#2078

#2080

#2086

#2087

#2088

#2089

#2090

#2092

#2093

#2094

#2096

#2097

#2098

#2099

#21

#2104

#2105

#2110

#2111

#2113

#2115

#2116

#2117

#2119

#212

#2120

#2121

#2123

#2125

#2126

#2131

#2132

#2133

#2134

#2136

#2137

#2138

#2139

#2140

#2145

#2146

#2147

#2150

#2151

#2152

#2153

#2156

#2158

#2166

#2168

#2172

#2173

#2176

#2177

#2180

#2195

#2196

#2197

#2199

#22

#2200

#2204

#2206

#2207

#2212

#2213

#2214

#2217

#2218

#2219

#2221

#2222

#2223

#2224

#2225

#2227

#2230

#2231

#2232

#2233

#2235

#2237

#2238

#2239

#224

#2242

#2253

#2254

#2257

#2263

#2264

#2269

#227

#2271

#2272

#2274

#2276

#2279

#228

#2280

#2284

#2286

#2288

#2290

#2292

#2295

#2296

#23

#2300

#2302

#2304

#2305

#2308

#2309

#2310

#2313

#2315

#2317

#2319

#2321

#2323

#2324

#2325

#2326

#2327

#2329

#2330

#2332

#2339

#234

#2342

#2343

#2344

#2345

#2346

#2349

#2349

#2350

#2351

#2352

#2353

#2354

#2355

#2356

#2363

#2364

#2365

#2366

#2369

#2376

#238

#2381

#2383

#2387

#2388

#2394

#2398

#2400

#2403

#2404

#2406

#2407

#2408

#2409

#241

#2410

#2411

#2412

#2415

#2418

#2419

#2420

#2421

#2422

#2423

#2424

#2425

#2426

#2427

#2430

#2433

#2434

#2435

#2436

#2437

#2438

#2439

#2441

#2442

#2443

#2444

#2445

#2446

#2448

#2449

#2450

#2451

#2452

#2453

#2456

#246

#2460

#2461

#2465

#2466

#2467

#247

#2472

#2473

#2475

#2481

#2483

#249

#2490

#2491

#2493

#2495

#2498

#2499

#25

#250

#2501

#2503

#2504

#2505

#2506

#2507

#2509

#2511

#2516

#252

#2523

#2524

#2525

#2526

#2527

#2530

#2531

#2532

#2533

#2534

#2535

#2538

#254

#2541

#2542

#2544

#2546

#255

#2552

#2554

#2557

#2558

#2561

#2565

#2566

#2569

#2570

#2572

#2576

#2577

#2578

#2579

#258

#2580

#2581

#2584

#2588

#2589

#259

#2590

#2591

#2594

#2595

#26

#2602

#2607

#2608

#2609

#2612

#2613

#2616

#2617

#2619

#2623

#2625

#2628

#263

#2630

#2631

#2634

#2639

#264

#2641

#2644

#2646

#2649

#2650

#2652

#2654

#2655

#2657

#2658

#266

#2662

#2663

#2664

#2666

#2667

#2669

#2670

#2672

#2673

#2674

#2677

#2679

#2681

#2685

#2686

#2687

#2689

#269

#2694

#2695

#2696

#2697

#2699

#270

#2704

#2705

#2706

#2707

#271

#2710

#2711

#2714

#2716

#2717

#2723

#2725

#2728

#2729

#2730

#2732

#2737

#2739

#274

#2740

#2743

#2745

#2748

#275

#2751

#2752

#2753

#2755

#2756

#2757

#2758

#2762

#2763

#2765

#2767

#2770

#2772

#2774

#2776

#2777

#2779

#278

#2781

#2782

#2783

#2788

#2790

#2791

#2794

#2795

#2796

#28

#280

#2800

#2804

#2805

#2806

#2808

#2810

#2814

#2815

#282

#2820

#2822

#2824

#2825

#2826

#2830

#2833

#2836

#284

#2841

#2842

#2843

#2844

#2845

#2850

#2851

#2852

#2853

#2854

#2855

#2856

#2857

#2860

#2861

#2862

#2863

#2864

#2867

#2874

#2875

#2876

#2877

#2878

#2879

#2880

#2883

#2887

#2888

#2889

#289

#2892

#2895

#290

#2902

#2909

#2914

#2916

#2917

#292

#2921

#2927

#2928

#293

#2931

#2932

#2934

#2935

#2936

#2938

#2940

#2941

#2945

#2948

#2950

#2952

#2957

#2959

#2964

#2966

#2977

#298

#2981

#2982

#2983

#2986

#2989

#299

#2991

#2992

#2993

#2994

#2997

#2998

#3

#300

#3003

#3006

#3007

#3008

#3009

#301

#3012

#3016

#3018

#3019

#3021

#3022

#3023

#3024

#3025

#3028

#3029

#3030

#3032

#3033

#3034

#3036

#304

#3042

#3045

#3046

#3047

#3048

#305

#3052

#3053

#3055

#3056

#3057

#306

#3062

#3066

#3068

#3069

#307

#3071

#3074

#3075

#3076

#3077

#308

#3082

#3084

#3085

#3088

#309

#3093

#3095

#3096

#3097

#3098

#3099

#31

#3102

#3103

#3105

#3107

#3108

#3109

#311

#3111

#3112

#3114

#3116

#3118

#3119

#312

#3123

#3129

#313

#3130

#3131

#3132

#3133

#3136

#3137

#3138

#3142

#3143

#3144

#3145

#3146

#3149

#315

#3150

#3154

#3155

#3157

#3159

#316

#3160

#3161

#3162

#3163

#3164

#3165

#3166

#3167

#317

#3173

#3174

#3179

#318

#3181

#3183

#3185

#3186

#3187

#3188

#319

#3191

#3192

#3193

#3194

#3196

#3198

#320

#3204

#3207

#321

#3211

#3213

#3217

#3219

#3220

#3221

#3223

#3226

#3227

#3228

#3229

#323

#3231

#3234

#3235

#3236

#324

#3244

#3246

#3247

#3248

#3251

#3252

#3253

#3255

#3259

#326

#3261

#3262

#3266

#3268

#3270

#3272

#3274

#3275

#3279

#3280

#3282

#3287

#3288

#3289

#329

#3293

#3296

#3298

#3299

#33

#330

#3301

#3302

#3305

#3307

#331

#3311

#3321

#3323

#3324

#3327

#3328

#3329

#3330

#3331

#3332

#3333

#3334

#334

#3340

#3344

#3345

#3346

#3348

#3349

#335

#3350

#3351

#3352

#3355

#3357

#3359

#336

#3361

#3363

#3365

#3366

#3366

#3368

#337

#3373

#3376

#3378

#3383

#3385

#3387

#3388

#339

#3390

#3391

#3394

#3395

#3396

#3397

#340

#3401

#3403

#3405

#3408

#3409

#3416

#3417

#3419

#342

#3420

#3423

#3424

#3427

#343

#3430

#3432

#3439

#344

#3441

#3443

#3444

#3445

#3447

#3448

#3449

#345

#3450

#3451

#3457

#3459

#3460

#3461

#3462

#3464

#3465

#3466

#3469

#347

#3470

#3471

#3472

#3475

#3478

#3479

#3482

#3484

#3488

#3490

#3491

#3492

#3493

#3495

#3496

#3497

#3498

#3499

#35

#3501

#3503

#3504

#3507

#3513

#3514

#3517

#3518

#3519

#352

#3521

#3526

#3527

#3528

#3529

#3530

#3532

#3534

#3535

#3537

#3540

#3541

#3544

#3545

#3546

#3548

#3549

#355

#3556

#3559

#356

#3560

#3561

#3562

#3563

#3564

#3567

#3569

#3570

#3572

#3574

#3575

#3576

#3577

#3578

#3579

#3580

#3581

#3582

#3583

#3585

#3587

#3588

#3589

#3590

#3592

#3593

#3594

#3595

#3597

#3598

#3599

#360

#3601

#3602

#3603

#3604

#3605

#3606

#3608

#3609

#361

#3610

#3611

#3613

#3615

#3618

#3619

#3621

#3623

#3625

#3626

#3627

#3629

#363

#3630

#3631

#3632

#3635

#3636

#3637

#3638

#3640

#3642

#3645

#3646

#3648

#3649

#365

#3650

#3651

#3653

#3654

#3656

#3657

#3659

#3660

#3669

#3671

#3673

#3674

#3675

#3677

#3681

#3682

#3684

#3686

#3687

#3688

#3692

#3695

#3698

#370

#3700

#3701

#3703

#3707

#371

#3712

#3713

#3714

#3715

#3716

#3719

#372

#3720

#3721

#3722

#3725

#3728

#373

#3731

#3733

#3736

#3737

#3739

#374

#3740

#3742

#3743

#3744

#3745

#3750

#3751

#3752

#3753

#3755

#3756

#3757

#3759

#376

#3760

#3761

#3762

#3764

#3765

#3766

#3767

#3769

#377

#3771

#3772

#3773

#3774

#3776

#3777

#3779

#378

#3781

#3782

#3783

#3786

#3787

#379

#3790

#3791

#3796

#3799

#38

#380

#3800

#3808

#3809

#3810

#3815

#3816

#3817

#3819

#3823

#3828

#3831

#3834

#3835

#3837

#3840

#3840

#3841

#3842

#3843

#3845

#3847

#3848

#385

#3850

#3851

#3852

#3853

#3857

#3858

#386

#3862

#3863

#3864

#3865

#387

#3872

#3878

#388

#3880

#3881

#3883

#3884

#3886

#3887

#3888

#3890

#3891

#3892

#3893

#3895

#390

#3900

#3901

#3902

#3904

#3905

#3906

#3907

#3908

#3909

#391

#3910

#3912

#3914

#3915

#3916

#3917

#3918

#3919

#392

#3920

#3921

#3922

#3924

#3926

#3927

#3928

#3929

#3931

#3934

#3935

#3936

#3937

#394

#3940

#3941

#3942

#3943

#3944

#3945

#3946

#3947

#3948

#395

#3950

#3951

#3952

#3953

#3955

#3957

#3958

#3959

#396

#3961

#3962

#3965

#3966

#3969

#397

#3970

#3972

#3973

#3974

#3975

#3976

#3977

#3978

#398

#3980

#3981

#3982

#3984

#3985

#3986

#3987

#3988

#3989

#399

#3992

#3998

#3999

#4

#4000

#4001

#4002

#4003

#4004

#4005

#4006

#4007

#4008

#4009

#401

#4011

#4012

#4012

#4013

#4015

#4017

#4018

#4019

#4020

#4021

#4022

#4023

#4024

#4025

#4026

#4027

#4028

#4031

#4032

#4037

#4038

#4039

#4040

#4042

#4043

#4044

#4045

#4046

#4047

#4048

#4049

#405

#4051

#4052

#4054

#4056

#4057

#4058

#4059

#4060

#4061

#4063

#4064

#4065

#4066

#4068

#4069

#407

#4070

#4071

#4072

#4073

#4076

#4077

#4078

#4079

#408

#4081

#4082

#4083

#4084

#4085

#4087

#4089

#409

#4090

#4091

#4092

#4093

#4095

#4096

#4097

#4098

#410

#4101

#4103

#4104

#4105

#4106

#4107

#4108

#4109

#411

#4110

#4112

#4112

#4113

#4114

#4115

#4116

#4117

#4118

#4119

#4120

#4121

#4123

#4124

#4125

#4126

#4127

#4128

#4129

#413

#4130

#4131

#4132

#4133

#4134

#4135

#4136

#4137

#4138

#4139

#414

#4140

#4141

#4142

#4143

#4144

#4145

#4146

#4147

#4148

#4149

#415

#4150

#4151

#4152

#4153

#4155

#4156

#4157

#4158

#416

#4160

#4161

#4162

#4163

#4164

#4165

#4165

#4166

#4167

#4168

#4169

#417

#4170

#4171

#4172

#4174

#4175

#4177

#4178

#4179

#4180

#4181

#4182

#4184

#4185

#4185

#4186

#4187

#4188

#4189

#419

#4190

#4192

#4193

#4194

#4196

#4197

#4198

#4198

#420

#4201

#4202

#4203

#4205

#4206

#4207

#4208

#4209

#4209

#421

#4210

#4211

#4213

#4214

#4216

#4217

#4218

#4219

#4220

#4221

#4222

#4223

#4224

#4225

#4227

#4228

#4229

#4230

#4231

#4232

#4233

#4234

#4235

#4236

#4237

#4238

#4239

#424

#4241

#4243

#4243

#4244

#4244

#4245

#4245

#4246

#4247

#4248

#425

#4250

#4251

#4252

#4254

#4255

#4256

#4258

#4259

#426

#4260

#4260

#4261

#4262

#4263

#4264

#4266

#4266

#4267

#4268

#427

#4270

#4271

#4272

#4273

#4274

#4275

#4276

#4278

#4279

#428

#4281

#4282

#4284

#4285

#4286

#4287

#4288

#429

#4290

#4291

#4292

#4293

#4294

#4296

#4298

#4299

#43

#430

#4300

#4300

#4301

#4301

#4302

#4303

#4304

#4304

#4305

#4307

#4308

#4309

#4309

#431

#4310

#4310

#4311

#4311

#4312

#4312

#4313

#4314

#4314

#4316

#4317

#4318

#4319

#4319

#432

#4320

#4321

#4322

#4324

#4325

#4326

#4327

#4327

#4328

#4329

#4331

#4332

#4333

#4334

#4335

#4336

#4337

#4338

#4340

#4340

#4341

#4342

#4343

#4344

#4345

#4346

#4347

#4348

#4349

#4350

#4351

#4352

#4354

#4355

#4356

#4357

#4357

#4358

#4360

#4360

#4361

#4361

#4362

#4362

#4363

#4364

#4365

#4365

#4366

#4367

#4367

#4368

#4369

#437

#4370

#4370

#4371

#4372

#4373

#4374

#4375

#4376

#4377

#4377

#4378

#4378

#4379

#4379

#4380

#4380

#4383

#4383

#4384

#4385

#4385

#4386

#4386

#4387

#4387

#4388

#4388

#4389

#4389

#4390

#4390

#44

#441

#442

#445

#447

#456

#457

#458

#459

#460

#461

#462

#463

#464

#465

#466

#467

#468

#469

#470

#472

#475

#477

#478

#479

#481

#482

#484

#487

#488

#489

#493

#494

#495

#50

#500

#504

#505

#506

#509

#510

#511

#513

#514

#517

#519

#52

#522

#523

#524

#527

#528

#529

#530

#531

#532

#533

#534

#539

#54

#540

#542

#544

#545

#546

#547

#548

#550

#551

#553

#554

#556

#557

#558

#56

#562

#563

#564

#565

#567

#568

#569

#571

#572

#573

#576

#577

#578

#579

#58

#580

#581

#583

#584

#588

#589

#590

#591

#594

#595

#596

#598

#599

#6

#602

#603

#604

#605

#606

#607

#610

#611

#612

#613

#619

#62

#620

#622

#623

#625

#626

#627

#629

#63

#630

#631

#633

#634

#635

#637

#638

#642

#643

#645

#649

#651

#655

#656

#657

#660

#665

#666

#667

#67

#670

#671

#672

#673

#674

#675

#676

#680

#682

#683

#686

#687

#688

#695

#696

#698

#699

#7

#70

#701

#702

#703

#704

#705

#708

#709

#710

#711

#712

#713

#714

#715

#716

#718

#719

#722

#724

#725

#726

#727

#728

#73

#732

#734

#735

#737

#738

#739

#740

#741

#742

#744

#746

#747

#748

#749

#751

#753

#755

#756

#758

#759

#761

#766

#768

#772

#773

#774

#775

#776

#777

#778

#779

#78

#780

#781

#782

#783

#789

#79

#790

#792

#794

#795

#797

#8

#800

#802

#803

#808

#81

#810

#811

#812

#813

#814

#815

#818

#819

#82

#820

#821

#823

#824

#825

#827

#828

#829

#830

#836

#837

#838

#839

#840

#842

#848

#849

#850

#851

#853

#855

#856

#857

#859

#860

#861

#862

#863

#865

#868

#869

#87

#871

#872

#873

#877

#878

#88

#881

#884

#887

#889

#89

#890

#891

#892

#893

#894

#895

#896

#9

#902

#904

#905

#906

#907

#909

#911

#915

#916

#917

#920

#921

#926

#927

#928

#932

#935

#937

#939

#941

#942

#943

#945

#949

#950

#951

#955

#959

#962

#966

#968

#972

#978

#979

#98

#981

#982

#983

#984

#988

#989

#990

#991

#999

0.0.1

v0.1.0

v0.10.0

v0.11.0

v0.12.0

v0.13.0

v0.13.1

v0.13.2

v0.14.0

v0.15.0

v0.16.0

v0.17.0

v0.17.1

v0.18.0

v0.19.0

v0.2.0

v0.2.1

v0.20.0

v0.20.1

v0.20.2

v0.20.3

v0.21.0

v0.22.0

v0.23.0

v0.24

v0.24.0

v0.24.1

v0.25.0

v0.26.0

v0.26.1

v0.27.0

v0.27.1

v0.27.2

v0.28.0

v0.29.0

v0.29.1

v0.29.2

v0.29.3

v0.3.0

v0.30.0

v0.30.1

v0.31.0

v0.32.0

v0.32.1

v0.33.0

v0.34.0

v0.34.1

v0.34.2

v0.4.0

v0.5.0

v0.5.1

v0.6.0

v0.6.1

v0.6.2

v0.7.0

v0.7.1

v0.8.0

v0.9.0

v1.0.0

v1.0.0rc0

v1.0.0rc1

v1.0.1

v1.1.0

v1.1.1

v1.10.0

v1.10.1

v1.11.0

v1.12.0

v1.13.0

v1.14.0

v1.15.0

v1.2.0

v1.2.1

v1.3.0

v1.4.0

v1.5.0

v1.5.1

v1.5.2

v1.6.0

v1.7.0

v1.8.0

v1.8.1

v1.9.0

Mono Color

• 4ebc726849 Skip _no_split_modules classes the model doesn't contain when auto-wrapping (#4384) main Quentin Gallouédec 2026-10-09 11:02:48 -04:00
• 419d0e0c87 Allow tensor parallelism next to replicated data parallelism (#4193) Quentin Gallouédec 2026-10-07 10:23:21 -04:00
• 2f4c053a17 FSDP2: move placeholder weights to meta before the fp32 upcast (#4369) 3 people 2026-10-06 15:54:06 +01:00
• 0819856291 Bump doc-builder workflow pin (#4368) Pauline Bailly-MassonandClaude Opus 4.8 2026-10-06 11:19:51 +02:00
• 7d8824f10f chore(deps): bump the actions group with 4 updates (#4366) dependabot[bot] 2026-10-05 14:23:59 +02:00
• 01c73fbdb9 Fix metric padding removal after skip_first_batches (#4235) Excelius 2026-10-01 21:31:42 +08:00
• a68e0d50e7 Fix wait_for_everyone() crashing on MULTI_CPU when the machine has an accelerator (#4354) Joey TanandClaude Fable 5.1 2026-10-01 09:09:08 -04:00
• aebbcc7bd3 [docs] Fix 31 dead or moved links across seven guides (#4348) Pratik Gandhi 2026-09-30 04:30:01 -07:00
• ea1311b108 Fix loading checkpoints with modules offloaded to disk (#4352) David 2026-09-29 11:50:25 -04:00
• a3b865e6d6 Fix IndexError when a tied parameter's partner module is split (#4344) 陈志谦andMarc Sun 2026-09-29 22:58:23 +08:00
• d737ded703 Fix notebook_launcher to propagate mixed_precision to the workers (#4331) 陈志谦andgithub-actions[bot] 2026-09-29 22:37:55 +08:00
• a7c67ecab2 Fix skip_first_batches dropping drop_last, non_blocking, slice_fn, and mesh (#4296) Abreham MeleseandAbreham Melese 2026-09-29 06:43:41 -07:00
• 313d4839b0 chore(deps): bump the actions group with 7 updates (#4350) dependabot[bot]andhf-security-analysis[bot] 2026-09-29 15:23:49 +02:00
• 421af8bee5 Fix accelerator dispatch test on minimum PyTorch (#4336) Marc Sun 2026-09-25 18:32:08 +02:00
• d3c8185746 Fix unwrap_model(keep_fp32_wrapper=False) breaking hooked models (#4255) David 2026-09-25 12:30:16 -04:00
• 0bddf0eb1b Fix ParallelismConfig.to_json returning None instead of the config dict (#4326) 林SOandMarc Sun 2026-09-26 00:22:48 +08:00
• d8dde8fb8b Prefer all_gather_single over deprecated all_gather_into_tensor (#4272) yi111andMarc Sun 2026-09-26 00:19:23 +08:00
• 37569f11bc Fix split_between_processes on tuples with apply_padding=True (#4307) Zhiqi Zhang 2026-09-26 00:09:32 +08:00
• 47bd9b989c Fix balanced_low_0 reading max_memory by position instead of device id (#4298) om singhal 2026-09-25 12:09:01 -04:00
• 8afee62c30 Fix dtype_byte_size reporting zero bytes for sub-byte and packed dtypes (#4237) VihaanAgarwal 2026-09-25 12:07:33 -04:00
• 65f83e49f2 Reduce key merging overhead in OffloadedWeightsLoader (#4281) emme1tandMarc Sun 2026-09-25 09:07:17 -07:00
• 05bf97ef85 Do not import torch.distributed in model_has_dtensor on a non-distributed build (#4250) Jeremy SchoemakerandMarc Sun 2026-09-25 10:31:43 -05:00
• af223223aa Stop accelerate launch from forcing torch.compile dynamic=False (#4254) David 2026-09-25 11:31:37 -04:00
• 032313499e Fix custom accelerator support (#4335) Marc SunandHaifeng Jin 2026-09-25 17:23:27 +02:00
• 51081f7b0f Read ACCELERATE_BYPASS_DEVICE_MAP case-insensitively, like every other flag (#4241) Sreekant Baheti 2026-09-25 08:02:52 -07:00
• 38fc23dea3 chore(deps): bump the actions group with 3 updates (#4299) dependabot[bot] 2026-09-25 16:36:15 +02:00
• 38caef138b Fix VRAM leak from cached int8 weights during CPU/disk offload (#4325) Edward J. Schwartz 2026-09-25 09:55:21 -04:00
• fb85091176 Fix FSDP2 fp16 checkpointing advancing the GradScaler it is restoring (#4291) Haoming SongandMarc Sun 2026-09-24 21:30:11 +08:00
• e3188ec078 Surface the child process error in simple_launcher without withholding its output (#4305) Albert Villanova del Moral 2026-09-23 16:55:14 +02:00
• 3529d1e4c5 Use a Llama fixture for the no-split estimator test (#4322) 4 people 2026-09-23 16:52:43 +02:00
• 53ad613761 Pin GitHub Actions to commit SHAs (#4321) hf-security-analysis[bot]andPauline Bailly-Masson 2026-09-23 15:43:15 +02:00
• 0d4a7fbaab Scope GITHUB_TOKEN permissions per job (#4320) hf-security-analysis[bot] 2026-09-23 14:47:29 +02:00
• e203e1ddf3 Remove duplicate debug key from SageMaker config fixture (#4302) TitusandCodex 2026-09-21 14:23:31 +02:00
• b795b4838e Key the doc build concurrency group on the pull request number (#4247) Albert Villanova del Moral 2026-09-14 16:22:30 +02:00
• ea8a8e7a85 chore(deps): bump the actions group with 4 updates (#4256) dependabot[bot] 2026-09-14 16:21:22 +02:00
• f13f7c13b6 v1.16.0dev Marc Sun 2026-09-09 15:05:32 +02:00
• 6afc1e5ee2 Release: v1.15.0 v1.15.0 v1.15.0-release Marc Sun 2026-09-09 14:56:56 +02:00
• 636a9343b4 Fix nightly CI: tensor parallel size detection and DeepSpeed warmup steps (#4229) Marc Sun 2026-09-09 14:49:52 +02:00
• 385d9fb40b docs: fix three dead links left by the docs restructure (#4230) 陈志谦 2026-09-09 17:54:10 +08:00
• c424d0b82d docs: fix garbled sentence in CONTRIBUTING.md (#4231) 陈志谦 2026-09-09 17:52:50 +08:00
• 0f7e35fe79 Clip grad norm support for dtensors (#4219) Michael BenayounandMarc Sun 2026-09-08 17:50:07 +02:00
• b2ac5095f0 Fix FSDP2/ PEFT/FULL_STATE_DICT dropping every rank's adapter shard except rank 0 (#4206) AmineDiroandMarc Sun 2026-09-08 15:53:10 +02:00
• 33e8bc4992 Fix load_accelerator_state only restoring one RNG backend (#4217) Rakshit SisodiyaandMarc Sun 2026-09-08 18:56:03 +05:30
• 50de3ad45f Treat MPS out-of-memory errors as OOM in find_executable_batch_size (#4227) Caio TheodoroandMarc Sun 2026-09-08 09:25:01 -04:00
• ab5fe8e507 feat: add the neuron device branch in state (#4218) Michael Benayoun 2026-09-08 15:22:27 +02:00
• 9baf95be95 Fix MLFLOW_NESTED_RUN never being able to turn nesting off (#4223) David 2026-09-08 08:57:37 -04:00
• d8544ddf40 Fix accelerate launch --cpu never setting the KMP variables (#4222) DavidandMarc Sun 2026-09-08 08:57:10 -04:00
• 786672cb26 Fix estimate-memory for timm>=1.0.29 by adding the hf-hub: prefix (#4213) Shardul Deshpande 2026-09-08 17:43:18 +05:30
• 2483a167ca Merge branch 'main' into use-supports-context-parallel use-supports-context-parallel Quentin Gallouédec 2026-09-07 17:48:02 -04:00
• b17471b747 Merge branch 'main' into ulysses-torch-backend ulysses-torch-backend Quentin Gallouédec 2026-09-07 16:00:30 -04:00
• 9e5d1de5d2 Fix accelerate env never reading the MPS chip name (#4221) DavidandMarc Sun 2026-09-07 13:14:14 -04:00
• ede1c22bc4 docs: fix mixed precision argument in examples (#4192) Nooby Alan 2026-09-07 18:36:26 +02:00
• a4d394ded8 Fix compile_regions running the uncompiled module (#4188) HyeonJin Kim 2026-09-08 01:32:51 +09:00
• e07f255559 Forward reduce_batch_size_fn through the find_executable_batch_size decorator form (#4160) Vineeth Sai VarikuntlaandMarc Sun 2026-09-07 09:32:30 -07:00
• 29eb9954f9 docs: fix documented parameter names that do not match the signature (#4156) massimiliano1991 2026-09-07 18:32:18 +02:00
• 7b16bf3fac fix: handle FP8 dtypes in disk offload write/read path (#4151) Jeremy SchoemakerandMarc Sun 2026-09-07 11:32:05 -05:00
• 069b3d6d19 Fix memory accounting for integrated CUDA devices (#4187) 3 people 2026-09-07 09:31:48 -07:00
• e965f10031 Reach through the DeepSpeed optimizer wrapper in AcceleratedOptimizer.eval() (#4130) 3 people 2026-09-07 09:19:49 -07:00
• 6bd00de68a Handle missing accelerate executable in env command (#4168) Zhewen Tan 2026-09-08 00:18:28 +08:00
• f627c45e56 chore(deps): bump the actions group across 1 directory with 4 updates (#4182) dependabot[bot] 2026-09-07 18:07:15 +02:00
• 004717a5b0 Report MPS as the accelerator in accelerate env. The accelerator detection chain in (#4158) ZaneandZane Neave 2026-09-08 04:06:55 +12:00
• 69db6aa8d1 Add type hints to utils/memory.py (#4152) Rudrendu PaulandRudrendu 2026-09-07 08:58:06 -07:00
• 8eb8f11554 Add missing type hints in checkpointing.py (#4153) Rudrendu PaulandRudrendu 2026-09-07 08:57:45 -07:00
• 5d0176a952 Fix distributedType -> distributed_type typo in downcast_bf16 guard (#4149) uttam12331anduttam12331 2026-09-07 21:10:58 +05:30
• 4f53d81059 Order the two sp gates the same way and state what the hooks do Quentin Gallouédec 2026-09-05 03:15:31 +00:00
• ea94b7c2a5 Test the sequence-mixing layer check without a hub kernel Quentin Gallouédec 2026-09-05 02:56:49 +00:00
• b89bbc1ff5 Rename utils/ulysses.py to utils/sequence_parallel.py Quentin Gallouédec 2026-09-05 02:29:51 +00:00
• f224a7303f Name the two Ulysses exchanges Quentin Gallouédec 2026-09-05 02:28:10 +00:00
• 196abb08b9 Gather position_ids once per forward instead of once per attention layer Quentin Gallouédec 2026-09-05 01:48:38 +00:00
• a004827adc Split the sequence parallel model preparation by concern Quentin Gallouédec 2026-09-05 01:33:22 +00:00
• 0c8185a1de Resolve the sequence parallel backend in _validate_accelerator Quentin Gallouédec 2026-09-05 00:57:40 +00:00
• 0797158607 Drop flash attention boundaries computed for the local shard Quentin Gallouédec 2026-09-05 00:37:18 +00:00
• f8ee0080fb Let the no-shard-dimension guard see the sp dimension Quentin Gallouédec 2026-09-05 00:25:04 +00:00
• 9229234dbf Merge main into the Ulysses torch backend branch Quentin Gallouédec 2026-09-05 00:18:34 +00:00
• fd132822ff Raise a clear error when FSDP is enabled on a mesh with no shard dimension (#4180) Quentin Gallouédec 2026-09-03 09:55:25 -04:00
• f7cc8e9a57 prepare_model: don't move DTensor-sharded models to the device (#4181) Quentin Gallouédecandgithub-actions[bot] 2026-09-03 09:54:39 -04:00
• 205561932b Resolve an unset sp_backend from the distributed type Quentin Gallouédec 2026-09-02 19:44:50 +00:00
• 1a1d590421 Ulysses torch backend: attention sinks, VLMs on text, refuse non-attention sequence mixers Quentin Gallouédec 2026-09-02 19:12:59 +00:00
• 8814a83cfe Add an FSDP2-native Ulysses sequence parallelism backend (sp_backend="torch") Quentin Gallouédec 2026-09-02 17:08:52 +00:00
• 2ab9b2cc91 Add FSDP2 activation_checkpointing_offload: offload checkpointed layer inputs to pinned CPU memory (#4175) Quentin GallouédecandMarc Sun 2026-09-01 08:11:30 -04:00
• c19955a400 Trim the context-parallel guard comment Quentin Gallouédec 2026-08-31 19:47:33 +00:00
• 10dd4ecf21 Ask transformers whether a model supports context parallelism Quentin Gallouédec 2026-08-31 19:39:55 +00:00
• bd204169b4 Refuse context parallelism for models with sliding-window or chunked attention layers (#4177) Quentin Gallouédec 2026-08-31 15:32:34 -04:00
• 2b55f5a2a3 Fix convert_model_to_fp8_ao converting the first and last linear layers (#4147) Vineeth Sai VarikuntlaandMarc Sun 2026-08-31 08:40:58 -07:00
• 338c19a513 Wrap the comment into one line fsdp2-ep-integration Quentin Gallouédec 2026-08-23 20:16:32 +00:00
• c3f972d763 Revert "is_peft_model: trust the imported peft, not just distribution metadata" Quentin Gallouédec 2026-08-23 19:57:19 +00:00
• 9abe97e772 Merge branch 'fsdp2-ep-mesh-error' into fsdp2-ep-integration Quentin Gallouédec 2026-08-22 13:15:20 +00:00
• 4e3c735351 Merge branches 'fix-is-peft-model-imported' and 'fix-prepare-model-dtensor-to' into fsdp2-ep-integration Quentin Gallouédec 2026-08-22 13:15:20 +00:00
• da22b48d65 prepare_model: don't move DTensor-sharded models to the device Quentin Gallouédec 2026-08-22 09:32:05 +00:00
• a9e2e6b5fc is_peft_model: trust the imported peft, not just distribution metadata Quentin Gallouédec 2026-08-22 07:51:03 +00:00
• 5731088a96 Raise a clear error when FSDP is enabled on a mesh with no shard dimension Quentin Gallouédec 2026-08-21 14:28:39 +00:00
• fd01e35c83 FSDP2 activation checkpointing: wrap the matched transformer layer itself, not each of its children (#4172) Quentin GallouédecandMarc Sun 2026-08-20 15:48:06 -04:00
• 2583573aa6 [test] Update min version torch (#4170) Marc Sun 2026-08-20 17:36:35 +02:00
• f801260713 Fix FSDP2 tied-embedding models on torch >= 2.13: put output embedding in the same fully_shard group (#4171) Quentin Gallouédec 2026-08-20 11:36:02 -04:00
• 7fccde20d2 fix(security): remediate workflow vulnerability in .github/workflows/build_and_run_tests.yml (#4169) hf-security-analysis[bot] 2026-08-18 15:34:44 +02:00
• fc3d11b6ed chore(deps): bump the actions group across 1 directory with 7 updates (#4167) dependabot[bot] 2026-08-18 15:33:39 +02:00
• dc78670cf2 Ensure device-agnostic in docs (#4163) kaixuanliu 2026-08-18 21:32:42 +08:00
• 4ff1f8119d Add tests/distributed E2E suite (Phase 0: DDP smoke + env parity) feat/distributed-e2e-tests-phase-0 Titus von KoellerandClaude Opus 4.7 2026-07-30 13:09:53 +02:00
• 16cb6eb80d Make doc builds faster (#4103) Mishig 2026-07-24 17:58:44 +08:00
• e625c7a325 Fix FSDP sharded checkpoint path resolution (#4119) Haoming Song 2026-07-23 22:19:06 +08:00