Commit Graph

511 Commits

Author SHA1 Message Date
Junya Morioka 89bfe94ab1 chore: Update create_matrix.py 2025-12-21 11:22:06 +09:00
Junya Morioka 6502b392f9 remove qemu arm64 docker 2025-12-21 11:15:26 +09:00
Junya Morioka 232329fd63 feat: update Dockerfile for arm64 build 2025-12-21 11:03:33 +09:00
Junya Morioka b532b8593f Merge pull request #71 from mjun0812/feat/manylinux-build
Refactor: Consolidate workflows and add composite action
2025-12-21 04:12:30 +09:00
Junya Morioka f1e5f1ed5b docs: add build environments section to README
- Add table listing all build platforms and their configurations
- Document runner types (GitHub-hosted, Self-hosted, AWS CodeBuild)
- Show container images used for each platform
- Include Linux x86_64, Linux ARM64, and Windows x86_64 environments
2025-12-21 04:10:36 +09:00
Junya Morioka 2f3b1245f7 refactor: consolidate self-hosted workflows with auto-detection
- Merge _build_manylinux_self_host.yml into _build_linux_self_host.yml
- Add automatic package manager detection (apt-get/dnf) for both x86_64 and ARM64
- Add environment check steps to all self-hosted workflows
- Update build.yml to use unified workflow with container-image parameter
- Remove duplicate build_wheels_manylinux_self_hosted job
- Update test workflows to use consolidated workflow
- Remove manylinux_self_hosted matrix configuration
- Set manylinux container image for ARM64 test workflow
2025-12-21 04:06:56 +09:00
Junya Morioka df03c553f7 refactor: extract common build steps into reusable composite action
- Create .github/actions/build-and-upload composite action for shared build logic
- Consolidate Python/uv setup, CUDA setup, wheel building, testing, and upload steps
- Update _build_linux.yml to use new composite action (reduced from 136 to 69 lines)
- Update _build_linux_arm_self_host.yml to use composite action with cleanup enabled
- Update _build_linux_self_host.yml for both container and no-container jobs
- Update _build_manylinux_self_host.yml to use composite action
- Reduce code duplication by ~200+ lines across all workflow files
2025-12-21 03:36:44 +09:00
Junya Morioka 86938251af refactor: improve code structure and documentation with shared utilities
- Move reusable functions (parse_numeric_version, normalize_semantic_version, get_tag_from_url, get_os_emoji, collect_versions_from_assets, format_versions) to common.py for code reuse across scripts
- Add comprehensive docstrings to all modules and functions for better maintainability
- Enhance parse_wheel_filename to support multiple manylinux tags (e.g., manylinux_2_24_x86_64.manylinux_2_28_x86_64)
- Improve normalize_platform_name to handle manylinux formats with multiple tags
- Refactor create_packages.py to use shared utilities from common.py
- Refactor create_release_history.py with improved function naming and error handling
- Refactor create_release_note.py with better error messages and usage documentation
- Decode URL encoding for improved readability in package documentation
- Update docs/packages.md with formatted output from refactored scripts
2025-12-21 03:20:11 +09:00
github-actions[bot] 879974db28 chore: update download statistics
Update download statistics and graph for 2025-12-20
2025-12-20 02:03:35 +00:00
github-actions[bot] 3b51b4b67a chore: update download statistics
Update download statistics and graph for 2025-12-19
2025-12-19 02:10:31 +00:00
github-actions[bot] 4e63e38ee9 docs: update docs for v0.7.0 2025-12-17 19:20:02 +00:00
Junya Morioka 9f2e0d736d Merge branch 'main' of github.com:mjun0812/flash-attention-prebuild-wheels 2025-12-17 18:06:07 +09:00
Junya Morioka 7e97699c9e fix: add tag_name for linux build 2025-12-17 18:05:59 +09:00
github-actions[bot] 29a1068c1b docs: update docs for v0.7.0 2025-12-17 09:04:30 +00:00
Junya Morioka 8bf9488adc Merge pull request #70 from mjun0812/feat/manylinux-build
feat: add manylinux self-hosted build job and enable version matrix
2025-12-17 16:50:56 +09:00
Junya Morioka acb50f4b17 feat: add manylinux self-hosted build job and enable version matrix
- Add manylinux self-hosted build workflow job in build.yml
- Configure manylinux matrix with flash-attn versions 2.6.3, 2.7.4, 2.8.3
- Enable Python versions 3.10, 3.11, 3.12 for manylinux builds
- Configure CUDA versions 12.8 and 13.0 for manylinux builds
- Add manylinux_self_hosted to build and release workflow dependencies
- Update create_matrix.py to enable manylinux_self_hosted matrix configuration
- Disable Windows and Windows CodeBuild matrices temporarily
2025-12-17 16:48:28 +09:00
github-actions[bot] 8fe2eb90aa chore: update download statistics
Update download statistics and graph for 2025-12-17
2025-12-17 02:06:31 +00:00
Junya Morioka 9efebf9016 fix: change step's shell for windows 2025-12-16 22:04:59 +09:00
Junya Morioka 1bbe3b0ca9 ci: fix virtual environment path for Windows workflows
- Update .venv/bin to .venv/Scripts for Windows compatibility
- Use PowerShell syntax for path assignment in _build_windows_code_build.yml
- Ensure correct GitHub PATH environment variable setup on Windows
2025-12-16 21:47:05 +09:00
Junya Morioka a33fbd2c0d feat: update create_matrix.py for windows 2025-12-16 20:55:41 +09:00
Junya Morioka 5bc98e4b5d feat: update create_matrix.py for windows 2025-12-16 20:52:14 +09:00
github-actions[bot] 65a4cd54b3 chore: update download statistics
Update download statistics and graph for 2025-12-16
2025-12-16 02:11:32 +00:00
github-actions[bot] 97b5761cdc chore: update download statistics
Update download statistics and graph for 2025-12-15
2025-12-15 02:20:57 +00:00
github-actions[bot] 9144f7d82b chore: update download statistics
Update download statistics and graph for 2025-12-14
2025-12-14 02:23:25 +00:00
Junya Morioka 64ec9c048a wip: add manylinux build 2025-12-13 22:32:37 +09:00
Junya Morioka 034c45614d wip: add manylinux build 2025-12-13 22:31:59 +09:00
Junya Morioka 7a3fe044d8 ci: fix auditwheel repair step output references
- Add step ID to auditwheel_repair for proper output tracking
- Update wheel path references to use correct step outputs
- Add patchelf dependency for ARM Linux builds
- Add explicit shell specification for manylinux workflow
2025-12-13 20:23:03 +09:00
Junya Morioka b88d206f75 ci: add sudo passwordless configuration for manylinux self-hosted workflow
- Configure root user with passwordless sudo access
- Required for subsequent gh installation step in manylinux build environment
2025-12-13 18:44:15 +09:00
Junya Morioka df77e68130 ci: remove sudo from gh installation in manylinux workflow
- Remove unnecessary sudo calls from dnf commands in self-hosted manylinux environment
- Commands are already executed with root privileges in the CI runner
2025-12-13 18:28:53 +09:00
Junya Morioka 92464a9b3b ci: refactor wheel handling and enable manylinux artifact generation
- Change wheel output to use full path instead of basename for better flexibility
- Add patchelf to build dependencies for wheel repair operations
- Enable auditwheel repair step with proper exclusions for CUDA/torch libraries
- Separate wheel path variable to track both standard and manylinux versions
- Rename manylinux workflow file to reflect its dedicated purpose
- Update workflow references to use renamed manylinux workflow
- Use fromjson() for runner parameter parsing in ARM build workflow
- Update test workflows to use container environment consistently
- Support both manylinux and standard wheel uploads to releases
2025-12-13 18:18:50 +09:00
github-actions[bot] a18d6ac478 docs: update docs for v0.6.9 2025-12-13 09:12:24 +00:00
Junya Morioka a7b3fe362e ci: refactor wheel path variables and adjust build matrix
- Replace WHEEL_NAME variables with WHEEL_PATH to store full file paths
  instead of just filenames, eliminating redundant directory concatenation
- Update all workflow references to use WHEEL_PATH directly in install
  and upload commands
- Simplify manylinux wheel handling by storing full paths in output variables
- Reduce tested versions in Linux self-hosted matrix to focus on Python 3.14
- Reduce tested versions in ARM64 self-hosted matrix to focus on Python 3.14
  and flash-attn 2.8.3
- Apply formatting standardization to Windows CodeBuild matrix
2025-12-13 17:25:23 +09:00
Junya Morioka 5d44bd8cd6 ci: refactor Python installation and enable manylinux wheel generation
- Replace actions/setup-python with uv-based Python installation
- Consolidate build dependencies into Python installation step
- Enable auditwheel repair and manylinux wheel generation across all Linux builds
- Add patchelf as build dependency for glibc compatibility
- Update Python version to 3.14 in build and test workflows
2025-12-13 17:16:05 +09:00
github-actions[bot] fb95a286ec chore: update download statistics
Update download statistics and graph for 2025-12-13
2025-12-13 02:03:59 +00:00
github-actions[bot] 797c36c81b chore: update download statistics
Update download statistics and graph for 2025-12-12
2025-12-12 02:10:44 +00:00
Junya Morioka c899e7f45e wip: add manylinux build 2025-12-11 18:27:36 +09:00
Junya Morioka bb762ba251 wip: add manylinux build 2025-12-11 18:18:18 +09:00
Junya Morioka 9ce129e222 wip: add manylinux build 2025-12-11 17:36:31 +09:00
Junya Morioka 88add986b3 ci: remove auditwheel 2025-12-11 15:06:30 +09:00
github-actions[bot] 00080c08fa chore: update download statistics
Update download statistics and graph for 2025-12-11
2025-12-11 02:11:06 +00:00
Junya Morioka 38ed47024c ci: refactor self-hosted runner configuration to use JSON format
- Convert runs-on array syntax to single runner value with fromjson()
- Update runner parameter defaults to JSON string format
- Add runner labels to build workflow calls
- Update test workflow runner configurations
- Remove unused test-utils.yml workflow
2025-12-11 03:08:03 +09:00
Junya Morioka c561145598 ci: add architecture labels to self-hosted runner configuration
- Add arm64 label to ARM64 self-hosted runner job
- Add x64 label to x86_64 self-hosted runner jobs (both container and non-container)
- Ensures runner selection by both custom runner name and architecture type
2025-12-11 02:45:25 +09:00
Junya Morioka 51ed48b6fb ci: add manylinux wheel generation and upload in Linux self-hosted build
- Add auditwheel repair step to generate manylinux-compatible wheels
- Verify manylinux wheel installation and package imports
- Upload repaired wheels to GitHub release with --clobber flag
2025-12-11 02:37:17 +09:00
Junya Morioka 2e6095a575 fix: reorganize Dockerfile user context and dependency installation
- Move WORKDIR before USER directive to follow Docker best practices
- Run installdependencies.sh as root user with explicit USER root context
- Reorder ENTRYPOINT to the end of the Dockerfile
- Remove unnecessary sudo prefix since running as root
2025-12-11 02:27:49 +09:00
Junya Morioka ab165f3f22 refactor: reorganize auditwheel repair and add manylinux platform support
- Move auditwheel repair after initial release upload with continue-on-error to allow pipeline continuation
- Add manylinux platform normalization support in normalize_platform_name()
- Expand self-hosted build matrix to include Python 3.14 and Flash Attention 2.8.3
- Improve wheel upload flow by separating regular and manylinux wheel handling
2025-12-11 02:26:39 +09:00
Junya Morioka 78470eab40 fix: rename runner name and update ignore pattern 2025-12-11 02:04:33 +09:00
Junya Morioka 61052b550b feat: add auditwheel for manylinux 2025-12-11 01:56:28 +09:00
Junya Morioka 7f2f8c579e chore: add .env.arm in .gitignore 2025-12-11 01:15:11 +09:00
Junya Morioka 521f9dcbaf feat: add ARM64 self-hosted runner build support
- Update build workflow to include ARM64 self-hosted runner job.
- Modify Dockerfile and compose.yml for ARM64 runner setup.
- Add ARM64 self-hosted matrix configuration.
- Update README with ARM64 self-hosted runner instructions.
2025-12-11 01:10:52 +09:00
Junya Morioka 67e64ccae1 ci: refactor ARM64 self-hosted runner workflow configuration
- Rename workflow file from _build_linux_self_host.yml to _build_linux_arm_self_host.yml for clarity
- Update workflow_call inputs to use flexible container image configuration
- Remove use-container flag and replace with container-image parameter
- Consolidate ubuntu image handling with --platform linux/arm64 option
- Update test-arm-self-hosted.yml to reference the renamed workflow
2025-12-11 00:29:39 +09:00