• Stars
    star
    1,684
  • Rank 26,692 (Top 0.6 %)
  • Language
    Python
  • License
    Other
  • Created about 7 years ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

๐ŸŽก Build Python wheels for all the platforms with minimal configuration.

cibuildwheel

PyPI Documentation Status Actions Status Travis Status Appveyor status CircleCI Status Azure Status Cirrus CI Status

Documentation

Python wheels are great. Building them across Mac, Linux, Windows, on multiple versions of Python, is not.

cibuildwheel is here to help. cibuildwheel runs on your CI server - currently it supports GitHub Actions, Azure Pipelines, Travis CI, AppVeyor, CircleCI, and GitLab CI - and it builds and tests your wheels across all of your platforms.

What does it do?

macOS Intel macOS Apple Silicon Windows 64bit Windows 32bit Windows Arm64 manylinux
musllinux x86_64
manylinux
musllinux i686
manylinux
musllinux aarch64
manylinux
musllinux ppc64le
manylinux
musllinux s390x
CPythonย 3.6 โœ… N/A โœ… โœ… N/A โœ… โœ… โœ… โœ… โœ…
CPythonย 3.7 โœ… N/A โœ… โœ… N/A โœ… โœ… โœ… โœ… โœ…
CPythonย 3.8 โœ… โœ… โœ… โœ… N/A โœ… โœ… โœ… โœ… โœ…
CPythonย 3.9 โœ… โœ… โœ… โœ… โœ…ยฒ โœ…ยณ โœ… โœ… โœ… โœ…
CPythonย 3.10 โœ… โœ… โœ… โœ… โœ…ยฒ โœ… โœ… โœ… โœ… โœ…
CPythonย 3.11 โœ… โœ… โœ… โœ… โœ…ยฒ โœ… โœ… โœ… โœ… โœ…
CPythonย 3.12โต โœ… โœ… โœ… โœ… โœ…ยฒ โœ… โœ… โœ… โœ… โœ…
PyPyย 3.7 v7.3 โœ… N/A โœ… N/A N/A โœ…ยน โœ…ยน โœ…ยน N/A N/A
PyPyย 3.8 v7.3 โœ… โœ…โด โœ… N/A N/A โœ…ยน โœ…ยน โœ…ยน N/A N/A
PyPyย 3.9 v7.3 โœ… โœ…โด โœ… N/A N/A โœ…ยน โœ…ยน โœ…ยน N/A N/A
PyPyย 3.10 v7.3 โœ… โœ…โด โœ… N/A N/A โœ…ยน โœ…ยน โœ…ยน N/A N/A

ยน PyPy is only supported for manylinux wheels.
ยฒ Windows arm64 support is experimental.
ยณ Alpine 3.14 and very briefly 3.15's default python3 was not able to load musllinux wheels. This has been fixed; please upgrade the python package if using Alpine from before the fix.
โด Cross-compilation not supported with PyPy - to build these wheels you need to run cibuildwheel on an Apple Silicon machine.
โต CPython 3.12 is available using the CIBW_PRERELEASE_PYTHONS option.

  • Builds manylinux, musllinux, macOS 10.9+, and Windows wheels for CPython and PyPy
  • Works on GitHub Actions, Azure Pipelines, Travis CI, AppVeyor, CircleCI, GitLab CI, and Cirrus CI
  • Bundles shared library dependencies on Linux and macOS through auditwheel and delocate
  • Runs your library's tests against the wheel-installed version of your library

See the cibuildwheel 1 documentation if you need to build unsupported versions of Python, such as Python 2.

Usage

cibuildwheel runs inside a CI service. Supported platforms depend on which service you're using:

Linux macOS Windows Linux ARM macOS ARM Windows ARM
GitHub Actions โœ… โœ… โœ… โœ…ยน โœ…ยฒ โœ…โด
Azure Pipelines โœ… โœ… โœ… โœ…ยฒ โœ…โด
Travis CI โœ… โœ… โœ…
AppVeyor โœ… โœ… โœ… โœ…ยฒ โœ…โด
CircleCI โœ… โœ… โœ… โœ…ยฒ
Gitlab CI โœ… โœ… โœ…ยน
Cirrus CI โœ… โœ…ยณ โœ… โœ… โœ…

ยน Requires emulation, distributed separately. Other services may also support Linux ARM through emulation or third-party build hosts, but these are not tested in our CI.
ยฒ Uses cross-compilation. It is not possible to test arm64 and the arm64 part of a universal2 wheel on this CI platform.
ยณ Uses cross-compilation. Thanks to Rosetta 2 emulation, it is possible to test x86_64 and both parts of a universal2 wheel on this CI platform.
โด Uses cross-compilation. It is not possible to test arm64 on this CI platform.

Example setup

To build manylinux, musllinux, macOS, and Windows wheels on GitHub Actions, you could use this .github/workflows/wheels.yml:

name: Build

on: [push, pull_request]

jobs:
  build_wheels:
    name: Build wheels on ${{ matrix.os }}
    runs-on: ${{ matrix.os }}
    strategy:
      matrix:
        os: [ubuntu-20.04, windows-2019, macOS-11]

    steps:
      - uses: actions/checkout@v3

      # Used to host cibuildwheel
      - uses: actions/setup-python@v3

      - name: Install cibuildwheel
        run: python -m pip install cibuildwheel==2.14.1

      - name: Build wheels
        run: python -m cibuildwheel --output-dir wheelhouse
        # to supply options, put them in 'env', like:
        # env:
        #   CIBW_SOME_OPTION: value

      - uses: actions/upload-artifact@v3
        with:
          path: ./wheelhouse/*.whl

For more information, including PyPI deployment, and the use of other CI services or the dedicated GitHub Action, check out the documentation and the examples.

How it works

The following diagram summarises the steps that cibuildwheel takes on each platform.

Explore an interactive version of this diagram in the docs.

Options

Option Description
Build selection CIBW_PLATFORM Override the auto-detected target platform
CIBW_BUILD
CIBW_SKIP
Choose the Python versions to build
CIBW_ARCHS Change the architectures built on your machine by default.
CIBW_PROJECT_REQUIRES_PYTHON Manually set the Python compatibility of your project
CIBW_PRERELEASE_PYTHONS Enable building with pre-release versions of Python if available
Build customization CIBW_BUILD_FRONTEND Set the tool to use to build, either "pip" (default for now) or "build"
CIBW_ENVIRONMENT Set environment variables needed during the build
CIBW_ENVIRONMENT_PASS_LINUX Set environment variables on the host to pass-through to the container during the build.
CIBW_BEFORE_ALL Execute a shell command on the build system before any wheels are built.
CIBW_BEFORE_BUILD Execute a shell command preparing each wheel's build
CIBW_REPAIR_WHEEL_COMMAND Execute a shell command to repair each built wheel
CIBW_MANYLINUX_*_IMAGE
CIBW_MUSLLINUX_*_IMAGE
Specify alternative manylinux / musllinux Docker images
CIBW_CONTAINER_ENGINE Specify which container engine to use when building Linux wheels
CIBW_DEPENDENCY_VERSIONS Specify how cibuildwheel controls the versions of the tools it uses
Testing CIBW_TEST_COMMAND Execute a shell command to test each built wheel
CIBW_BEFORE_TEST Execute a shell command before testing each wheel
CIBW_TEST_REQUIRES Install Python dependencies before running the tests
CIBW_TEST_EXTRAS Install your wheel for testing using extras_require
CIBW_TEST_SKIP Skip running tests on some builds
Other CIBW_BUILD_VERBOSITY Increase/decrease the output of pip wheel

These options can be specified in a pyproject.toml file, as well; see configuration.

Working examples

Here are some repos that use cibuildwheel.

Name CI OS Notes
scikit-learn github icon windows icon apple icon linux icon The machine learning library. A complex but clean config using many of cibuildwheel's features to build a large project with Cython and C++ extensions.
pytorch-fairseq github icon apple icon linux icon Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
NumPy github icon travisci icon windows icon apple icon linux icon The fundamental package for scientific computing with Python.
Tornado travisci icon apple icon linux icon Tornado is a Python web framework and asynchronous networking library, originally developed at FriendFeed.
Matplotlib github icon windows icon apple icon linux icon The venerable Matplotlib, a Python library with C++ portions
NCNN github icon windows icon apple icon linux icon ncnn is a high-performance neural network inference framework optimized for the mobile platform
Prophet github icon windows icon apple icon linux icon Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
Kivy github icon windows icon apple icon linux icon Open source UI framework written in Python, running on Windows, Linux, macOS, Android and iOS
MyPy github icon apple icon linux icon windows icon The compiled version of MyPy using MyPyC.
duckdb github icon apple icon linux icon windows icon DuckDB is an in-process SQL OLAP Database Management System

โ„น๏ธ That's just a handful, there are many more! Check out the Working Examples page in the docs.

Legal note

Since cibuildwheel repairs the wheel with delocate or auditwheel, it might automatically bundle dynamically linked libraries from the build machine.

It helps ensure that the library can run without any dependencies outside of the pip toolchain.

This is similar to static linking, so it might have some license implications. Check the license for any code you're pulling in to make sure that's allowed.

Changelog

v2.14.1

15 July 2023

  • ๐Ÿ›  Updates the prerelease CPython 3.12 version to 3.12.0b4 (#1550)

v2.14.0

10 July 2023

  • โœจ Adds support for building PyPy 3.10 wheels. (#1525)
  • ๐Ÿ›  Updates the prerelease CPython 3.12 version to 3.12.0b3.
  • โœจ Allow the use of the {wheel} placeholder in CIBW_TEST_COMMAND (#1533)
  • ๐Ÿ“š Docs & examples updates (#1532, #1416)
  • โš ๏ธ Removed support for running cibuildwheel in Python 3.7. Python 3.7 is EOL. However, cibuildwheel continues to build Python 3.7 wheels for the moment. (#1175)

v2.13.1

10 June 2023

  • ๐Ÿ›  Updates the prerelease CPython 3.12 version to 3.12.0b2. (#1516)
  • ๐Ÿ›  Adds a moving v<major>.<minor> tag for use in GitHub Actions workflow files. If you use this, you'll get the latest patch release within a minor version. Additionally, Dependabot won't send you PRs for patch releases. (#1517)

v2.13.0

28 May 2023

  • โœจ Adds CPython 3.12 support, under the prerelease flag CIBW_PRERELEASE_PYTHONS. This version of cibuildwheel uses 3.12.0b1.

    While CPython is in beta, the ABI can change, so your wheels might not be compatible with the final release. For this reason, we don't recommend distributing wheels until RC1, at which point 3.12 will be available in cibuildwheel without the flag. (#1507)

  • โœจ Adds the ability to pass arguments to the container engine when the container is created, using the CIBW_CONTAINER_ENGINE option. (#1499)

v2.12.3

19 April 2023

  • ๐Ÿ› Fix an import error when running on Python 3.7. (#1479)

That's the last few versions.

โ„น๏ธ Want more changelog? Head over to the changelog page in the docs.


Contributing

For more info on how to contribute to cibuildwheel, see the docs.

Everyone interacting with the cibuildwheel project via codebase, issue tracker, chat rooms, or otherwise is expected to follow the PSF Code of Conduct.

Maintainers

Credits

cibuildwheel stands on the shoulders of giants.

Massive props also to-

  • @zfrenchee for help debugging many issues
  • @lelit for some great bug reports and contributions
  • @mayeut for a phenomenal PR patching Python itself for better compatibility!
  • @czaki for being a super-contributor over many PRs and helping out with countless issues!
  • @mattip for his help with adding PyPy support to cibuildwheel

See also

Another very similar tool to consider is matthew-brett/multibuild. multibuild is a shell script toolbox for building a wheel on various platforms. It is used as a basis to build some of the big data science tools, like SciPy.

If you are building Rust wheels, you can get by without some of the tricks required to make GLIBC work via manylinux; this is especially relevant for cross-compiling, which is easy with Rust. See maturin-action for a tool that is optimized for building Rust wheels and cross-compiling.

More Repositories

1

pipenv

Python Development Workflow for Humans.
Python
24,500
star
2

pip

The Python package installer
Python
9,178
star
3

pipx

Install and Run Python Applications in Isolated Environments
Python
8,438
star
4

hatch

Modern, extensible Python project management
Python
5,078
star
5

sampleproject

A sample project that exists for PyPUG's "Tutorial on Packaging and Distributing Projects"
Python
4,914
star
6

virtualenv

Virtual Python Environment builder
Python
4,642
star
7

pipfile

Python
3,231
star
8

setuptools

Official project repository for the Setuptools build system
Python
2,251
star
9

flit

Simplified packaging of Python modules
Python
2,070
star
10

twine

Utilities for interacting with PyPI
Python
1,543
star
11

manylinux

Python wheels that work on any linux (almost)
Shell
1,365
star
12

packaging.python.org

Python Packaging User Guide
Python
1,362
star
13

pip-audit

Audits Python environments and dependency trees for known vulnerabilities
Python
888
star
14

setuptools_scm

the blessed package to manage your versions by scm tags
Python
802
star
15

gh-action-pypi-publish

The blessed :octocat: GitHub Action, for publishing your ๐Ÿ“ฆ distribution files to PyPI: https://github.com/marketplace/actions/pypi-publish
Python
795
star
16

get-pip

Helper scripts to install pip, in a Python installation that doesn't have it.
Python
694
star
17

build

A simple, correct Python build frontend
Python
667
star
18

packaging

Core utilities for Python packages
Python
566
star
19

wheel

The official binary distribution format for Python
Python
469
star
20

bandersnatch

A PyPI mirror client according to PEP 381 http://www.python.org/dev/peps/pep-0381/
Python
421
star
21

auditwheel

Auditing and relabeling cross-distribution Linux wheels.
Python
403
star
22

advisory-database

Advisory database for Python packages published on pypi.org
236
star
23

python-manylinux-demo

Demo project for building Python wheels for Linux with Travis-CI
C
221
star
24

sample-namespace-packages

Tests against namespace packages
Python
166
star
25

readme_renderer

Safely render long_description/README files in Warehouse
Python
151
star
26

packaging-problems

An issue tracker for the problems in packaging
140
star
27

trove-classifiers

Canonical source for classifiers on PyPI.
Python
126
star
28

pyproject-hooks

A low-level library for calling build-backends in `pyproject.toml`-based project
Python
115
star
29

installer

A low-level library for installing from a Python wheel distribution.
Python
107
star
30

scripttest

Utilities to help with testing command line scripts
Python
59
star
31

gh-action-pip-audit

A GitHub Action for pip-audit
Python
59
star
32

distlib

A low-level library which implements some Python packaging standards (PEPs) and which could be used by third-party packaging tools to achieve interoperability.
Python
43
star
33

distutils

distutils as found in cpython
Python
42
star
34

.github

Community health files for the Python Packaging Authority
30
star
35

interoperability-peps

Development repo for evolution of PyPA interoperability standards (released versions are published as PEPs on python.org)
Python
22
star
36

pypa.io

Source code for the pypa.io website
Python
22
star
37

integration-test

ensure core packaging tools work well with each other
17
star
38

pkg_resources

Abandoned extraction of pkg_resources. Official version found at /pypa/setuptools.
Python
15
star
39

get-virtualenv

14
star
40

history

history generates history/changelog files for a project
Python
7
star
41

easy_install

Python
7
star
42

wheel-builders

Companion repo for the [email protected] mailing list
7
star
43

browntruck

Python
6
star
44

pypa-docs-theme

Common base Sphinx theme for PyPA projects
Python
6
star
45

docker-python

5
star
46

copr

Package files for building PyPA packages in copr
4
star
47

pep470

Python
4
star
48

pip-test-package

Used in pip's test suite
Python
4
star
49

pypa-bot

Source code behind @pypa-bot (eventually)
3
star
50

pypi-camo

Dockerfile
3
star
51

bot-test

1
star