pybind11: merge CMake and setuptools version

[tridelat]

Currently, we build pybind11 from CMake for xtensor-python (pybind11_cmake.yaml), but also from setuptools so that it is importable from python (pybind11.yaml).

We need instead to:

• use only one version for pybind11 (instead of having pybind11.yaml and pybind11_cmake.yaml
• enable tests on pybind11 (make sure pytest can be imported)
• make sure xtensor-python builds fine
• make sure that pybind11 is importable from python

[zhang-alvin]

From what I've read, this is largely a deficiency in pybind11:

pybind/pybind11#1379

where the neccessary CMake files should be produced with a setuptools installation but are not.

There is a mini project that fixes this in https://github.com/pybind/cmake_example, but is incompatible with hashdist because of a dependency on the pybind11 submodule.

[tridelat]

@zhang-alvin thanks, then we can keep our current workaround with 2 separate pybind11 installs, leave that issue open, and fix it when the problem is solved on the pybind11 repo itself

[zhang-alvin]

@zhang-alvin thanks, then we can keep our current workaround with 2 separate pybind11 installs, leave that issue open, and fix it when the problem is solved on the pybind11 repo itself

Sounds good. Although to clarify, hashdist does have some logic to handle submodules, but I'm not sure how it's supposed to be setup since the repositories are usually downloaded as bare repositories in the .hashdist/src directory and submodules can't be populated in bare repositories.

[cekees]

@tridelat you can try modifying the hashdist profile_links stage as below:

extends: [cmake_package]

dependencies:
build: [mpi, python, pytest]
run: [mpi, python, pytest]

sources:

• key: tar.gz:d3wvppdimmmq4nldokips6razaop4tmq
  url: https://github.com/pybind/pybind11/archive/v2.4.3.tar.gz

defaults:
relocatable: true

build_stages:

• name: setup_builddir
  after: prologue
  handler: bash
  bash: |
  mkdir -p _build
  cd _build

• name: configure
  debug: true
  extra: [
  '-DCMAKE_CXX_COMPILER:STRING=${MPICXX}',
  '-DPYBIND11_TEST:BOOL=OFF',
  ]

profile_links:

• name: python_packages
  link: 'lib/python{{pyver}}/site-packages/*'
  dirs: true