Skip to content

Example script crashes when bfgn is installed using provided environment.yaml files #103

@rachelemason

Description

@rachelemason

I installed bfgn following the CPU instructions in the README file, then put the contents of the termite_mound_example.py file into a Jupyter notebook in order to step through it piece by piece, making only the minimum modifications to the script necessary for it to run in the notebook. The fit_model_with_data_container step failed with the following error:

W tensorflow/core/framework/op_kernel.cc:1401] OP_REQUIRES failed at mkl_slice_op.cc:438 : Aborted: Operation received an exception:Status: 5, message: could not create a view primitive descriptor, in file tensorflow/core/kernels/mkl_slice_op.cc:435

I obtained a Jupyter notebook version of the termite example script from Megs Seeley along with a listing of the packages in the conda environment in which she successfully ran the notebook. I find that the notebook runs successfully in that environment, but fails in my environment. I suspect that the important difference between the environments is that the one I created from the environment.yaml file on github uses python=3.7 and tensorflow=1.13.1, while Megs' environment uses python=3.6 and tensorflow=1.12.0. I haven't been able to fully test that because conda runs into a mess of inconsistencies when I try to downgrade numpy and scipy.

Here are the contents of environments under which the example script does not and does run, respectively:

packages in environment at /home/remason2/.conda/envs/bfgn-cpu:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
_tflow_select 2.3.0 mkl
absl-py 0.15.0 pyhd3eb1b0_0
affine 2.3.0 pyhd3eb1b0_0
albumentations 1.0.3 pyhd8ed1ab_0 conda-forge
astor 0.8.1 py37h06a4308_0
attrs 21.4.0 pyhd3eb1b0_0
backcall 0.2.0 pypi_0 pypi
bfgn 0.1.0 dev_0
blas 1.0 mkl
brotli 1.0.9 he6710b0_2
brotlipy 0.7.0 py37h27cfd23_1003
bzip2 1.0.8 h7b6447c_0
c-ares 1.18.1 h7f8727e_0
ca-certificates 2022.4.26 h06a4308_0
cairo 1.16.0 h19f5f5c_2
certifi 2022.6.15 py37h06a4308_0
cffi 1.15.0 py37hd667e15_1
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 7.1.2 pyhd3eb1b0_0
click-plugins 1.1.1 pyhd3eb1b0_0
cligj 0.7.2 py37h06a4308_0
cloudpickle 2.1.0 pyhd8ed1ab_0 conda-forge
colorama 0.4.5 py37h06a4308_0
cryptography 37.0.1 py37h9ce1e76_0
curl 7.67.0 hbc83047_0
cycler 0.11.0 pyhd3eb1b0_0
cytoolz 0.11.2 py37h540881e_2 conda-forge
dask-core 2022.2.0 pyhd8ed1ab_0 conda-forge
dataclasses 0.8 pyh6d0b6a4_7
dbus 1.13.18 hb2f20db_0
debugpy 1.6.0 pypi_0 pypi
decorator 5.1.1 pyhd8ed1ab_0 conda-forge
entrypoints 0.4 pypi_0 pypi
expat 2.4.4 h295c915_0
ffmpeg 4.1.3 h167e202_0 conda-forge
fiona 1.8.4 py37hc38cc03_0
fontconfig 2.13.1 h6c09931_0
fonttools 4.25.0 pyhd3eb1b0_0
freetype 2.11.0 h70c0345_0
freexl 1.0.6 h27cfd23_0
fsspec 2022.5.0 pyhd8ed1ab_0 conda-forge
gast 0.5.3 pyhd3eb1b0_0
gdal 2.3.3 py37hbb2a789_0
geos 3.7.1 he6710b0_0
giflib 5.1.4 h14c3975_1
glib 2.69.1 h4ff587b_1
gmp 6.2.1 h58526e2_0 conda-forge
gnutls 3.6.13 h85f3911_1 conda-forge
graphite2 1.3.13 h58526e2_1001 conda-forge
grpcio 1.42.0 py37hce63b2e_0
gst-plugins-base 1.14.0 h8213a91_2
gstreamer 1.14.0 h28cd5cc_2
h5py 2.10.0 py37h7918eee_0
harfbuzz 2.4.0 h37c48d4_1 conda-forge
hdf4 4.2.13 h3ca952b_2
hdf5 1.10.4 hb1b8bf9_0
icu 58.2 he6710b0_3
idna 3.3 pyhd3eb1b0_0
imageio 2.13.1 pyhd8ed1ab_0 conda-forge
imgaug 0.4.0 pyhd8ed1ab_1 conda-forge
importlib-metadata 4.11.3 py37h06a4308_0
intel-openmp 2021.4.0 h06a4308_3561
ipykernel 6.15.0 pypi_0 pypi
ipython 7.34.0 pypi_0 pypi
jasper 1.900.1 h07fcdf6_1006 conda-forge
jedi 0.18.1 pypi_0 pypi
joblib 1.1.0 pyhd3eb1b0_0
jpeg 9e h7f8727e_0
json-c 0.13.1 h1bed415_0
jupyter-client 7.3.4 pypi_0 pypi
jupyter-core 4.10.0 pypi_0 pypi
kealib 1.4.7 hd0c454d_6
keras 2.2.4 0
keras-applications 1.0.8 py_1
keras-base 2.2.4 py37_0
keras-preprocessing 1.1.2 pyhd3eb1b0_0
kiwisolver 1.4.2 py37h295c915_0
krb5 1.16.4 h173b8e3_0
lame 3.100 h7f98852_1001 conda-forge
lcms2 2.12 h3be6417_0
ld_impl_linux-64 2.38 h1181459_1
libblas 3.9.0 12_linux64_mkl conda-forge
libboost 1.67.0 h46d08c1_4
libcblas 3.9.0 12_linux64_mkl conda-forge
libcurl 7.67.0 h20c2e04_0
libdap4 3.19.1 h6ec2957_0
libedit 3.1.20210910 h7f8727e_0
libffi 3.3 he6710b0_2
libgcc-ng 11.2.0 h1234567_1
libgdal 2.3.3 h2e7e64b_0
libgfortran-ng 7.5.0 hae1eefd_17 conda-forge
libgfortran4 7.5.0 ha8ba4b0_17
libgomp 11.2.0 h1234567_1
libiconv 1.16 h516909a_0 conda-forge
libkml 1.3.0 h590aaf7_4
liblapack 3.9.0 12_linux64_mkl conda-forge
liblapacke 3.9.0 12_linux64_mkl conda-forge
libnetcdf 4.6.1 h11d0813_2
libpng 1.6.37 hbc83047_0
libpq 11.5 hd9ab2ff_2 conda-forge
libprotobuf 3.20.1 h4ff587b_0
libspatialite 4.3.0a hb08deb6_19
libssh2 1.10.0 h8f2d780_0
libstdcxx-ng 11.2.0 h1234567_1
libtiff 4.1.0 h2818925_1
libuuid 1.0.3 h7f8727e_2
libwebp 1.0.2 h576950b_1 conda-forge
libxcb 1.15 h7f8727e_0
libxml2 2.9.14 h74e7548_0
locket 1.0.0 pyhd8ed1ab_0 conda-forge
lz4-c 1.9.3 h295c915_1
markdown 3.3.4 py37h06a4308_0
matplotlib 3.3.4 py37h06a4308_0
matplotlib-base 3.3.4 py37h62a2d02_0
matplotlib-inline 0.1.3 pypi_0 pypi
mkl 2021.4.0 h06a4308_640
mkl-service 2.4.0 py37h7f8727e_0
mkl_fft 1.3.1 py37hd3c417c_0
mkl_random 1.2.2 py37h51133e4_0
mock 4.0.3 pyhd3eb1b0_0
munch 2.5.0 pyhd3eb1b0_0
munkres 1.1.4 py_0
ncurses 6.3 h7f8727e_2
nest-asyncio 1.5.5 pypi_0 pypi
nettle 3.6 he412f7d_0 conda-forge
networkx 2.5 py_0 conda-forge
numpy 1.21.5 py37h6c91a56_3
numpy-base 1.21.5 py37ha15fc14_3
olefile 0.46 py37_0
opencv 4.1.0 py37h5517eff_4 conda-forge
openh264 1.8.0 hdbcaa40_1000 conda-forge
openjpeg 2.4.0 h3ad879b_0
openssl 1.1.1p h5eee18b_0
packaging 21.3 pyhd3eb1b0_0
parso 0.8.3 pypi_0 pypi
partd 1.2.0 pyhd8ed1ab_0 conda-forge
pcre 8.45 h295c915_0
pexpect 4.8.0 pypi_0 pypi
pickleshare 0.7.5 pypi_0 pypi
pillow 8.3.1 py37h2c7a002_0
pip 21.2.2 py37h06a4308_0
pixman 0.40.0 h7f8727e_1
poppler 0.65.0 h581218d_1
poppler-data 0.4.11 h06a4308_0
proj4 5.2.0 h295c915_1001
prompt-toolkit 3.0.29 pypi_0 pypi
protobuf 3.20.1 py37h295c915_0
psutil 5.8.0 py37h27cfd23_1
ptyprocess 0.7.0 pypi_0 pypi
pycparser 2.21 pyhd3eb1b0_0
pygments 2.12.0 pypi_0 pypi
pyopenssl 22.0.0 pyhd3eb1b0_0
pyparsing 3.0.4 pyhd3eb1b0_0
pyqt 5.9.2 py37h05f1152_2
pysocks 1.7.1 py37_1
python 3.7.13 h12debd9_0
python-dateutil 2.8.2 pyhd3eb1b0_0
python_abi 3.7 2_cp37m conda-forge
pywavelets 1.3.0 py37hda87dfa_1 conda-forge
pyyaml 5.4.1 py37h27cfd23_1
pyzmq 23.2.0 pypi_0 pypi
qt 5.9.7 h5867ecd_1
rasterio 1.0.21 py37hc38cc03_0
readline 8.1.2 h7f8727e_1
requests 2.27.1 pyhd3eb1b0_0
scikit-image 0.16.2 py37hb3f55d8_0 conda-forge
scikit-learn 0.24.2 py37ha9443f7_0
scipy 1.7.3 py37hc147768_0
setuptools 61.2.0 py37h06a4308_0
shapely 1.6.4 py37h86c5351_0
sip 4.19.8 py37hf484d3e_0
six 1.16.0 pyhd3eb1b0_1
snuggs 1.4.7 pyhd3eb1b0_0
sqlite 3.38.3 hc218d9a_0
tensorboard 1.13.1 py37hf484d3e_0
tensorflow 1.13.1 mkl_py37h54b294f_0
tensorflow-base 1.13.1 mkl_py37h7ce6ba3_0
tensorflow-estimator 1.13.0 py_0
termcolor 1.1.0 py37h06a4308_1
threadpoolctl 2.2.0 pyh0d69192_0
tk 8.6.12 h1ccaba5_0
toolz 0.11.2 pyhd8ed1ab_0 conda-forge
tornado 6.1 py37h27cfd23_0
tqdm 4.63.0 pyhd3eb1b0_0
traitlets 5.3.0 pypi_0 pypi
typing_extensions 4.1.1 pyh06a4308_0
urllib3 1.26.9 py37h06a4308_0
wcwidth 0.2.5 pypi_0 pypi
werkzeug 2.0.3 pyhd3eb1b0_0
wheel 0.37.1 pyhd3eb1b0_0
x264 1!152.20180806 h14c3975_0 conda-forge
xerces-c 3.2.3 h780794e_0
xz 5.2.5 h7f8727e_1
yaml 0.2.5 h7b6447c_0
zipp 3.8.0 py37h06a4308_0
zlib 1.2.12 h7f8727e_2
zstd 1.5.2 ha4553b6_0

packages in environment at /home/remason2/.conda/envs/bfgn-again:

Name Version Build Channel

_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
_tflow_select 2.3.0 mkl
absl-py 0.15.0 pyhd3eb1b0_0
affine 2.3.0 pyhd3eb1b0_0
albumentations 1.1.0 pypi_0 pypi
astor 0.8.1 py36h06a4308_0
attrs 21.4.0 pyhd3eb1b0_0
backcall 0.2.0 pypi_0 pypi
bfgn 0.1.0 dev_0
blas 1.0 mkl
brotlipy 0.7.0 py36h27cfd23_1003
bzip2 1.0.8 h7b6447c_0
c-ares 1.18.1 h7f8727e_0
ca-certificates 2022.4.26 h06a4308_0
cairo 1.16.0 h19f5f5c_2
certifi 2021.5.30 py36h06a4308_0
cffi 1.14.6 py36h400218f_0
charset-normalizer 2.0.4 pyhd3eb1b0_0
click 7.1.2 pyhd3eb1b0_0
click-plugins 1.1.1 pyhd3eb1b0_0
cligj 0.7.2 py36h06a4308_0
colorama 0.4.4 pyhd3eb1b0_0
coverage 5.5 py36h27cfd23_2
cryptography 35.0.0 py36hd23ed53_0
curl 7.67.0 hbc83047_0
cycler 0.11.0 pyhd3eb1b0_0
cython 0.29.24 py36h295c915_0
dataclasses 0.8 pyh4f3eec9_6
dbus 1.13.18 hb2f20db_0
decorator 5.1.1 pypi_0 pypi
entrypoints 0.4 pypi_0 pypi
expat 2.4.4 h295c915_0
fiona 1.8.4 py36hc38cc03_0
fontconfig 2.13.1 h6c09931_0
freetype 2.11.0 h70c0345_0
freexl 1.0.6 h27cfd23_0
gast 0.5.3 pyhd3eb1b0_0
gdal 2.3.3 py36hbb2a789_0
geos 3.7.1 he6710b0_0
giflib 5.1.4 h14c3975_1
glib 2.69.1 h4ff587b_1
grpcio 1.36.1 py36h2157cd5_1
gst-plugins-base 1.14.0 h8213a91_2
gstreamer 1.14.0 h28cd5cc_2
h5py 2.10.0 py36h7918eee_0
hdf4 4.2.13 h3ca952b_2
hdf5 1.10.4 hb1b8bf9_0
icu 58.2 he6710b0_3
idna 3.3 pyhd3eb1b0_0
imageio 2.15.0 pypi_0 pypi
importlib-metadata 4.8.1 py36h06a4308_0
intel-openmp 2022.0.1 h06a4308_3633
ipykernel 5.5.6 pypi_0 pypi
ipython 7.16.3 pypi_0 pypi
ipython-genutils 0.2.0 pypi_0 pypi
jedi 0.17.2 pypi_0 pypi
joblib 1.1.0 pypi_0 pypi
jpeg 9e h7f8727e_0
json-c 0.13.1 h1bed415_0
jupyter-client 7.1.2 pypi_0 pypi
jupyter-core 4.9.2 pypi_0 pypi
kealib 1.4.7 hd0c454d_6
keras 2.2.4 0
keras-applications 1.0.8 py_1
keras-base 2.2.4 py36_0
keras-preprocessing 1.1.2 pyhd3eb1b0_0
kiwisolver 1.3.1 py36h2531618_0
krb5 1.16.4 h173b8e3_0
lcms2 2.12 h3be6417_0
ld_impl_linux-64 2.38 h1181459_1
libboost 1.73.0 h28710b8_12
libcurl 7.67.0 h20c2e04_0
libdap4 3.19.1 h6ec2957_0
libedit 3.1.20210910 h7f8727e_0
libffi 3.3 he6710b0_2
libgcc-ng 11.2.0 h1234567_1
libgdal 2.3.3 h2e7e64b_0
libgfortran-ng 7.3.0 hdf63c60_0
libgomp 11.2.0 h1234567_1
libkml 1.3.0 h7ecb851_5
libnetcdf 4.6.1 h11d0813_2
libpng 1.6.37 hbc83047_0
libpq 11.5 hd9ab2ff_2 conda-forge
libprotobuf 3.17.2 h4ff587b_1
libspatialite 4.3.0a hb08deb6_19
libssh2 1.10.0 h8f2d780_0
libstdcxx-ng 11.2.0 h1234567_1
libtiff 4.2.0 h2818925_1
libuuid 1.0.3 h7f8727e_2
libwebp-base 1.2.2 h7f8727e_0
libxcb 1.15 h7f8727e_0
libxml2 2.9.14 h74e7548_0
lz4-c 1.9.3 h295c915_1
markdown 3.3.4 py36h06a4308_0
matplotlib 3.3.4 py36h06a4308_0
matplotlib-base 3.3.4 py36h62a2d02_0
mkl 2020.2 256
mkl-service 2.3.0 py36he8ac12f_0
mkl_fft 1.3.0 py36h54f3939_0
mkl_random 1.1.1 py36h0573a6f_0
munch 2.5.0 pyhd3eb1b0_0
ncurses 6.3 h7f8727e_2
nest-asyncio 1.5.5 pypi_0 pypi
networkx 2.5.1 pypi_0 pypi
numpy 1.19.5 pypi_0 pypi
numpy-base 1.19.2 py36hfa32c7d_0
olefile 0.46 py36_0
opencv-python-headless 4.6.0.66 pypi_0 pypi
openjpeg 2.4.0 h3ad879b_0
openssl 1.1.1p h5eee18b_0
parso 0.7.1 pypi_0 pypi
pcre 8.45 h295c915_0
pexpect 4.8.0 pypi_0 pypi
pickleshare 0.7.5 pypi_0 pypi
pillow 8.4.0 pypi_0 pypi
pip 21.2.2 py36h06a4308_0
pixman 0.40.0 h7f8727e_1
poppler 0.65.0 h581218d_1
poppler-data 0.4.11 h06a4308_0
proj4 5.2.0 h295c915_1001
prompt-toolkit 3.0.30 pypi_0 pypi
protobuf 3.17.2 py36h295c915_0
psutil 5.8.0 py36h27cfd23_1
ptyprocess 0.7.0 pypi_0 pypi
pycparser 2.21 pyhd3eb1b0_0
pygments 2.12.0 pypi_0 pypi
pyopenssl 22.0.0 pyhd3eb1b0_0
pyparsing 3.0.9 pypi_0 pypi
pyqt 5.9.2 py36h05f1152_2
pysocks 1.7.1 py36h06a4308_0
python 3.6.13 h12debd9_1
python-dateutil 2.8.2 pyhd3eb1b0_0
pywavelets 1.1.1 pypi_0 pypi
pyyaml 6.0 pypi_0 pypi
pyzmq 23.2.0 pypi_0 pypi
qt 5.9.7 h5867ecd_1
qudida 0.0.4 pypi_0 pypi
rasterio 1.0.21 py36hc38cc03_0
readline 8.1.2 h7f8727e_1
requests 2.27.1 pyhd3eb1b0_0
scikit-image 0.17.2 pypi_0 pypi
scikit-learn 0.24.2 py36ha9443f7_0
scipy 1.5.4 pypi_0 pypi
setuptools 58.0.4 py36h06a4308_0
shapely 1.6.4 py36h86c5351_0
sip 4.19.8 py36hf484d3e_0
six 1.16.0 pyhd3eb1b0_1
snuggs 1.4.7 pyhd3eb1b0_0
sqlite 3.38.5 hc218d9a_0
tensorboard 1.12.2 py36he6710b0_0
tensorflow 1.12.0 mkl_py36h69b6ba0_0
tensorflow-base 1.12.0 mkl_py36h3c3e929_0
termcolor 1.1.0 py36h06a4308_1
threadpoolctl 3.1.0 pypi_0 pypi
tifffile 2020.9.3 pypi_0 pypi
tk 8.6.12 h1ccaba5_0
tornado 6.1 py36h27cfd23_0
tqdm 4.63.1 pyhd8ed1ab_0 conda-forge
traitlets 4.3.3 pypi_0 pypi
typing_extensions 4.1.1 pyh06a4308_0
urllib3 1.26.8 pyhd3eb1b0_0
wcwidth 0.2.5 pypi_0 pypi
werkzeug 2.0.3 pyhd3eb1b0_0
wheel 0.37.1 pyhd3eb1b0_0
xerces-c 3.2.3 h780794e_0
xz 5.2.5 h7f8727e_1
yaml 0.2.5 h7b6447c_0
zipp 3.6.0 pyhd3eb1b0_0
zlib 1.2.12 h7f8727e_2
zstd 1.5.2 ha4553b6_0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions