Skip to content
This repository was archived by the owner on Jul 22, 2024. It is now read-only.
This repository was archived by the owner on Jul 22, 2024. It is now read-only.

how to install ray from powerai conda channels? GLIBCXX_3.4.21 not found #272

@den-run-ai

Description

@den-run-ai

I noticed that this Ray package was released in conda powerai channel:
https://anaconda.org/powerai/ray

What are the installation steps for this package?
Does it require base powerai 1.6.2 or powerai 1.7.0 or early release?

When I tried to install the following runtime error appears:

conda activate ray
(ray) [j0541825@mesquite-2 ~]$ python
Python 3.6.10 |Anaconda, Inc.| (default, Mar 26 2020, 00:22:27)
[GCC 7.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import ray
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/data/gpfs/anaconda3/envs/ray/lib/python3.6/site-packages/ray/__init__.py", line 25, in <module>
    CDLL(so_path, ctypes.RTLD_GLOBAL)
  File "/data/gpfs/anaconda3/envs/ray/lib/python3.6/ctypes/__init__.py", line 348, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21' not found (required by /data/gpfs/anaconda3/envs/ray/lib/python3.6/site-packages/ray/_raylet.so)

Here is the list of installed packages in that environment:

# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main
_pytorch_select           2.0             gpu_25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
absl-py                   0.8.1                    py36_0
apex                      0.1.0_1.7.1.a0  py36_683.g5ebb56f    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
arrow-cpp                 0.15.1          py36_684.g3ff7364    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
atomicwrites              1.4.0                      py_0
attrs                     20.1.0                   pypi_0    pypi
blas                      1.0                    openblas
boost-cpp                 1.67.0               h14c3975_4
brotli                    1.0.7                he6710b0_0
brotlipy                  0.7.0           py36h7b6447c_1000
bzip2                     1.0.8                h7b6447c_0
c-ares                    1.15.0            h7b6447c_1001
ca-certificates           2020.7.22                     0
cairo                     1.14.12              h8948797_3
certifi                   2020.6.20                py36_0
cffi                      1.12.3           py36h2e261b9_0
chardet                   3.0.4                 py36_1003
click                     7.0                        py_0
cloudpickle               1.6.0                      py_0
colorama                  0.4.3                      py_0
coverage                  4.5.4            py36h7b6447c_0
cryptography              3.1.1            py36h1ba5d50_0
cudatoolkit               10.2.89            698.g82312a1    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cudnn                     7.6.5_10.2         667.g338a052    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cxxfilt                   0.2.0           py_646.gbc2955e    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
cycler                    0.10.0                   py36_0
cython                    0.29                     pypi_0    pypi
cytoolz                   0.11.0           py36h7b6447c_0
dask-core                 2.30.0                     py_0
decorator                 4.4.2                      py_0
double-conversion         3.1.5              647.g15aab6a    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
ffmpeg                    4.2.2                h20bf706_0
filelock                  3.0.12                     py_0
fontconfig                2.13.0               h9420a91_0
freeglut                  3.0.0                hf484d3e_5
freetype                  2.10.2               h5ab3b9f_0
funcsigs                  1.0.2                    py36_0
future                    0.17.1                   py36_0
gflags                    2.2.2             1703.g1bcb8ab    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
giflib                    5.1.4                h14c3975_1
glib                      2.63.1               h5a9c865_0
glog                      0.3.5             1692.g110e904    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
gmp                       6.1.2                h7f7056e_2
gnutls                    3.6.5             h71b1129_1002
graphite2                 1.3.14               h23475e2_0
graphsurgeon              0.4.1           py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
grpc-cpp                  1.28.1             657.g35c3292    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
grpcio                    1.16.1           py36hf8bcb03_1
harfbuzz                  1.8.8                hffaf4a1_0
hdf5                      1.10.4               hb1b8bf9_0
hypothesis                5.37.1                     py_0
icu                       58.2                 he6710b0_3
idna                      2.8                      py36_0
imageio                   2.9.0                      py_0
importlib-metadata        1.7.0                    py36_0
importlib_metadata        1.7.0                         0
iniconfig                 1.0.1                    pypi_0    pypi
jasper                    2.0.14               h07fcdf6_1
jpeg                      9b                   hcb7ba68_2
jsonschema                3.2.0                    py36_1
kiwisolver                1.2.0            py36hfd86e86_0
lame                      3.100                h7b6447c_0
ld_impl_linux-ppc64le     2.33.1               h0f24833_7
leveldb                   1.20                 hf484d3e_1
libboost                  1.67.0               h46d08c1_4
libedit                   3.1.20191231         h14c3975_1
libevent                  2.1.11             651.gcf7de63    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libffi                    3.2.1             hf484d3e_1007
libgcc-ng                 8.2.0                h822a55f_1
libgfortran-ng            7.3.0                h822a55f_1
libglu                    9.0.0                hf484d3e_1
libopenblas               0.3.10               h5a2b251_0
libopencv                 3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libopus                   1.3.1                h7b6447c_0
libpng                    1.6.37               hbc83047_0
libprotobuf               3.8.0              658.gde7f9ce    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
libstdcxx-ng              8.2.0                h822a55f_1
libtiff                   4.1.0                h2733197_0
libuuid                   1.0.3                h1bed415_2
libvpx                    1.7.0                hf484d3e_0
libwebp                   1.0.1                h8e7db2f_0
libxcb                    1.14                 h7b6447c_0
libxml2                   2.9.10               he19cac6_1
llvmlite                  0.31.0           py36hd408876_0
lmdb                      0.9.24               he6710b0_0
lz4-c                     1.8.1.2              h14c3975_0
markdown                  3.1.1                    py36_0
matplotlib                3.3.1                         0
matplotlib-base           3.3.1            py36h8254106_0
mock                      3.0.5                    py36_0
more-itertools            8.4.0                    pypi_0    pypi
nccl                      2.6.4              664.g54e83f1    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
ncurses                   6.2                  he6710b0_1
nettle                    3.4.1                hbb512f6_0
networkx                  2.3                        py_0
ninja                     1.9.0            py36hfd86e86_0
numactl                   2.0.12             652.gb5e1afd    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
numba                     0.47.0           py36h962f231_0
numpy                     1.17.4           py36hd5be1e1_0
numpy-base                1.17.4           py36h2f8d375_0
olefile                   0.46                       py_0
onnx                      1.6.0           py36_695.g506708a    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
opencv                    3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
openh264                  2.1.0                hd408876_0
openssl                   1.1.1h               h7b6447c_0
packaging                 20.4                       py_0
pandas                    0.25.3           py36he6710b0_0
parquet-cpp               1.5.1              652.g650bfd0    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pcre                      8.44                 he6710b0_0
pillow                    7.0.0            py36haac5956_0
pip                       20.2.2                   py36_0
pixman                    0.40.0               h7b6447c_0
pluggy                    0.13.1                   py36_0
powerai-license           1.7.1.a0           808.g7ea5f87    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
powerai-release           1.7.1.a0           651.g1c389a2    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
powerai-tools             1.7.1.a0           647.g843ad38    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
protobuf                  3.8.0            py36he6710b0_0
py                        1.9.0                      py_0
py-opencv                 3.4.10          py36_812.g27886b9    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pyarrow                   0.15.1          py36_687.gfd1820f    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pycparser                 2.20                       py_2
pyopenssl                 19.1.0                     py_1
pyparsing                 2.4.7                      py_0
pyrsistent                0.17.3           py36h7b6447c_0
pysocks                   1.7.1                    py36_0
pytest                    6.0.1                    pypi_0    pypi
python                    3.6.10               ha29dc6b_1
python-dateutil           2.8.1                      py_0
python-lmdb               0.98             py36he6710b0_0
pytorch                   1.5.0            25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pytorch-base              1.5.0           gpu_py36_25737.g2788c56    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
pytz                      2020.1                     py_0
pywavelets                1.1.1            py36h7b6447c_2
pyyaml                    5.1.2            py36h7b6447c_0
ray                       0.8.1            py36h1d8a796_1    powerai
re2                       2020.05.01         645.g6afac28    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
readline                  8.0                  h7b6447c_0
redis-py                  3.5.3                      py_0
requests                  2.22.0                   py36_1
scikit-image              0.15.0           py36he6710b0_0
scipy                     1.4.1            py36habc2bb6_0
setuptools                49.6.0                   py36_0
six                       1.15.0                   pypi_0    pypi
snappy                    1.1.7                h1532aa0_3
sortedcontainers          2.2.2                      py_0
spectrum-mpi              10.03              702.ga72dafb    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
sqlite                    3.33.0               hbc83047_0
tabulate                  0.8.2                    py36_0
tensorboard               2.2.2           py_a4bcc6b_4457.g1bb2968    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tensorboard-plugin-wit    1.6.0           py_638.gc00ec86    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tensorrt                  7.0.0.11        py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
thrift-cpp                0.13.0             667.g56cf104    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tk                        8.6.10               hbc83047_0
toml                      0.10.1                   pypi_0    pypi
toolz                     0.11.1                     py_0
torchtext                 0.6.0           py36_659.ge17227c    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
torchvision-base          0.6.0           gpu_py36_682.ga63109c    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
tornado                   6.0.4            py36h7b6447c_1
tqdm                      4.36.1                     py_0
typing                    3.6.4                    py36_0
uff                       0.6.5           py36_721.g6b2a552    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
uriparser                 0.9.3              639.g7465fef    https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda-early-access
urllib3                   1.25.10                    py_0
wcwidth                   0.2.5                      py_0
werkzeug                  0.16.0                     py_0
wheel                     0.34.2                   py36_0
x264                      1!157.20191217       h7b6447c_0
xz                        5.2.5                h7b6447c_0
yaml                      0.1.7                h1bed415_2
zipp                      3.1.0                    pypi_0    pypi
zlib                      1.2.11               h7b6447c_3
zstd                      1.3.7                h0b5b093_0

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions