Long build root error masked by long-prefix changes #1337

pelson · 2016-09-08T14:31:05Z

Just wanted to raise the fact that having a CONDA_BLD_PATH that is long can cause some grief with the new conda-build because of the automatic re-try behaviour implemented in conda-build 2.

Essentially, conda-build initially tries to build a recipe against a long build prefix, and then when that fails, falls back to trying a shorter prefix. The problem is that the shorter prefix is still too long, and the error message is hard to decipher (it just exits without any information).

Example output:

CONDA_BLD_PATH=${TMPDIR}/0123456789012345678901234567890123456789012345678901234567890123456789/build conda build ./recipe/
BUILD START: click-plugins-1.0.3-py35_0
    (actual version deferred until further download or env creation)
updating index in: /Users/pelson/miniconda/pkgs
updating index in: /var/folders/mh/cy5_fjpx1277hvwgw4756dpw0000gn/T/0123456789012345678901234567890123456789012345678901234567890123456789/build/osx-64
updating index in: /var/folders/mh/cy5_fjpx1277hvwgw4756dpw0000gn/T/0123456789012345678901234567890123456789012345678901234567890123456789/build/noarch
Using Anaconda API: https://api.anaconda.org

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ca-certificates-2016.8.31  |                0         163 KB  conda-forge

The following NEW packages will be INSTALLED:

    ca-certificates: 2016.8.31-0      conda-forge
    certifi:         2016.8.31-py35_0 conda-forge
    click:           6.6-py35_1       conda-forge
    ncurses:         5.9-9            conda-forge
    openssl:         1.0.2h-2         conda-forge
    python:          3.5.2-2          conda-forge
    readline:        6.2-0            conda-forge
    setuptools:      26.1.1-py35_0    conda-forge
    sqlite:          3.13.0-1         conda-forge
    tk:              8.5.19-0         conda-forge
    xz:              5.2.2-0          conda-forge
    zlib:            1.2.8-3          conda-forge

WARNING:/Users/pelson/miniconda/lib/python3.5/site-packages/conda_build/build.py:Build prefix failed with prefix length 255
WARNING:/Users/pelson/miniconda/lib/python3.5/site-packages/conda_build/build.py:Error was: 
WARNING:/Users/pelson/miniconda/lib/python3.5/site-packages/conda_build/build.py:ERROR: placeholder '/Users/travis/miniconda3/envs/_build_placehold_placehold_placehold_placehold_pla' too short in: conda-forge::ncurses-5.9-9

WARNING:/Users/pelson/miniconda/lib/python3.5/site-packages/conda_build/build.py:One or more of your package dependencies needs to be rebuilt with a longer prefix length.
WARNING:/Users/pelson/miniconda/lib/python3.5/site-packages/conda_build/build.py:Falling back to legacy prefix length of 80 characters.
WARNING:/Users/pelson/miniconda/lib/python3.5/site-packages/conda_build/build.py:Your package will not install into prefixes > 80 characters.
updating index in: /Users/pelson/miniconda/pkgs
updating: ca-certificates-2016.8.31-0.tar.bz2
updating index in: /var/folders/mh/cy5_fjpx1277hvwgw4756dpw0000gn/T/0123456789012345678901234567890123456789012345678901234567890123456789/build/osx-64
updating index in: /var/folders/mh/cy5_fjpx1277hvwgw4756dpw0000gn/T/0123456789012345678901234567890123456789012345678901234567890123456789/build/noarch

The following NEW packages will be INSTALLED:

    ca-certificates: 2016.8.31-0      conda-forge
    certifi:         2016.8.31-py35_0 conda-forge
    click:           6.6-py35_1       conda-forge
    ncurses:         5.9-9            conda-forge
    openssl:         1.0.2h-2         conda-forge
    python:          3.5.2-2          conda-forge
    readline:        6.2-0            conda-forge
    setuptools:      26.1.1-py35_0    conda-forge
    sqlite:          3.13.0-1         conda-forge
    tk:              8.5.19-0         conda-forge
    xz:              5.2.2-0          conda-forge
    zlib:            1.2.8-3          conda-forge

ERROR: placeholder '/Users/travis/miniconda3/envs/_build_placehold_placehold_placehold_placehold_pla' too short in: conda-forge::ncurses-5.9-9

conda-build doesn't need to do anything about this (as we will soon have packages that can support long prefixes), I just wanted to raise awareness. Ping @bjlittle & @lbdreyer

The text was updated successfully, but these errors were encountered:

pelson · 2016-09-08T14:31:37Z

@msarahan - please close at will.

msarahan · 2016-09-08T14:37:47Z

You just wanted to claim 1337, didn't you?

This is a good point - thank you for raising it, and giving people some information to find.

mingwandroid · 2016-09-08T14:52:05Z

I should've held out 20 minutes before submitting 1336.

pelson · 2016-09-08T15:26:02Z

Wow - feeling a little behind the times... 😄 I haven't heard of 1337 as a thing b3f0r3...

pelson · 2016-09-08T15:27:29Z

As a thing, it would probably be helpful if conda spat out a better message here. Ping @kalefranz to raise awareness.

licode · 2016-09-12T03:00:00Z

I also see the same error. This also fails on conda-build=1.21.3.
Here is my config

The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    ncurses-5.9                |                9         954 KB  conda-forge
    patchelf-0.9               |                1         349 KB  conda-forge
    sqlite-3.13.0              |                0         4.9 MB  conda-forge
    xz-5.2.2                   |                0         853 KB  conda-forge
    python-3.5.2               |                3        31.8 MB  conda-forge
    conda-env-2.5.1            |           py35_0          27 KB  defaults
    markupsafe-0.23            |           py35_2          32 KB  defaults
    psutil-4.3.1               |           py35_0         228 KB  defaults
    pytz-2016.6.1              |           py35_0         162 KB  conda-forge
    ruamel_yaml-0.11.14        |           py35_0         377 KB  defaults
    six-1.10.0                 |           py35_0          18 KB  conda-forge
    clyent-1.2.2               |           py35_0          15 KB  defaults
    conda-4.1.12               |           py35_0         204 KB  defaults
    jinja2-2.8                 |           py35_1         278 KB  conda-forge
    python-dateutil-2.5.3      |           py35_0         237 KB  conda-forge
    anaconda-client-1.4.0      |           py35_0         101 KB  defaults
    conda-build-1.21.3         |           py35_0         238 KB  defaults
    conda-execute-0.6.0        |           py35_0          14 KB  conda-forge
    ------------------------------------------------------------
                                           Total:        40.7 MB

The following NEW packages will be INSTALLED:

    anaconda-client: 1.4.0-py35_0    defaults
    clyent:          1.2.2-py35_0    defaults
    conda-build:     1.21.3-py35_0   defaults
    conda-execute:   0.6.0-py35_0    conda-forge
    jinja2:          2.8-py35_1      conda-forge
    markupsafe:      0.23-py35_2     defaults
    ncurses:         5.9-9           conda-forge
    patchelf:        0.9-1           conda-forge
    psutil:          4.3.1-py35_0    defaults
    python-dateutil: 2.5.3-py35_0    conda-forge
    pytz:            2016.6.1-py35_0 conda-forge
    ruamel_yaml:     0.11.14-py35_0  defaults
    six:             1.10.0-py35_0   conda-forge

The following packages will be UPDATED:

    conda:           4.0.5-py35_0 defaults    --> 4.1.12-py35_0   defaults
    conda-env:       2.4.5-py35_0 defaults    --> 2.5.1-py35_0    defaults
    python:          3.5.1-0      conda-forge --> 3.5.2-3         conda-forge
    sqlite:          3.9.2-0      conda-forge --> 3.13.0-0        conda-forge
    xz:              5.0.5-1      conda-forge --> 5.2.2-0         conda-forge

msarahan · 2016-09-12T13:35:41Z

@licode this error is caused by conda-forge's packages being built with a prefix that is shorter than the prefix that you're trying to install into. Conda-build 2 will try to build packages with a longer prefix, but fall back to a shorter one if any package that it is installing is limited to a shorter prefix.

The only way that you'll be successful is to have packages for all of your prerequisites that are built with conda-build 2. They need to be built in order - any dependency with a short prefix will mess up attempts to get a long prefix in something that uses it.

Most of the packages in defaults have been rebuilt with the long prefix. Based on your log, it looks to me like you need sqlite and xz from defaults right now, until conda-forge starts using conda-build 2 and rebuilds their packages.

licode · 2016-09-12T15:52:00Z

thanks. I put default before conda-forge in .condarc to make sure we get packages (like sqlite and xz) first from default channel. So it looks working now.

github-actions · 2022-07-19T04:28:31Z

Hi there, thank you for your contribution!

This issue has been automatically marked as stale because it has not had recent activity. It will be closed automatically if no further activity occurs.

If you would like this issue to remain open please:

Verify that you can still reproduce the issue at hand
Comment that the issue is still reproducible and include:
- What OS and version you reproduced the issue on
- What steps you followed to reproduce the issue

NOTE: If this issue was closed prematurely, please leave a comment.

Thanks!

pelson mentioned this issue Oct 8, 2016

error loading shared object with conda-build 2 conda-forge/cmake-feedstock#21

Closed

rvalieris mentioned this issue Jan 16, 2017

Test env is broken if recipe dir name is > 9 characters and package depends on R bioconda/bioconda-recipes#3158

Closed

msarahan mentioned this issue Aug 9, 2017

Unsatisfiable dependencies for platform win-32: ['vs2008_win-32'] #2263

Closed

github-actions bot added the stale [bot] marked as stale due to inactivity label Jul 19, 2022

github-actions bot added the stale::closed [bot] closed after being marked as stale label Aug 19, 2022

github-actions bot closed this as completed Aug 19, 2022

github-actions bot added the locked [bot] locked due to inactivity label Aug 19, 2023

github-actions bot locked as resolved and limited conversation to collaborators Aug 19, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Long build root error masked by long-prefix changes #1337

Long build root error masked by long-prefix changes #1337

pelson commented Sep 8, 2016

pelson commented Sep 8, 2016

msarahan commented Sep 8, 2016

mingwandroid commented Sep 8, 2016

pelson commented Sep 8, 2016

pelson commented Sep 8, 2016

licode commented Sep 12, 2016

msarahan commented Sep 12, 2016

licode commented Sep 12, 2016

github-actions bot commented Jul 19, 2022

Long build root error masked by long-prefix changes #1337

Long build root error masked by long-prefix changes #1337

Comments

pelson commented Sep 8, 2016

pelson commented Sep 8, 2016

msarahan commented Sep 8, 2016

mingwandroid commented Sep 8, 2016

pelson commented Sep 8, 2016

pelson commented Sep 8, 2016

licode commented Sep 12, 2016

msarahan commented Sep 12, 2016

licode commented Sep 12, 2016

github-actions bot commented Jul 19, 2022