Fixbug #3494 No to_python (by-value) converter found for C++ t… by errord · Pull Request #3575 · BVLC/caffe

errord · 2016-01-20T09:58:26Z

fixbug #3494 , register shared_ptr Blob Dtype

…ype: boost::shared_ptr<caffe::Blob<float> >

errord · 2016-01-21T03:03:17Z

what is label JL? @shelhamer

crowsonkb · 2016-02-25T11:55:35Z

It would be nice if this were merged. I'm having to merge it manually by hand to build on OS X, since Homebrew is packaging boost 1.60.0.

shelhamer · 2016-02-25T20:54:50Z

@errord @crowsonkb Sorry, I can't reproduce this in master @ fe0f441. Can you give more details on your setup? I have compiled and tested pycaffe with boost 1.60.0_1 on OS X 10.11.3 without trouble.

graphaelli · 2016-02-29T03:53:04Z

I've also run into this. There is no error at build time but you can reproduce it by running tests. Specifically - python3 -m unittest test_solver.py:

Without this patch:

======================================================================
ERROR: test_net_memory (test_solver.TestSolver)
Check that nets survive after the solver is destroyed.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/opt/caffe/python/caffe/test/test_solver.py", line 29, in setUp
    size=self.solver.net.blobs['label'].data.shape)
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Net<float> >

======================================================================
ERROR: test_snapshot (test_solver.TestSolver)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/opt/caffe/python/caffe/test/test_solver.py", line 29, in setUp
    size=self.solver.net.blobs['label'].data.shape)
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Net<float> >

======================================================================
ERROR: test_solve (test_solver.TestSolver)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/opt/caffe/python/caffe/test/test_solver.py", line 29, in setUp
    size=self.solver.net.blobs['label'].data.shape)
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Net<float> >

----------------------------------------------------------------------
Ran 3 tests in 0.026s

FAILED (errors=3)

With:

.
----------------------------------------------------------------------
Ran 3 tests in 0.048s

OK

ahundt · 2016-02-29T17:17:35Z

I think I just reproduced the problem in #3575 on master with #3570 and #3613 applied (the latter two may not be relevant). When I applied #3575 I was able to continue on. Here is the trace:

Traceback (most recent call last):
File "/Users/athundt/source/eclipse/caffe/fcn-32s/eval-fcn-32s.py", line 17, in
net.blobs['data'].reshape(1, *in_.shape)
File "/Users/athundt/source/git/caffe/python/caffe/pycaffe.py", line 28, in _Net_blobs
return OrderedDict(zip(self._blob_names, self._blobs))
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptrcaffe::Blob

± python --version
Python 2.7.11
OS X 10.11.3

/usr/local/Cellar/boost/1.60.0_1 (11,059 files, 123.0M) *
Built from source with: --with-mpi --without-single --without-static --c++11
From: https://github.com/Homebrew/homebrew/blob/master/Library/Formula/boost.rb

panovr · 2016-03-02T05:13:53Z

@shelhamer I hope this commit can be merged, because I also run into this problem, and my environment is Mac OS X 10.11.3, Xcode 7.2, Anaconda python 2.7.11, boost 1.6.0.

I verified and confirmed that the error below can be fixed by applying this commit.

======================================================================
ERROR: test_forward_backward (test_net.TestNet)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_net.py", line 45, in setUp
    size=self.net.blobs['label'].data.shape)
  File "caffe/pycaffe.py", line 28, in _Net_blobs
    return OrderedDict(zip(self._blob_names, self._blobs))
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Blob<float> >

======================================================================
ERROR: test_inputs_outputs (test_net.TestNet)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_net.py", line 45, in setUp
    size=self.net.blobs['label'].data.shape)
  File "caffe/pycaffe.py", line 28, in _Net_blobs
    return OrderedDict(zip(self._blob_names, self._blobs))
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Blob<float> >

======================================================================
ERROR: test_memory (test_net.TestNet)
Check that holding onto blob data beyond the life of a Net is OK
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_net.py", line 45, in setUp
    size=self.net.blobs['label'].data.shape)
  File "caffe/pycaffe.py", line 28, in _Net_blobs
    return OrderedDict(zip(self._blob_names, self._blobs))
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Blob<float> >

======================================================================
ERROR: test_save_and_read (test_net.TestNet)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_net.py", line 45, in setUp
    size=self.net.blobs['label'].data.shape)
  File "caffe/pycaffe.py", line 28, in _Net_blobs
    return OrderedDict(zip(self._blob_names, self._blobs))
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Blob<float> >

======================================================================
ERROR: test_net_memory (test_solver.TestSolver)
Check that nets survive after the solver is destroyed.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_solver.py", line 29, in setUp
    size=self.solver.net.blobs['label'].data.shape)
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Net<float> >

======================================================================
ERROR: test_snapshot (test_solver.TestSolver)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_solver.py", line 29, in setUp
    size=self.solver.net.blobs['label'].data.shape)
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Net<float> >

======================================================================
ERROR: test_solve (test_solver.TestSolver)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/ylzhao/Project/caffe/python/caffe/test/test_solver.py", line 29, in setUp
    size=self.solver.net.blobs['label'].data.shape)
TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Net<float> >

----------------------------------------------------------------------
Ran 21 tests in 1.499s

shelhamer · 2016-03-04T00:41:30Z

Ok, I have reproduced the problem and the fix. Thanks for the patch!

…float-no-register [pycaffe] fix boost 1.60 compatibility issue; close #3494

shelhamer · 2016-03-04T03:23:04Z

python/caffe/_caffe.cpp

    .def("_set_input_arrays", &Net_SetInputArrays,
        bp::with_custodian_and_ward<1, 2, bp::with_custodian_and_ward<1, 3> >())
    .def("save", &Net_Save);
+  bp::register_ptr_to_python<shared_ptr<Net<Dtype> > >();


@longjon can you comment on this? It seems redundant to me given the bp::class_ declarations but boost 1.60 complains without it (on OS X at least).

shelhamer · 2016-03-04T03:29:08Z

Note that this can cause harmless warnings for some boost versions. These are the warnings:

/home/ubuntu/caffe/python/caffe/pycaffe.py:13: RuntimeWarning: to-Python converter for boost::shared_ptrcaffe::Net already registered; second conversion method ignored.
from ._caffe import Net, SGDSolver, NesterovSolver, AdaGradSolver, \
/home/ubuntu/caffe/python/caffe/pycaffe.py:13: RuntimeWarning: to-Python converter for boost::shared_ptrcaffe::Blob already registered; second conversion method ignored.
from ._caffe import Net, SGDSolver, NesterovSolver, AdaGradSolver, \
/home/ubuntu/caffe/python/caffe/pycaffe.py:13: RuntimeWarning: to-Python converter for boost::shared_ptrcaffe::Solver already registered; second conversion method ignored.
from ._caffe import Net, SGDSolver, NesterovSolver, AdaGradSolver, \

This happens for me at least with boost 1.59 on Ubuntu 14.04. This should maybe be conditioned on boost version/platform as gross as adding guards is. See #3866 for one attempt.

…lob-float-no-register [pycaffe] fix boost 1.60 compatibility issue; close BVLC#3494

fixbug #issues/3494 No to_python (by-value) converter found for C++ t…

de31e03

…ype: boost::shared_ptr<caffe::Blob<float> >

errord changed the title ~~fixbug #3494 No to_python (by-value) converter found for C++ t…~~ Fixbug #3494 No to_python (by-value) converter found for C++ t… Jan 20, 2016

shelhamer added Python JL labels Jan 20, 2016

add register Net and Solver

8fea1f5

bei21 mentioned this pull request Jan 27, 2016

"TypeError: No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Blob<float> >" #3477

Closed

Austriker mentioned this pull request Feb 14, 2016

No to_python (by-value) converter found for C++ type: boost::shared_ptr<caffe::Blob<float> > #3494

Closed

shelhamer added a commit that referenced this pull request Mar 4, 2016

Merge pull request #3575 from errord/fix-boost-shared_ptr-caffe-Blob-…

c2354b9

…float-no-register [pycaffe] fix boost 1.60 compatibility issue; close #3494

shelhamer merged commit c2354b9 into BVLC:master Mar 4, 2016

shelhamer reviewed Mar 4, 2016
View reviewed changes

shelhamer added a commit to longjon/caffe that referenced this pull request Mar 4, 2016

DEBUG rollback BVLC#3575

bd8b5bd

shelhamer added a commit to shelhamer/caffe that referenced this pull request Mar 4, 2016

revert BVLC#3575

39f6643

yutkin mentioned this pull request Mar 6, 2016

Ld error while make test on OS X #3779

Closed

This was referenced Mar 21, 2016

Added check before register ptr to python #3865

Closed

Added check before register ptr to python #3866

Closed

shelhamer mentioned this pull request Apr 5, 2016

RuntimeWarning: to-Python converter for boost::shared_ptr<caffe::Net<float> > already registered; second conversion method ignored. #3944

Closed

seanbell mentioned this pull request Apr 20, 2016

RuntimeWarning when loading the Python Caffe module #4009

Closed

seanbell mentioned this pull request Apr 28, 2016

Suppress boost registration warnings in pycaffe (Based on #3960) #4069

Merged

tusharshar mentioned this pull request May 6, 2016

Pycaffe on windows issue #4103

Closed

fxbit pushed a commit to Yodigram/caffe that referenced this pull request Sep 1, 2016

Merge pull request BVLC#3575 from errord/fix-boost-shared_ptr-caffe-B…

1337ef6

…lob-float-no-register [pycaffe] fix boost 1.60 compatibility issue; close BVLC#3494

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fixbug #3494 No to_python (by-value) converter found for C++ t…#3575

Fixbug #3494 No to_python (by-value) converter found for C++ t…#3575
shelhamer merged 2 commits intoBVLC:masterfrom
errord:fix-boost-shared_ptr-caffe-Blob-float-no-register

errord commented Jan 20, 2016

Uh oh!

errord commented Jan 21, 2016

Uh oh!

crowsonkb commented Feb 25, 2016

Uh oh!

shelhamer commented Feb 25, 2016

Uh oh!

graphaelli commented Feb 29, 2016

Uh oh!

ahundt commented Feb 29, 2016

Uh oh!

panovr commented Mar 2, 2016

Uh oh!

shelhamer commented Mar 4, 2016

Uh oh!

shelhamer Mar 4, 2016

Uh oh!

shelhamer commented Mar 4, 2016

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

Comments

Conversation

errord commented Jan 20, 2016

Uh oh!

errord commented Jan 21, 2016

Uh oh!

crowsonkb commented Feb 25, 2016

Uh oh!

shelhamer commented Feb 25, 2016

Uh oh!

graphaelli commented Feb 29, 2016

Uh oh!

ahundt commented Feb 29, 2016

Uh oh!

panovr commented Mar 2, 2016

Uh oh!

shelhamer commented Mar 4, 2016

Uh oh!

shelhamer Mar 4, 2016

Choose a reason for hiding this comment

Uh oh!

shelhamer commented Mar 4, 2016

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

Comments