RP YARN throws error on cu_results.to_dict()

[drelu]

print "Submit Compute Units to Unit Manager ..."
cu_set = umgr.submit_units([cudesc])
print "Waiting for CUs to complete ..."
umgr.wait_units()
print "All CUs completed successfully!"
cu_results = cu_set[0]
details=cu_results.as_dict()

Submit Compute Units to Unit Manager ...
Waiting for CUs to complete ...
All CUs completed successfully!

2015-11-10 00:47:36,530: radical.pilot : MainProcess : PilotLauncherWorker-1: ERROR : Using bootstrapper /opt/anaconda/lib/python2.7/site-packages/radical/pilot/bootstrapper/default_bootstrapper.sh
Copying bootstrapper 'file://localhost/opt/anaconda/lib/python2.7/site-packages/radical/pilot/bootstrapper/default_bootstrapper.sh' to agent sandbox (<saga.filesystem.directory.Directory object at 0x7f050abab090>).
Copying sdist 'file://localhost/opt/anaconda/lib/python2.7/site-packages/radical/utils/radical.utils-0.38.tar.gz' to sandbox (sftp://sc15-aws.radical-cybertools.org/home/test037/radical.pilot.sandbox/rp.session.ip-10-99-194-113.ec2.internal.test037.016749.0003-pilot.0000/).
Copying sdist 'file://localhost/opt/anaconda/lib/python2.7/site-packages/saga/saga-python-0.38.1.tar.gz' to sandbox (sftp://sc15-aws.radical-cybertools.org/home/test037/radical.pilot.sandbox/rp.session.ip-10-99-194-113.ec2.internal.test037.016749.0003-pilot.0000/).
Copying sdist 'file://localhost/opt/anaconda/lib/python2.7/site-packages/radical/pilot/controller/..//radical.pilot-v0.37.10-123-g2a5e534-tutorial-sc15.tar.gz' to sandbox (sftp://sc15-aws.radical-cybertools.org/home/test037/radical.pilot.sandbox/rp.session.ip-10-99-194-113.ec2.internal.test037.016749.0003-pilot.0000/).
Writing agent configuration to file '/tmp/rp_agent_cfg_cCOllp.json'.
Copying agent configuration file 'file://localhost/tmp/rp_agent_cfg_cCOllp.json' to sandbox (sftp://sc15-aws.radical-cybertools.org/home/test037/radical.pilot.sandbox/rp.session.ip-10-99-194-113.ec2.internal.test037.016749.0003-pilot.0000/).
Submitting SAGA job with description: {'Project': None, 'Executable': '/bin/bash', 'TotalPhysicalMemory': None, 'WorkingDirectory': '/home/test037/radical.pilot.sandbox/rp.session.ip-10-99-194-113.ec2.internal.test037.016749.0003-pilot.0000/', 'Queue': None, 'Environment': {}, 'WallTimeLimit': 30, 'Arguments': ['-l bootstrap_1.sh', " -d 'radical.utils-0.38.tar.gz:saga-python-0.38.1.tar.gz:radical.pilot-v0.37.10-123-g2a5e534-tutorial-sc15.tar.gz' -m 'create' -p 'pilot.0000' -r 'debug' -s 'rp.session.ip-10-99-194-113.ec2.internal.test037.016749.0003' -v '/home/test037/radical.pilot.sandbox/ve_aws_anaconda' -b 'anaconda' -a 'multicore'"], 'ProcessesPerHost': None, 'Error': 'bootstrap_1.err', 'Output': 'bootstrap_1.out', 'TotalCPUCount': 2}
Pilot launching failed! (SAGA Job state is FAILED.)
Traceback (most recent call last):
File "/opt/anaconda/lib/python2.7/site-packages/radical/pilot/controller/pilot_launcher_worker.py", line 744, in run
raise RuntimeError ("SAGA Job state is FAILED.")
RuntimeError: SAGA Job state is FAILED.

[iparask]

Can you point me to the whole configuration? Also it would be nice if I had the pilot.0000.log.tgz file

[drelu]

It is on sc15-aws under the test037 user

On Mon, Nov 9, 2015 at 7:57 PM, Ioannis Paraskevakos <
notifications@github.com> wrote:

Can you point me to the whole configuration? Also it would be nice if I
had the pilot.0000.log.tgz file

—
Reply to this email directly or view it on GitHub
#1 (comment)
.

[iparask]

Okay, please pull again. Set the user_id in the YARN example to test037 and give a try to the whole notebook.

[drelu]

1. Do we need the user id to be set manually? Can this automatically be
   down?
2. Can we throw a clear error message?

Thanks,
Andre

On Mon, Nov 9, 2015 at 8:08 PM, Ioannis Paraskevakos <
notifications@github.com> wrote:

Okay, please pull again. Set the user_id in the YARN example to test037
and give a try to the whole notebook.

—
Reply to this email directly or view it on GitHub
#1 (comment)
.

[iparask]

I added an instruction in the example. When a user is connecting through ssh to machine the uer name must be defined.

1. Depends, are we going to provide everything ready or each student will clone this repo to an account on AWS? If we set everything up we can have the username ready. Else it needs to be set manually.

2. A clear error message? On the notebook? I can add an if statement that checks in the example. an error message is thrown but you need stderr to show up in the notebook. I do not know if that is possible

[iparask]

Did you have a chance to run it?

[iparask]

I think you were able to run, am I correct?