ansible operator failed when json_query filter is used

[luciferinlove]

Bug Report

What did you do?
I have ansible operator generated with:

operator-sdk new ansible-operator --type ansible --kind TestConfig --api-version test.test/v1alpha1 --generate-playbook

I've created the role with json_query filter in some steps. When I run ansible-operator I've got the error.

What did you expect to see?
Steps with json_query filter must be succeeded.

What did you see instead? Under which circumstances?
I see the error in operator logs:

fatal: [localhost]: FAILED! => {"msg": "You need to install \"jmespath\" prior to running json_query filter"}

Environment

• operator-sdk version:

operator-sdk version: "v0.12.0", commit: "2445fcda834ca4b7cf0d6c38fba6317fb219b469"

• go version:

go version: "go1.13.3 linux/amd64"

• Kubernetes version information:

Client Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.3", GitCommit:"2d3c76f9091b6bec110a5e63777c332469e0cba2", GitTreeState:"clean", BuildDate:"2019-08-19T11:05:50Z", GoVersion:"go1.12.9", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"15", GitVersion:"v1.15.3", GitCommit:"2d3c76f9091b6bec110a5e63777c332469e0cba2", GitTreeState:"clean", BuildDate:"2019-08-19T11:05:50Z", GoVersion:"go1.12.9", Compiler:"gc", Platform:"linux/amd64"}

• Kubernetes cluster kind:

• Are you writing your operator in ansible, helm, or go?

ansible

Possible Solution
pip jmespath module must be installed in default ansible operator container

Additional context
Add any other context about the problem here.

[camilamacedo86]

It is using python 3 and pip3. See: https://github.com/operator-framework/operator-sdk-samples/blob/master/ansible/memcached-operator/.travis.yml#L5

Are you with python 3 and pip3 installed in your env?

[luciferinlove]

Yes to both questions, but I'll check it out in detail

[luciferinlove]

When I run

operator-sdk build my_image

I see only building of docker container image.

Dockerfile generated by operator-sdk looks like:

FROM quay.io/operator-framework/ansible-operator:v0.12.0

COPY watches.yaml ${HOME}/watches.yaml

COPY roles/ ${HOME}/roles/
COPY playbook.yml ${HOME}/playbook.yml

[luciferinlove]

All are working when I add jmethpath installing in Dockerfile manually

[camilamacedo86]

HI @luciferinlove,

Could you please clarfies the steps performed in All are working when I add jmethpath installing in Dockerfile manually? What do you mean with? Could you please describe the steps?

[luciferinlove]

Hi. When I run

operator-sdk new ansible-operator --type ansible --kind TestConfig --api-version test.test/v1alpha1 --generate-playbook

I see such files tree:

.
├── build
│   ├── Dockerfile
│   └── test-framework
│       ├── ansible-test.sh
│       └── Dockerfile
├── deploy
│   ├── crds
│   │   ├── test.test_testconfigs_crd.yaml
│   │   └── test.test_v1alpha1_testconfig_cr.yaml
│   ├── operator.yaml
│   ├── role_binding.yaml
│   ├── role.yaml
│   └── service_account.yaml
├── molecule
│   ├── default
│   │   ├── asserts.yml
│   │   ├── molecule.yml
│   │   ├── playbook.yml
│   │   └── prepare.yml
│   ├── test-cluster
│   │   ├── molecule.yml
│   │   └── playbook.yml
│   └── test-local
│       ├── molecule.yml
│       ├── playbook.yml
│       └── prepare.yml
├── playbook.yml
├── roles
│   └── testconfig
│       ├── defaults
│       │   └── main.yml
│       ├── files
│       ├── handlers
│       │   └── main.yml
│       ├── meta
│       │   └── main.yml
│       ├── README.md
│       ├── tasks
│       │   └── main.yml
│       ├── templates
│       └── vars
│           └── main.yml
├── .travis.yml
└── watches.yaml

Then I edit build/Dockerfile:

FROM quay.io/operator-framework/ansible-operator:v0.12.0

USER 0                              <---------- String that I'm adding
RUN pip3 install jmespath <---------- String that I'm adding
USER 1001                       <---------- String that I'm adding

COPY watches.yaml ${HOME}/watches.yaml

COPY roles/ ${HOME}/roles/
COPY playbook.yml ${HOME}/playbook.yml

Then I run operator-sdk build my_image and deploy this operator image in kubernetes.
All are working great in this case.

[camilamacedo86]

Really thank you for your info. It shows an issue. I am looking on that.

[luciferinlove]

@camilamacedo86 , thank you too)

[camilamacedo86]

Just to register I could reproduce this one by using the Memcached sample. Following the error:

TASK [Memcached : extract instance tags] ***************************************
task path: /opt/ansible/roles/Memcached/tasks/main.yml:36
fatal: [localhost]: FAILED! => {
    "msg": "You need to install \"jmespath\" prior to running json_query filter"
}

PLAY RECAP *********************************************************************
localhost                  : ok=3    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0  

To do it just add the following in the main.yml task.

- name: extract instance tags
  set_fact:
    instance_tags: '{{instances | json_query(query)}}'
  vars:
    query: 'instances[*].tags."organization-tag-2"'