Skip to content

Bug 1804230: Documentation Incorrect for OCP 4.4 RHV IPI Install#3183

Merged
openshift-merge-robot merged 1 commit intoopenshift:masterfrom
rgolangh:doc-update
May 20, 2020
Merged

Bug 1804230: Documentation Incorrect for OCP 4.4 RHV IPI Install#3183
openshift-merge-robot merged 1 commit intoopenshift:masterfrom
rgolangh:doc-update

Conversation

@rgolangh
Copy link
Copy Markdown
Contributor

@rgolangh rgolangh commented Feb 25, 2020

docs: Update for oVirt installation and customization

revisit install_ipi.md

@openshift-ci-robot openshift-ci-robot added the bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. label Feb 25, 2020
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@rgolangh: This pull request references Bugzilla bug 1804230, which is invalid:

  • expected the bug to target the "4.5.0" release, but it targets "4.4.0" instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

Details

In response to this:

Bug 1804230: Documentation Incorrect for OCP 4.4 RHV IPI Install

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Feb 25, 2020
@rgolangh
Copy link
Copy Markdown
Contributor Author

/bugzilla refresh

@openshift-ci-robot openshift-ci-robot added bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. and removed bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. labels Feb 25, 2020
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@rgolangh: This pull request references Bugzilla bug 1804230, which is valid. The bug has been moved to the POST state. The bug has been updated to refer to the pull request using the external bug tracker.

Details

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Comment thread docs/user/ovirt/customization.md Outdated
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These options are only available via TF_VARs? We shouldn't be suggesting that to users only developers, can these be set on the machine pools?

Comment thread docs/user/ovirt/customization.md Outdated
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same, user facing options should be available in install-config, ex: #3170

Comment thread docs/user/ovirt/customization.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment thread docs/user/ovirt/install_ipi.md Outdated
Comment on lines 91 to 93
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's use generic names in the examples and censor the kubeadmin password

Comment thread docs/user/ovirt/install_ipi.md Outdated
Comment on lines 91 to 93
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's use generic names in the examples and censor the kubeadmin password

Copy link
Copy Markdown
Contributor

@rolfedh rolfedh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Customizing a template during installation

Before you begin, see the generic cluster customization doc.

You can customize cluster resources both during and after installing a cluster. This topic shows you how to customize a template during the installation process before the installer uses the template to create resources for the cluster.

While creating a cluster, the OpenShift installer provides the following resources:

  • It uploads a qcow disk image of Red Hat Enterprise Linux CoreOS (RHCOS).
  • It creates a template from the pinned RHCOS qcow disk.
  • It creates master nodes and disks from the template.

Customizing these installer-created resources before installation helps make the resource definitions consistent with each other. This approach is more straightforward than making customizations after installation. It also helps avoid issues caused by resources that are inconsistent with each other.

The cluster also uses the template to create every master and worker node both during and after the installation.

A dedicated VLAN network per cluster may come in the future.

Customizing environment variables

Optionally, you can customize the following environment variables before installation.

Env variable Description
TF_VAR_ovirt_template_disk_size_gib The size of the template disk for worker/nodes in GiB
TF_VAR_ovirt_master_mem Master VM memory in MiB
TF_VAR_ovirt_master_cpu Master number of CPUs
TF_VAR_ovirt_template_mem Template VM memory in MiB
TF_VAR_ovirt_template_cpu Template number of CPUs

Although the installer uses the same template to create every node, it uses the TF_VAR_ovirt_master_ and TF_VAR_ovirt_template_ variables to provide different resources for master and worker nodes.

Editing templates

Optionally, you can customize the template the installer creates from the pinned RHCOS qcow disk.

When the installer finishes creating the template, stop the installation for editing.
Locate the template, named infraID
Edit the contents of the template. For example, you can edit it to create a node with two NICs.
Save your edits to the template file.
If you change the file name of the template, set the OPENSHIFT_INSTALL_OS_IMAGE_OVERRIDE environment variable to the new name, (as described here)[docs/dev/]

Note: You can set OPENSHIFT_INSTALL_OS_IMAGE_OVERRIDE to the file name of a template, or the URL of a qcow image.

Customizing the install-config properties

Optionally, you can customize the install-config properties.

Note: For oVirt platform specifics, see the full struct details, here.

Property Description
ovirt_network_name An active network under the selected cluster ID

@jstuever
Copy link
Copy Markdown
Contributor

jstuever commented Mar 4, 2020

/uncc @jstuever

@openshift-ci-robot openshift-ci-robot removed the request for review from jstuever March 4, 2020 17:46
@Jmainguy
Copy link
Copy Markdown

This makes no mention of uploading the RHCOS image to RHV, which the binary nightly of openshift-install still does not do as of 3/10/2020.

@rgolangh rgolangh force-pushed the doc-update branch 2 times, most recently from 8fb4c33 to 7f00816 Compare April 2, 2020 14:00
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@rgolangh: The following test failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/prow/e2e-aws-scaleup-rhel7 7f00816f3c6bfdf198daffef06d242fb45fe35c2 link /test e2e-aws-scaleup-rhel7

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@rgolangh rgolangh force-pushed the doc-update branch 2 times, most recently from e35b7ed to f425e7b Compare May 4, 2020 07:26
Comment thread docs/user/ovirt/customization.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This entire document is very confusing to me.

It mixes the during, before installing a lot. It's not clear to me what you can do at each.

Also the during is too confusing, I have no clue enable when do you want the user to make the change.

Also at one point this document says stop the installer when the template is created, modify it and then restart with and env..
^^ all this is a really bad ux. No document should recommend this type of high-touch-time based workflow. Please fix it.

Also, this document points to code for options available for configuration.. that's not acceptable. Please clearly document so the customization.

Lastly this document doesn't look anything like docs/aws/customization of any other cloud ones. Please make sure the documents are consistent. It's important for readers to correctly anticipate.

Comment thread docs/user/ovirt/customization.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The env is designed for devs and not users of the product. Please either make it clear that there are plans to provide supported way of doing it, and this is a worksheet for time being.

@rgolangh
Copy link
Copy Markdown
Contributor Author

@abhinavdahiya customization.md was merged as part of #3399 . I'll drop it from this PR and update the install_ipi if needed

@openshift-ci-robot openshift-ci-robot added the bugzilla/severity-medium Referenced Bugzilla bug's severity is medium for the branch this PR is targeting. label May 19, 2020
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@rgolangh: This pull request references Bugzilla bug 1804230, which is valid.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target release (4.5.0) matches configured target release for branch (4.5.0)
  • bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, ON_DEV, POST, POST)
Details

In response to this:

Bug 1804230: Documentation Incorrect for OCP 4.4 RHV IPI Install

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@rgolangh
Copy link
Copy Markdown
Contributor Author

@abhinavdahiya @rolfedh I think this is ready for another round of review.

@abhinavdahiya
Copy link
Copy Markdown
Contributor

/approve

@openshift-ci-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: abhinavdahiya

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 19, 2020
Copy link
Copy Markdown
Contributor

@rolfedh rolfedh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't understand why we are maintaining this topic. We've had customer complaints from people who landed here instead of the current documentation. It seems like we should replace this content with a link that sends users to https://docs.openshift.com/container-platform/4.4/installing/installing_rhv/installing-rhv-default.html. I'll help you move any key facts to https://github.com/openshift/openshift-docs/tree/master/installing/installing_rhv. What do you think?
Otherwise, if you still want to maintain this outside the documentation, then LGTM - merge your changes and I'll follow up with a detailed copyedit in a separate pull request.

Comment thread docs/user/ovirt/customization.md Outdated
Comment on lines 1 to 17
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Replace with:

# Customizing a template during installation

Before you begin, see the [generic cluster customization doc](docs/user/customization.md). 
 
You can customize cluster resources both during and after installing a cluster. This topic shows you how to customize a template *during* the installation process before the installer uses the template to create resources for the cluster. 

While creating a cluster, the OpenShift installer provides the following resources: 
- It uploads a qcow disk image of Red Hat Enterprise Linux CoreOS (RHCOS).
- It creates a template from the pinned RHCOS qcow disk. 
- It creates master nodes and disks from the template.

Customizing these installer-created resources *before* installation helps make the resource definitions consistent with each other. This approach is more straightforward than making customizations after installation. It also helps avoid issues caused by resources that are inconsistent with each other.

The cluster also uses the template to create every master and worker node both during and after the installation.

A dedicated VLAN network per cluster may come in the future.

Comment thread docs/user/ovirt/customization.md Outdated
Comment on lines 19 to 29
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Roy is going to move this whole section to a new doc under docs/dev/ovirt. Replace the content with:

## Customizing environment variables

Optionally, you can customize the following environment variables before installation.

| Env variable | Description |
| ---  | --- |
| `TF_VAR_ovirt_template_disk_size_gib` | The size of the template disk for worker/nodes in GiB | 
| `TF_VAR_ovirt_master_mem` | Master VM memory in MiB  | 
| `TF_VAR_ovirt_master_cpu` | Master number of CPUs | 
| `TF_VAR_ovirt_template_mem` | Template VM memory in MiB | 
| `TF_VAR_ovirt_template_cpu` | Template number of CPUs |

Although the installer uses the same template to create every node, it uses the `TF_VAR_ovirt_master_` and `TF_VAR_ovirt_template_` variables to provide different resources for master and worker nodes. 

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These references to "VM" are confusing. It's unclear which lexicon we're using: RHV or OCP? Are we talking about "master and worker nodes" in OCP, or the RHV "RHV Master, RHVH/RHEL hosts (hypervisors), and virtual machines" in RHV?

Comment thread docs/user/ovirt/customization.md Outdated
Comment on lines 31 to 33
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Roy is going to move this section to a new doc under docs/dev/ovirt

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I totally dropped customization.md from the PR because it was merged as part of #3399 - see https://github.com/openshift/installer/blob/master/docs/user/ovirt/customization.md

Comment thread docs/user/ovirt/customization.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Replace with:

## Editing templates.

Optionally, you can customize the template the installer creates from the pinned RHCOS qcow disk. 

When the installer finishes creating the template, stop the installation for editing.
Locate the template, named [`infraID`](pkg/asset/installconfig/clusterid.go) 
Edit the contents of the template. For example, you can edit it to create a node with two NICs.
Save your edits to the template file.
If you change the file name of the template, set the `OPENSHIFT_INSTALL_OS_IMAGE_OVERRIDE` environment variable to the new name, (as described here)[docs/dev/]  

Note: You can set `OPENSHIFT_INSTALL_OS_IMAGE_OVERRIDE` to the file name of a template, or the URL of a qcow image.

Copy link
Copy Markdown
Contributor

@dougsland dougsland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, few comments.

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oVirt 4.3.9.4 or higher as we talked.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably add a external link:

 [per ETCD requirement doc](https://github.com/etcd-io/etcd/blob/master/Documentation/op-guide/hardware.md)

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd suggest us update API_VIP to API_VIRTUAL_IP

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

api_vip and dns_vip, and ingress_vip are the name of the keys in install-config. Actually I'll change all the usages here to lower case.

Copy link
Copy Markdown
Contributor

@dougsland dougsland May 19, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

api_vip and dns_vip, and ingress_vip are the name of the keys in install-config. Actually I'll
change all the usages here to lower case.

Can we link to source code (install-config) these keys ?

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same here

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

DNS_VIRTUAL_IP

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:s/to your/Make sure the DNS Virtual IP is included in /etc/resolv.conf (or similar phrase)/g

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think Rolfe may be able to help here with another PR. I want this change to get it already to at least be a good improvement over what we already have.

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add a note for "install_dir" ? Will it keep the vms configurations? Should we do a backup in case of failure?

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO, we should add into requirements a note about: "pub key" and how to generate it.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doc should be specific to ovirt/RHV. All information which is non-platform specific should go in the generic docs. If it was there I would link to it. Maybe it's worth adding that there.

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

missing url for docs/usr/customization.md ?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ack

Comment thread docs/user/ovirt/install_ipi.md Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we have any link to add as reference for install-config.yaml?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a generated file. But I'll add a link to the installer explain command that will print information about the install-config.

revisit install_ipi.md

Signed-off-by: Roy Golan <rgolan@redhat.com>
@dougsland
Copy link
Copy Markdown
Contributor

Alright, let's move forward.
/lgtm

@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@dougsland: changing LGTM is restricted to collaborators

Details

In response to this:

Alright, let's move forward.
/lgtm

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@sdodson
Copy link
Copy Markdown
Member

sdodson commented May 20, 2020

/lgtm
(on behalf of @dougsland )

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label May 20, 2020
@openshift-merge-robot openshift-merge-robot merged commit 64529d5 into openshift:master May 20, 2020
@openshift-ci-robot
Copy link
Copy Markdown
Contributor

@rgolangh: All pull requests linked via external trackers have merged: openshift/installer#3183. Bugzilla bug 1804230 has been moved to the MODIFIED state.

Details

In response to this:

Bug 1804230: Documentation Incorrect for OCP 4.4 RHV IPI Install

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. bugzilla/severity-medium Referenced Bugzilla bug's severity is medium for the branch this PR is targeting. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. lgtm Indicates that a PR is ready to be merged. retest-not-required-docs-only size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants