Podman now looks like a dependency in the RPM installation

[nerdalert]

What happened:

Install is suddenly failing when the Podman binary is not found, it was working 24 hours ago. There has been only one commit merged since then and it's possible it may be related to If a service stops with error request all the other services to stop but I'm not even sure that would be reflected in the RPM install yet.

I'm installing from nerdalert/microshift-installer using the RPM install instructions.

• Below are the logs:

Jan 31 01:53:49 cluster-b systemd[2096]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Jan 31 01:53:49 cluster-b systemd[1]: microshift.service: Main process exited, code=exited, status=203/EXEC
Jan 31 01:53:49 cluster-b systemd[2097]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Jan 31 01:53:49 cluster-b systemd[2097]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Jan 31 01:53:49 cluster-b systemd[1]: microshift.service: Control process exited, code=exited, status=203/EXEC
Jan 31 01:53:49 cluster-b systemd[1]: microshift.service: Failed with result 'exit-code'.
Jan 31 01:53:49 cluster-b systemd[1]: Failed to start MicroShift Containerized.
Jan 31 01:53:50 cluster-b systemd[1]: microshift.service: Scheduled restart job, restart counter is at 5.
Jan 31 01:53:50 cluster-b systemd[1]: Stopped MicroShift Containerized.
Jan 31 01:53:50 cluster-b systemd[1]: microshift.service: Start request repeated too quickly.
Jan 31 01:53:50 cluster-b systemd[1]: microshift.service: Failed with result 'exit-code'.
Jan 31 01:53:50 cluster-b systemd[1]: Failed to start MicroShift Containerized.

Ive only been digging into Microshift the past couple of days and haven't looked into if there is any e2e spun up yet. Would like to contribute if I can be of assistance getting some rolling if there isn't any.

How to reproduce it (as minimally and precisely as possible):

1. running the script linked and commenting out the Podman install (I have added Podman as a workaround)
2. or using the RPM instructions on the website

Anything else we need to know?:

• If Podman is a requirement, I will update the rpm install docs.

Environment:

• Fedora 35
• VirtualBox 4xcore 4BG mem
• Microshift version:
  MicroShift Version: 4.8.0-0.microshift-2022-01-06-210147
  Base OKD Version: 4.8.0-0.okd-2021-10-10-030117

Thanks!

[fzdarsky]

Hi @nerdalert, thanks for giving MicroShift a try!

In your script you're installing MicroShift via RPM, which creates the microshift.service for you that you can then start. No need for Podman for this.

From your log output, I suspect you may have tried deploying MicroShift on Podman on the same machine and overwritten the microshift.service file doing so?

I'm going to close this issue as not-a-bug. If you believe this is incorrect, please feel free to reopen.

[mangelajo]

We have a microshift-containerized service in the rpm for convenience, don't use that service just the plain "microshift"

[nerdalert]

Thanks for the assist @mangelajo @fzdarsky!

Just to double check, here is what I am installing for the RPM install per the QuickStart instructions. This is a fresh Fedora install that I'm snapshotting for a fresh OS every time I have installed. The microshift.service file that gets installed is the one containing the Podman startup.

Are the install commands I'm using below wrong? Thanks!

sudo dnf module enable -y cri-o:1.21
sudo dnf install -y cri-o cri-tools
sudo systemctl enable crio --now

sudo dnf copr enable -y @redhat-et/microshift
sudo dnf install -y microshift firewalld
sudo systemctl enable microshift --now

# no microshift.service file
brent@cluster-a:~$ ls /usr/lib/systemd/system/ | grep micro
brent@cluster-a:~$

# Install
brent@cluster-a:~$ sudo dnf module enable -y cri-o:1.21
sudo dnf install -y cri-o cri-tools
sudo systemctl enable crio --now
[sudo] password for brent:
Fedora 35 - x86_64 - Updates                                                                                                                                                                    41 kB/s |  13 kB     00:00
Fedora 35 - x86_64 - Updates                                                                                                                                                                   1.1 MB/s | 5.0 MB     00:04
Fedora Modular 35 - x86_64 - Updates                                                                                                                                                            69 kB/s |  14 kB     00:00
Dependencies resolved.
===============================================================================================================================================================================================================================
 Package                                               Architecture                                         Version                                                Repository                                             Size
===============================================================================================================================================================================================================================
Enabling module streams:
 cri-o                                                                                                      1.21

Transaction Summary
===============================================================================================================================================================================================================================

Complete!
Last metadata expiration check: 0:00:06 ago on Tue 01 Feb 2022 12:01:25 PM EST.
Dependencies resolved.
===============================================================================================================================================================================================================================
 Package                                                     Architecture                           Version                                                              Repository                                       Size
===============================================================================================================================================================================================================================
Installing:
 cri-o                                                       x86_64                                 1.21.3-1.module_f35+13330+6bc9c749                                   updates-modular                                  23 M
 cri-tools                                                   x86_64                                 1.19.0-1.module_f35+12974+2bc66b5d                                   updates-modular                                 6.1 M
Installing dependencies:
 conmon                                                      x86_64                                 2:2.0.30-2.fc35                                                      fedora                                           56 k
 container-selinux                                           noarch                                 2:2.173.1-1.fc35                                                     updates                                          49 k
 containernetworking-plugins                                 x86_64                                 1.0.1-1.fc35                                                         fedora                                          8.7 M
 containers-common                                           noarch                                 4:1-32.fc35                                                          updates                                          76 k
 criu                                                        x86_64                                 3.16.1-2.fc35                                                        updates                                         529 k
 fuse-common                                                 x86_64                                 3.10.5-1.fc35                                                        fedora                                          8.3 k
 fuse3                                                       x86_64                                 3.10.5-1.fc35                                                        fedora                                           54 k
 fuse3-libs                                                  x86_64                                 3.10.5-1.fc35                                                        fedora                                           92 k
 libbsd                                                      x86_64                                 0.10.0-8.fc35                                                        fedora                                          104 k
 libnet                                                      x86_64                                 1.2-4.fc35                                                           fedora                                           57 k
 libslirp                                                    x86_64                                 4.6.1-2.fc35                                                         fedora                                           72 k
 runc                                                        x86_64                                 2:1.0.2-2.fc35                                                       fedora                                          3.1 M
 socat                                                       x86_64                                 1.7.4.2-1.fc35                                                       updates                                         302 k
Installing weak dependencies:
 fuse-overlayfs                                              x86_64                                 1.7.1-2.fc35                                                         fedora                                           72 k
 slirp4netns                                                 x86_64                                 1.1.12-2.fc35                                                        fedora                                           55 k

Transaction Summary
===============================================================================================================================================================================================================================
Install  17 Packages

Total download size: 42 M
Installed size: 212 M
Downloading Packages:
(1/17): fuse-common-3.10.5-1.fc35.x86_64.rpm                                                                                                                                                    50 kB/s | 8.3 kB     00:00
(2/17): conmon-2.0.30-2.fc35.x86_64.rpm                                                                                                                                                        234 kB/s |  56 kB     00:00
(3/17): fuse3-3.10.5-1.fc35.x86_64.rpm                                                                                                                                                         232 kB/s |  54 kB     00:00
(4/17): fuse-overlayfs-1.7.1-2.fc35.x86_64.rpm                                                                                                                                                 133 kB/s |  72 kB     00:00
(5/17): libbsd-0.10.0-8.fc35.x86_64.rpm                                                                                                                                                        239 kB/s | 104 kB     00:00
(6/17): fuse3-libs-3.10.5-1.fc35.x86_64.rpm                                                                                                                                                    121 kB/s |  92 kB     00:00
(7/17): libnet-1.2-4.fc35.x86_64.rpm                                                                                                                                                           428 kB/s |  57 kB     00:00
(8/17): libslirp-4.6.1-2.fc35.x86_64.rpm                                                                                                                                                       293 kB/s |  72 kB     00:00
(9/17): slirp4netns-1.1.12-2.fc35.x86_64.rpm                                                                                                                                                   176 kB/s |  55 kB     00:00
(10/17): container-selinux-2.173.1-1.fc35.noarch.rpm                                                                                                                                            14 kB/s |  49 kB     00:03
(11/17): containernetworking-plugins-1.0.1-1.fc35.x86_64.rpm                                                                                                                                   1.6 MB/s | 8.7 MB     00:05
(12/17): containers-common-1-32.fc35.noarch.rpm                                                                                                                                                110 kB/s |  76 kB     00:00
(13/17): criu-3.16.1-2.fc35.x86_64.rpm                                                                                                                                                         317 kB/s | 529 kB     00:01
(14/17): socat-1.7.4.2-1.fc35.x86_64.rpm                                                                                                                                                       182 kB/s | 302 kB     00:01
(15/17): runc-1.0.2-2.fc35.x86_64.rpm                                                                                                                                                          418 kB/s | 3.1 MB     00:07
(16/17): cri-tools-1.19.0-1.module_f35+12974+2bc66b5d.x86_64.rpm                                                                                                                               704 kB/s | 6.1 MB     00:08
(17/17): cri-o-1.21.3-1.module_f35+13330+6bc9c749.x86_64.rpm                                                                                                                                   1.1 MB/s |  23 MB     00:21
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                                                          1.4 MB/s |  42 MB     00:29
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                                                                                                       1/1
  Running scriptlet: container-selinux-2:2.173.1-1.fc35.noarch                                                                                                                                                            1/17
  Installing       : container-selinux-2:2.173.1-1.fc35.noarch                                                                                                                                                            1/17
  Running scriptlet: container-selinux-2:2.173.1-1.fc35.noarch                                                                                                                                                            1/17
  Installing       : fuse3-libs-3.10.5-1.fc35.x86_64                                                                                                                                                                      2/17
  Installing       : socat-1.7.4.2-1.fc35.x86_64                                                                                                                                                                          3/17
  Installing       : libslirp-4.6.1-2.fc35.x86_64                                                                                                                                                                         4/17
  Installing       : slirp4netns-1.1.12-2.fc35.x86_64                                                                                                                                                                     5/17
  Installing       : libnet-1.2-4.fc35.x86_64                                                                                                                                                                             6/17
  Installing       : libbsd-0.10.0-8.fc35.x86_64                                                                                                                                                                          7/17
  Installing       : criu-3.16.1-2.fc35.x86_64                                                                                                                                                                            8/17
  Installing       : runc-2:1.0.2-2.fc35.x86_64                                                                                                                                                                           9/17
  Installing       : fuse-common-3.10.5-1.fc35.x86_64                                                                                                                                                                    10/17
  Installing       : fuse3-3.10.5-1.fc35.x86_64                                                                                                                                                                          11/17
  Installing       : fuse-overlayfs-1.7.1-2.fc35.x86_64                                                                                                                                                                  12/17
  Running scriptlet: fuse-overlayfs-1.7.1-2.fc35.x86_64                                                                                                                                                                  12/17
  Installing       : containers-common-4:1-32.fc35.noarch                                                                                                                                                                13/17
  Installing       : containernetworking-plugins-1.0.1-1.fc35.x86_64                                                                                                                                                     14/17
  Installing       : conmon-2:2.0.30-2.fc35.x86_64                                                                                                                                                                       15/17
  Installing       : cri-o-1.21.3-1.module_f35+13330+6bc9c749.x86_64                                                                                                                                                     16/17
  Running scriptlet: cri-o-1.21.3-1.module_f35+13330+6bc9c749.x86_64                                                                                                                                                     16/17
  Installing       : cri-tools-1.19.0-1.module_f35+12974+2bc66b5d.x86_64                                                                                                                                                 17/17
  Running scriptlet: container-selinux-2:2.173.1-1.fc35.noarch                                                                                                                                                           17/17
  Running scriptlet: cri-tools-1.19.0-1.module_f35+12974+2bc66b5d.x86_64                                                                                                                                                 17/17
  Verifying        : conmon-2:2.0.30-2.fc35.x86_64                                                                                                                                                                        1/17
  Verifying        : containernetworking-plugins-1.0.1-1.fc35.x86_64                                                                                                                                                      2/17
  Verifying        : fuse-common-3.10.5-1.fc35.x86_64                                                                                                                                                                     3/17
  Verifying        : fuse-overlayfs-1.7.1-2.fc35.x86_64                                                                                                                                                                   4/17
  Verifying        : fuse3-3.10.5-1.fc35.x86_64                                                                                                                                                                           5/17
  Verifying        : fuse3-libs-3.10.5-1.fc35.x86_64                                                                                                                                                                      6/17
  Verifying        : libbsd-0.10.0-8.fc35.x86_64                                                                                                                                                                          7/17
  Verifying        : libnet-1.2-4.fc35.x86_64                                                                                                                                                                             8/17
  Verifying        : libslirp-4.6.1-2.fc35.x86_64                                                                                                                                                                         9/17
  Verifying        : runc-2:1.0.2-2.fc35.x86_64                                                                                                                                                                          10/17
  Verifying        : slirp4netns-1.1.12-2.fc35.x86_64                                                                                                                                                                    11/17
  Verifying        : container-selinux-2:2.173.1-1.fc35.noarch                                                                                                                                                           12/17
  Verifying        : containers-common-4:1-32.fc35.noarch                                                                                                                                                                13/17
  Verifying        : criu-3.16.1-2.fc35.x86_64                                                                                                                                                                           14/17
  Verifying        : socat-1.7.4.2-1.fc35.x86_64                                                                                                                                                                         15/17
  Verifying        : cri-o-1.21.3-1.module_f35+13330+6bc9c749.x86_64                                                                                                                                                     16/17
  Verifying        : cri-tools-1.19.0-1.module_f35+12974+2bc66b5d.x86_64                                                                                                                                                 17/17

Installed:
  conmon-2:2.0.30-2.fc35.x86_64                            container-selinux-2:2.173.1-1.fc35.noarch                    containernetworking-plugins-1.0.1-1.fc35.x86_64          containers-common-4:1-32.fc35.noarch
  cri-o-1.21.3-1.module_f35+13330+6bc9c749.x86_64          cri-tools-1.19.0-1.module_f35+12974+2bc66b5d.x86_64          criu-3.16.1-2.fc35.x86_64                                fuse-common-3.10.5-1.fc35.x86_64
  fuse-overlayfs-1.7.1-2.fc35.x86_64                       fuse3-3.10.5-1.fc35.x86_64                                   fuse3-libs-3.10.5-1.fc35.x86_64                          libbsd-0.10.0-8.fc35.x86_64
  libnet-1.2-4.fc35.x86_64                                 libslirp-4.6.1-2.fc35.x86_64                                 runc-2:1.0.2-2.fc35.x86_64                               slirp4netns-1.1.12-2.fc35.x86_64
  socat-1.7.4.2-1.fc35.x86_64

Complete!
Created symlink /etc/systemd/system/multi-user.target.wants/crio.service → /usr/lib/systemd/system/crio.service.
brent@cluster-a:~$ sudo dnf copr enable -y @redhat-et/microshift
/usr/lib/python3.10/site-packages/dnf-plugins/copr.py:433: DeprecationWarning: distro.linux_distribution() is deprecated. It should only be used as a compatibility shim with Python's platform.linux_distribution(). Please use distro.id(), distro.version() and distro.name() instead.
  dist = linux_distribution()

Enabling a Copr repository. Please note that this repository is not part
of the main distribution, and quality may vary.

The Fedora Project does not exercise any power over the contents of
this repository beyond the rules outlined in the Copr FAQ at
<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,
and packages are not held to any quality or security level.

Please do not file bug reports about these packages in Fedora
Bugzilla. In case of problems, contact the owner of this repository.
Repository successfully enabled.
brent@cluster-a:~$ sudo dnf install -y microshift firewalld
Copr repo for microshift owned by @redhat-et                                                                                                                                                   6.8 kB/s | 2.7 kB     00:00
Package firewalld-1.0.1-2.fc35.noarch is already installed.
Dependencies resolved.
===============================================================================================================================================================================================================================
 Package                                     Architecture                    Version                                                  Repository                                                                          Size
===============================================================================================================================================================================================================================
Installing:
 microshift                                  x86_64                          4.8.0-2022_01_06_210147.fc35                             copr:copr.fedorainfracloud.org:group_redhat-et:microshift                           34 M
Installing dependencies:
 microshift-selinux                          noarch                          4.8.0-2022_01_06_210147.fc35                             copr:copr.fedorainfracloud.org:group_redhat-et:microshift                           19 k

Transaction Summary
===============================================================================================================================================================================================================================
Install  2 Packages

Total download size: 34 M
Installed size: 154 M
Downloading Packages:
(1/2): microshift-selinux-4.8.0-2022_01_06_210147.fc35.noarch.rpm                                                                                                                              148 kB/s |  19 kB     00:00
(2/2): microshift-4.8.0-2022_01_06_210147.fc35.x86_64.rpm                                                                                                                                      2.0 MB/s |  34 MB     00:17
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                                                                                                          2.0 MB/s |  34 MB     00:17
Copr repo for microshift owned by @redhat-et                                                                                                                                                   9.1 kB/s | 1.0 kB     00:00
Importing GPG key 0xC6BC2A0E:
 Userid     : "@redhat-et_microshift (None) <@redhat-et#microshift@copr.fedorahosted.org>"
 Fingerprint: C950 F16F F4CC 32E0 BCDA 1DF3 4730 C786 C6BC 2A0E
 From       : https://download.copr.fedorainfracloud.org/results/@redhat-et/microshift/pubkey.gpg
Key imported successfully
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                                                                                                       1/1
  Installing       : microshift-selinux-4.8.0-2022_01_06_210147.fc35.noarch                                                                                                                                                1/2
  Running scriptlet: microshift-selinux-4.8.0-2022_01_06_210147.fc35.noarch                                                                                                                                                1/2
  Installing       : microshift-4.8.0-2022_01_06_210147.fc35.x86_64                                                                                                                                                        2/2
  Running scriptlet: microshift-4.8.0-2022_01_06_210147.fc35.x86_64                                                                                                                                                        2/2
  Running scriptlet: microshift-selinux-4.8.0-2022_01_06_210147.fc35.noarch                                                                                                                                                2/2
  Running scriptlet: microshift-4.8.0-2022_01_06_210147.fc35.x86_64                                                                                                                                                        2/2
  Verifying        : microshift-4.8.0-2022_01_06_210147.fc35.x86_64                                                                                                                                                        1/2
  Verifying        : microshift-selinux-4.8.0-2022_01_06_210147.fc35.noarch                                                                                                                                                2/2

Installed:
  microshift-4.8.0-2022_01_06_210147.fc35.x86_64                                                             microshift-selinux-4.8.0-2022_01_06_210147.fc35.noarch

Complete!

• service fails to start since its looking for podman

# Start the service
brent@cluster-a:~$ sudo systemctl enable microshift --now
Created symlink /etc/systemd/system/multi-user.target.wants/microshift.service → /usr/lib/systemd/system/microshift.service.
Created symlink /etc/systemd/system/default.target.wants/microshift.service → /usr/lib/systemd/system/microshift.service.
Job for microshift.service failed because the control process exited with error code.
See "systemctl status microshift.service" and "journalctl -xeu microshift.service" for details.

• logs out microshift.service file

brent@cluster-a:~$ systemctl status microshift.service
× microshift.service - MicroShift Containerized
     Loaded: loaded (/usr/lib/systemd/system/microshift.service; enabled; vendor preset: disabled)
     Active: failed (Result: exit-code) since Tue 2022-02-01 12:03:25 EST; 6s ago
       Docs: man:podman-generate-systemd(1)
    Process: 1631 ExecStartPre=/bin/rm -f /run/microshift.service.ctr-id (code=exited, status=0/SUCCESS)
    Process: 1632 ExecStartPre=/usr/bin/mkdir -p /var/hpvolumes (code=exited, status=0/SUCCESS)
    Process: 1633 ExecStart=/usr/bin/podman run --cidfile=/run/microshift.service.ctr-id --cgroups=no-conmon --rm --replace --sdnotify=container --label io.containers.autoupdate=registry --network=host --privileged -d --na>
    Process: 1634 ExecStopPost=/usr/bin/podman rm -f --ignore --cidfile=/run/microshift.service.ctr-id (code=exited, status=203/EXEC)
   Main PID: 1633 (code=exited, status=203/EXEC)
        CPU: 4ms

Feb 01 12:03:25 cluster-a systemd[1]: microshift.service: Scheduled restart job, restart counter is at 5.
Feb 01 12:03:25 cluster-a systemd[1]: Stopped MicroShift Containerized.
Feb 01 12:03:25 cluster-a systemd[1]: microshift.service: Start request repeated too quickly.
Feb 01 12:03:25 cluster-a systemd[1]: microshift.service: Failed with result 'exit-code'.
Feb 01 12:03:25 cluster-a systemd[1]: Failed to start MicroShift Containerized.


brent@cluster-a:~$ journalctl -u microshift.service
-- Journal begins at Thu 2022-01-27 17:56:12 EST, ends at Tue 2022-02-01 12:03:25 EST. --
Feb 01 12:03:24 cluster-a systemd[1]: Starting MicroShift Containerized...
Feb 01 12:03:24 cluster-a systemd[1617]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1617]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Main process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1618]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1618]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Control process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Failed with result 'exit-code'.
Feb 01 12:03:24 cluster-a systemd[1]: Failed to start MicroShift Containerized.
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Scheduled restart job, restart counter is at 1.
Feb 01 12:03:24 cluster-a systemd[1]: Stopped MicroShift Containerized.
Feb 01 12:03:24 cluster-a systemd[1]: Starting MicroShift Containerized...
Feb 01 12:03:24 cluster-a systemd[1621]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1621]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Main process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1622]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1622]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Control process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Failed with result 'exit-code'.
Feb 01 12:03:24 cluster-a systemd[1]: Failed to start MicroShift Containerized.
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Scheduled restart job, restart counter is at 2.
Feb 01 12:03:24 cluster-a systemd[1]: Stopped MicroShift Containerized.
Feb 01 12:03:24 cluster-a systemd[1]: Starting MicroShift Containerized...
Feb 01 12:03:24 cluster-a systemd[1625]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1625]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Main process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1626]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1626]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Control process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Failed with result 'exit-code'.
Feb 01 12:03:24 cluster-a systemd[1]: Failed to start MicroShift Containerized.
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Scheduled restart job, restart counter is at 3.
Feb 01 12:03:24 cluster-a systemd[1]: Stopped MicroShift Containerized.
Feb 01 12:03:24 cluster-a systemd[1]: Starting MicroShift Containerized...
Feb 01 12:03:24 cluster-a systemd[1629]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1629]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Main process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1630]: microshift.service: Failed to locate executable /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1630]: microshift.service: Failed at step EXEC spawning /usr/bin/podman: No such file or directory
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Control process exited, code=exited, status=203/EXEC
Feb 01 12:03:24 cluster-a systemd[1]: microshift.service: Failed with result 'exit-code'.
Feb 01 12:03:24 cluster-a systemd[1]: Failed to start MicroShift Containerized.

brent@cluster-a:~$ cat /usr/lib/systemd/system/microshift.service
# container-microshift.service
# autogenerated by Podman 3.4.0
# Fri Nov  5 14:30:39 UTC 2021

[Unit]
Description=MicroShift Containerized
Documentation=man:podman-generate-systemd(1)
Wants=network-online.target crio.service
After=network-online.target crio.service
RequiresMountsFor=%t/containers

[Service]
Environment=PODMAN_SYSTEMD_UNIT=%n
Restart=on-failure
TimeoutStopSec=70
ExecStartPre=/bin/rm -f %t/%n.ctr-id
ExecStartPre=/usr/bin/mkdir -p /var/hpvolumes
ExecStart=/usr/bin/podman run --cidfile=%t/%n.ctr-id --cgroups=no-conmon --rm --replace --sdnotify=container --label io.containers.autoupdate=registry --network=host --privileged -d --name microshift -v /var/run:/var/run -v /sys:/sys:ro -v /var/lib:/var/lib:rw,rshared -v /var/hpvolumes:/var/hpvolumes -v /lib/modules:/lib/modules -v /etc:/etc -v /run/containers:/run/containers -v /var/log:/var/log -e KUBECONFIG=/var/lib/microshift/resources/kubeadmin/kubeconfig quay.io/microshift/microshift:latest
ExecStop=/usr/bin/podman stop --ignore --cidfile=%t/%n.ctr-id
ExecStopPost=/usr/bin/podman rm -f --ignore --cidfile=%t/%n.ctr-id
Type=notify
NotifyAccess=all

[Install]
WantedBy=multi-user.target default.target

[mangelajo]

We had a bug introduced in our rpm spec file, I'm sending a bugfix, and between the bug being introduced, and yesterday, no new stable build of the rpms had been generated because of a different issue.

A couple of days ago we re-generated the rpms -> the bug crawled in.

[cooktheryan]

Latest RPM fixes this

[ec2-user@ip-172-31-86-161 ~]$ rpm -qa | grep podman
[ec2-user@ip-172-31-86-161 ~]$ rpm -qa | grep microshift
microshift-4.8.0-2022_02_02_194009.el8.x86_64
microshift-selinux-4.8.0-2022_02_02_194009.el8.noarch
[ec2-user@ip-172-31-86-161 ~]$ sudo systemctl status microshift
● microshift.service - MicroShift
   Loaded: loaded (/usr/lib/systemd/system/microshift.service; disabled; vendor preset: disab>
   Active: active (running) since Thu 2022-02-03 14:02:44 UTC; 30min ago
 Main PID: 20312 (microshift)
    Tasks: 30 (limit: 204094)
   Memory: 808.2M
   CGroup: /system.slice/microshift.service
           └─20312 /usr/bin/microshift run

Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.996247   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.996362   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.996767   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.997624   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.998203   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.999520   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:12.999776   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:13.000435   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:13.007088   2031>
Feb 03 14:33:13 ip-172-31-86-161.ec2.internal microshift[20312]: W0203 14:33:13.007124   2031>