AlmaLinux 9: Network Down After Reboot (eno1 Interface Fails to Activate)

[PrashantKNachan]

We recently encountered an issue with one cpanel server after upgrading from Almalinux 8 to Almalinux 9. Network configuration files were missing thus causing the server to go offline. By taking console access we found that the Network Manager service is running on a cPanel server with AlmaLinux 9, however the network interface eno1 fails to activate after a reboot.

Root cause analysis --> Issue with eno1 network interface fails to activate after a reboot on my AlmaLinux 9 system.

Below are the steps we took to troubleshoot and resolve the issue, including installing network-scripts to enable the network service. hope this helps.

1. If the server is accessible via IPMI or KVM, then check the directory listing on the below path:

cd /etc/sysconfig/network-scripts/

ls -la

[root@hostname network-scripts]# ls -la
total 32
drwxr-xr-x. 2 root root 4096 Aug 30 01:46 .
drwxr-xr-x. 7 root root 4096 Aug 30 00:58 ..
-rw-r--r-- 1 root root 220 Aug 29 00:37 ifcfg-eno1
-rw-r--r-- 1 root root 1244 Jul 24 04:23 readme-ifcfg-rh.txt
-rw-r--r-- 1 root root 10301 Aug 29 00:33 route6-eno1
-rw-r--r-- 1 root root 58 Aug 29 00:37 route-eno1

check ifcfg-eno1 with correct Route Configuration.

2.Checked NetworkManager Status and Network Service Status,

systemctl status NetworkManager
● NetworkManager.service - Network Manager
Loaded: loaded (/usr/lib/systemd/system/NetworkManager.service; enabled; preset: enabled)
Active: active (running) since Fri 2024-08-30 02:11:42 EDT; 13min ago

systemctl status network
Unit network.service could not be found.

3.Added development repo(Install AlmaLinux Devel repository) and encountered issues:

[root@hostname network-scripts]# dnf-config-manager --add-repo https://repo.almalinux.org/almalinux...nux-devel.repo
-bash: dnf-config-manager: command not found

[nano /etc/resolv.conf
Added: 8.8.8.8

nano /etc/yum.repos.d/almalinux-devel.repo

copy correct repo from Almalinux-9 repository :

https://repo.almalinux.org/almalinux/9.4/devel/x86_64/os/repodata/

then check again and generate and update the metadata cache for all enabled repositories using dnf makecache :

[root@hostname network-scripts]# dnf-config-manager --add-repo https://repo.almalinux.org/almalinux...nux-devel.repo

[root@hostname network-scripts]# dnf makecache
EA4 ( EasyApache 4 - c9 ) 5.5 kB/s | 2.9 kB 00:00
cPanel Addons Production Feed 4.1 kB/s | 2.9 kB 00:00
cPanel Plugins project 4.4 kB/s | 2.9 kB 00:00
Icinga packages 7.3 kB/s | 2.9 kB 00:00
MariaDB106 8.1 kB/s | 3.4 kB 00:00
AlmaLinux 9 - AppStream 41 kB/s | 4.2 kB 00:00
AlmaLinux 9 - BaseOS 38 kB/s | 3.8 kB 00:00
AlmaLinux 9 - CRB 40 kB/s | 4.2 kB 00:00
AlmaLinux OS 9 - Devel 12 MB/s | 4.4 MB 00:00
AlmaLinux 9 - Extras 33 kB/s | 3.3 kB 00:00
AlmaLinux 9 - Extras 191 kB/s | 20 kB 00:00
Extra Packages for Enterprise Linux 9 - x86_64 88 kB/s | 35 kB 00:00
Extra Packages for Enterprise Linux 9 - x86_64 15 MB/s | 22 MB 00:01
Extra Packages for Enterprise Linux 9 openh264 (From Cisco) - x86_64 3.3 kB/s | 993 B 00:00
Imunify360 - Gradual Rollout Slot 5 8.1 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 8.4 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 7 8.5 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 8 8.4 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 1 8.5 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 2 8.3 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 3 8.3 kB/s | 3.0 kB 00:00
Imunify360 - Gradual Rollout Slot 4 8.8 kB/s | 3.0 kB 00:00
EL-9 - Imunify360 16 kB/s | 3.0 kB 00:00
Imunify360 ea-php Hardened repository for CentOS 9 - x86_64 8.4 kB/s | 3.0 kB 00:00
kernelcare 7.8 kB/s | 3.0 kB 00:00
WP Toolkit for cPanel 24 kB/s | 2.9 kB 00:00
WP Toolkit third parties 22 kB/s | 2.9 kB 00:00
Metadata cache created.

4.Ran dnf makecache:

Attempted to enable and install packages from the devel repository:

dnf --enablerepo=devel install network-scripts ipcalc bc

5. Then install the packages network-scripts, ipcalc, and bc from the appstream repository(Install network-scripts rpm package:

dnf --enablerepo=appstream install network-scripts ipcalc bc

Package Architecture Version Repository Size
================================================== ================================================== ================================================== ================================================== ======
Installing:
network-scripts x86_64 10.11.6-1.el9 almalinux-devel 56 k
Installing weak dependencies:
network-scripts-teamd x86_64 1.31-16.el9_1 almalinux-devel 10 k

Transaction Summary​

6.Verify the network-scripts on below path:

cd /etc/sysconfig/network-scripts/

root@hostname network-scripts]# ls -la
total 256
drwxr-xr-x. 2 root root 4096 Aug 30 02:31 .
drwxr-xr-x. 7 root root 4096 Aug 30 00:58 ..
-rw-r--r-- 1 root root 220 Aug 29 00:37 ifcfg-eno1
-rw-r--r-- 1 root root 254 Feb 8 2024 ifcfg-lo
-rwxr-xr-x 1 root root 2057 Feb 8 2024 ifdown
-rwxr-xr-x 1 root root 649 Feb 8 2024 ifdown-bnep
-rwxr-xr-x 1 root root 6560 Feb 8 2024 ifdown-eth
-rwxr-xr-x 1 root root 772 Feb 8 2024 ifdown-ippp
-rwxr-xr-x 1 root root 4534 Feb 8 2024 ifdown-ipv6
lrwxrwxrwx 1 root root 11 Apr 3 06:15 ifdown-isdn -> ifdown-ippp
-rwxr-xr-x 1 root root 2068 Feb 8 2024 ifdown-post
-rwxr-xr-x 1 root root 873 Feb 8 2024 ifdown-routes
-rwxr-xr-x 1 root root 1462 Feb 8 2024 ifdown-sit
-rwxr-xr-x 1 root root 1625 Jan 9 2020 ifdown-Team
-rwxr-xr-x 1 root root 1560 Jan 9 2020 ifdown-TeamPort
-rwxr-xr-x 1 root root 1466 Feb 8 2024 ifdown-tunnel
-rwxr-xr-x 1 root root 5159 Feb 8 2024 ifup
-rwxr-xr-x 1 root root 12215 Feb 8 2024 ifup-aliases
-rwxr-xr-x 1 root root 909 Feb 8 2024 ifup-bnep
-rwxr-xr-x 1 root root 14186 Feb 8 2024 ifup-eth

7. Confirmed the Network Interfaces Status eno1 with UP,BROADCAST,RUNNING,MULTICAST status:

[root@hostname network-scripts]# ifconfig

8.Checked Service status before enabling:

[root@hostname network-scripts]# systemctl status network
○ network.service - LSB: Bring up/down networking
Loaded: loaded (/etc/rc.d/init.d/network; generated)
Active: inactive (dead)
Docs: man:systemd-sysv-generator(8)

9. Enabling and starting the service:

[root@hostname network-scripts]# systemctl enable network
network.service is not a native service, redirecting to systemd-sysv-install.
Executing: /usr/lib/systemd/systemd-sysv-install enable network

[root@hostname network-scripts]# systemctl restart network
[root@hostname network-scripts]# systemctl status network
● network.service - LSB: Bring up/down networking
Loaded: loaded (/etc/rc.d/init.d/network; generated)
Active: active (exited) since Fri 2024-08-30 02:31:55 EDT; 4s ago
Docs: man:systemd-sysv-generator(8)

10. Reboot and final status check: After rebooting, the network service starts once the server successfully boots.

[root@hostname ~]# systemctl status network
● network.service - LSB: Bring up/down networking
Loaded: loaded (/etc/rc.d/init.d/network; generated)
Active: active (exited) since Fri 2024-08-30 02:32:21