Optiplex 7010 not turning back on after reboot

[philipandag]

Component

Dasharo firmware

Device

Dell OptiPlex 7010

Dasharo version

v0.1.0

Dasharo Tools Suite version

Test case ID

Brief summary

No video on pikvm, no serial output after reboot

How reproducible

5-10%, I wasn't able to find a correlation of this issue to anything as for this moment
Very likely to happen when running CBMEM003.001 test case which reboots five times in a row.

How to reproduce

Reboot the device. CBMEM003.001 works well as a way to reproduce this. I have experienced it when rebooting in both Ubuntu and DTS. Not when rebooting from the Setup menu, but this does not mean it won't happen.

Expected behavior

The device should always boot back up after a reboot.

Actual behavior

There is no video nor serial output, pressing the power / reset buttons (via osfv_cli rte) does not affect the device. To turn it back on I had to cut the power off and on (sonoff) and then power it back on normally (osfv_cli rte pwr on)

Screenshots

Ubuntu serial output when rebooting

[  OK  ] Unmounted /run/user/128.
[  OK  ] Stopped Userspace Out-Of-Memory (OOM) Killer.
[  OK  ] Stopped User Runtime Directory /run/user/128.
[  OK  ] Removed slice User Slice of UID 128.
         Stopping Permit User Sessions...
[  OK  ] Started Show Plymouth Power Off Screen.
plymouth-poweroff.service
[  OK  ] Stopped Permit User Sessions.
[  OK  ] Stopped target Network.
[  OK  ] Stopped target User and Group Name Lookups.
[  OK  ] Stopped target Remote File Systems.
         Stopping Network Manager...
         Stopping Network Name Resolution...
         Stopping WPA supplicant...
[  OK  ] Stopped Network Name Resolution.
[  OK  ] Stopped WPA supplicant.
[  OK  ] Stopped Network Manager.
[  OK  ] Stopped target Preparation for Network.
[  OK  ] Stopped Thermal Daemon Service.
[  OK  ] Stopped Snap Daemon.
[  OK  ] Stopped target Basic System.
[  OK  ] Stopped Forward Password R…s to Plymouth Directory Watch.
[  OK  ] Stopped target Path Units.
[  OK  ] Stopped ACPI Events Check.
[  OK  ] Stopped CUPS Scheduler.
[  OK  ] Stopped Start whoopsie on …n of the /var/crash directory.
[  OK  ] Stopped target Slice Units.
[  OK  ] Removed slice User and Session Slice.
[  OK  ] Stopped target Socket Units.
[  OK  ] Stopped target System Time Set.
[  OK  ] Closed ACPID Listen Socket.
[  OK  ] Closed Avahi mDNS/DNS-SD Stack Activation Socket.
[  OK  ] Closed CUPS Scheduler.
[  OK  ] Closed Socket activation for snappy daemon.
[  OK  ] Closed Syslog Socket.
[  OK  ] Closed UUID daemon activation socket.
[  OK  ] Stopped target System Initialization.
[  OK  ] Stopped target Local Encrypted Volumes.
[  OK  ] Stopped Forward Password R…uests to Wall Directory Watch.
[  OK  ] Stopped target Local Verity Protected Volumes.
         Stopping Set Up Additional Binary Formats...
[  OK  ] Stopped Apply Kernel Variables.
[  OK  ] Stopped Load Kernel Modules.
         Stopping Network Time Synchronization...
         Stopping Record System Boot/Shutdown in UTMP...
[  OK  ] Stopped Set Up Additional Binary Formats.
[  OK  ] Unset automount Arbitrary …s File System Automount Point.
[  OK  ] Stopped Network Time Synchronization.
[  OK  ] Stopped Record System Boot/Shutdown in UTMP.
[  OK  ] Stopped Create Volatile Files and Directories.
[  OK  ] Stopped target Local File Systems.
[  OK  ] Stopped target Mounted snaps.
         Unmounting /boot/efi...
         Unmounting /home...
         Unmounting /run/credentials/systemd-sysusers.service...
         Unmounting /run/snapd/ns/snapd-desktop-integration.mnt...
         Unmounting Mount unit for bare, revision 5...
         Unmounting Mount unit for core22, revision 1621...
         Unmounting Mount unit for core22, revision 1663...
         Unmounting Mount unit for firefox, revision 5014...
         Unmounting Mount unit for firefox, revision 5091...
         Unmounting Mount unit for gnome-42-2204, revision 141...
         Unmounting Mount unit for gnome-42-2204, revision 176...
         Unmounting Mount unit for …ommon-themes, revision 1535...
         Unmounting Mount unit for snap-store, revision 1113...
         Unmounting Mount unit for snap-store, revision 1216...
         Unmounting Mount unit for snapd, revision 20671...
         Unmounting Mount unit for snapd, revision 21759...
         Unmounting Mount unit for …p-integration, revision 247...
         Unmounting Mount unit for …p-integration, revision 253...
         Unmounting Mount unit for …sion 3836 via mount-control...
[  OK  ] Unmounted /boot/efi.
[  OK  ] Unmounted /home.
[  OK  ] Unmounted /run/credentials/systemd-sysusers.service.
[  OK  ] Unmounted /run/snapd/ns/snapd-desktop-integration.mnt.
[  OK  ] Unmounted Mount unit for bare, revision 5.
[  OK  ] Unmounted Mount unit for core22, revision 1621.
[  OK  ] Unmounted Mount unit for core22, revision 1663.
[  OK  ] Unmounted Mount unit for firefox, revision 5014.
[  OK  ] Unmounted Mount unit for firefox, revision 5091.
[  OK  ] Unmounted Mount unit for gnome-42-2204, revision 141.
[  OK  ] Unmounted Mount unit for gnome-42-2204, revision 176.
[  OK  ] Unmounted Mount unit for g…-common-themes, revision 1535.
[  OK  ] Unmounted Mount unit for snap-store, revision 1113.
[  OK  ] Unmounted Mount unit for snap-store, revision 1216.
[  OK  ] Unmounted Mount unit for snapd, revision 20671.
[  OK  ] Unmounted Mount unit for snapd, revision 21759.
[  OK  ] Unmounted Mount unit for s…top-integration, revision 247.
[  OK  ] Unmounted Mount u[  OK  ] Unmounted Mount unit for f…vision 3836 via mount-control.
[  OK  ] Stopped target Mounting snaps.
         Unmounting /run/snapd/ns...
[  OK  ] Stopped File System Check on /dev/disk/by-uuid/4275-0C1D.
[  OK  ] Stopped File System Check …8-279b-4721-a32a-c764efd84b96.
[  OK  ] Removed slice Slice /system/systemd-fsck.
[  OK  ] Unmounted /run/snapd/ns.
[  OK  ] Stopped target Preparation for Local File Systems.
[  OK  ] Stopped target Swaps.
         Deactivating swap /dev/dis…L100-240-G2_GW3020985-part3...
[  OK  ] Stopped Create Static Device Nodes in /dev.
[  OK  ] Stopped Create System Users.
[  OK  ] Stopped Remount Root and Kernel File Systems.
[  OK  ] Reached target System Shutdown.
[  OK  ] Deactivated swap /dev/disk…/pci-0000:00:1f.2-ata-1-part3.
[  OK  ] Deactivated swap /dev/disk…ci-0000:00:1f.2-ata-1.0-part3.
[  OK  ] Deactivated swap /dev/disk…/wwn-0x502b2a201d1c1b1a-part3.
[  OK  ] Deactivated swap /dev/disk…d-77c4-4aa7-8891-d02fce2d57b3.
[  OK  ] Deactivated swap /dev/disk…-CL100-240-G2_GW3020985-part3.
[  OK  ] Deactivated swap /dev/sda3.
[  OK  ] Deactivated swap /dev/disk…f-f52c-4623-b040-a2a5cae5a4a2.
[  OK  ] Reached target Unmount All Filesystems.
[  OK  ] Reached target Late Shutdown Services.
[  OK  ] Finished System Power Off.
[  OK  ] Reached target System Power Off.
[  176.955521] reboot: Power down

No more serial output is ever produced unless the power is cut off.

CBMEM003.001 logs show the issue on the fifth iteration.
dasharo-performance_log.zip

Additional context

I have experienced this issue when testing CBMEM003.001 on three separate tries. First it appeared on the first iteration of the measurement. On the second try it has appeared on the second iteration. On the third try, the test succeeded. Finally it has appeared on the fifth iteration when I tried to get some logs for this issue.

Solutions you've tried

No response

[miczyg1]

On the OptiPlex I tested I have seen that the Dasharo firmware was not deployed properly. It was missing the SCH5545 FW. SCH5545 is the chip which gives us the serial port and also manages the platform power sequencing. Validating the firmware which was not properly deployed (without blobs transmission in DTS) is not correct. When the blob is used, I have no problems with rebooting.