Hello
We purchased several HDK 8Gen1 for evaluation of our software.
We encountered accidentally reboot issue.
Our software needs system reboot and all of our HDKs failed to reboot.
But reproducibility is not good...
Summary is here...
System No Failure Cycle
#1 62
#2 91
#3 10
#4 84
#5 51
#7 12
#8 139
#9 7
#10 6
#11 99
#12 20
#13 94
Has anyone faced this issue?
Here is failure log output
Format: Log Type - Time(microsec) - Message - Optional Info
Log Type: B - Since Boot(Power On Reset), D - Delta, S - Statistic
S - QC_IMAGE_VERSION_STRING=BOOT.MXF.2.0-00728-WAIPIO-1
S - IMAGE_VARIANT_STRING=SocWaipioLAA
S - OEM_IMAGE_VERSION_STRING=crm-ubuntu135
S - Boot Interface: UFS
S - Secure Boot: Off
S - Boot Config @ 0x221c8600 = 0x00000001
S - JTAG ID @ 0x221c8744 = 0x301880e1
S - OEM ID @ 0x221c8700 = 0x00000000
S - Serial Number @ 0x221c8610 = 0x0000043217c9eed0
S - OEM Config Row 0 @ 0x221c2230 = 0x0000000000000000
S - OEM Config Row 1 @ 0x221c2238 = 0x0000000000000000
S - Feature Config Row 0 @ 0x221c2258 = 0x000000ffffffbf00
S - Feature Config Row 1 @ 0x221c2260 = 0x0000000000000000
S - OEM LCS:PROD
S - Core 0 Frequency, 1363 MHz
S - PBL Patch Ver: 0
S - PBL freq: 600 MHZ
S - -------------------------
PBL Timestamps (in usecs)
-------------------------
APBL start: 330
APBL Boot Media Detect Start: 7743
APBL Boot Media Detect End: 7760
APBL SHELF Load+Auth Start: 7760
APBL ELF MD Load Start: 45715
APBL ELF MD Load End: 45943
APBL ELF Seg Load Start: 45943
APBL ELF Seg Load End: 48956
APBL SEQ Valid Set: 48983
APBL SEQ SA ACK Rcvd: 59235
APBL ELF MD Load Start: 60451
APBL ELF MD Load End: 61330
APBL ELF Auth Start: 61335
APBL ELF Auth End: 70773
APBL ELF Seg Load Start: 70775
APBL ELF Seg Load End: 73955
APBL ELF Seg Verify Start: 73956
APBL ELF Seg Verify End: 78916
APBL ELF MD Load Start: 80055
APBL ELF MD Load End: 80803
APBL ELF Auth Start: 80805
APBL ELF Auth End: 90246
APBL ELF Seg Load Start: 90248
APBL ELF Seg Load End: 97570
APBL ELF Seg Verify Start: 97571
APBL ELF Seg Verify End: 102041
APBL SHELF Load+Auth End: 102188
APBL TME PBL Exit: 102191
APBL XBL_SC Exit Check: 102543
APBL XBL_SC Exit Ack: 110638
APBL Exit: 110641
B - 113307 - SBL1, Start
B - 298107 - SBL1 BUILD @ 03:03:25 on Mar 9 2022
B - 306220 - usb: HS: usb_shared_xbl_dtb_node_init dtb inaccessible , 0x2
B - 311954 - usb: usb_hs_phy_cfg size , 0x20
B - 313265 - usb: eud_ser_upd , 0x17c9eed0
D - 12597 - sbl1_hw_init
D - 488 - media_init:1
D - 0 - blacklist disable
B - 327234 - OEM_MISC - Image Load, Start
D - 2592 - Auth Metadata
D - 9364 - OEM_MISC - Image Loaded, Delta - (4648 Bytes)
B - 337360 - QTI_MISC - Image Load, Start
D - 9546 - Auth Metadata
D - 17416 - QTI_MISC - Image Loaded, Delta - (4624 Bytes)
B - 355782 - APDP - Image Load, Start
D - 5795 - APDP - Image Loaded, Delta - (0 Bytes)
D - 0 - boot_dload_dump_security_regions
D - 0 - EUD Init
D - 0 - blacklist enable
D - 3111 - DP_Milestone
D - 3233 - Auth Metadata
D - 4941 - sbl1_xblconfig_init
B - 386801 - XBL Config - Image Load, Start
B - 390125 - DTB: looking for default S_DTB_NAME
B - 396012 - DTB: published DEFAULT_BLOB_ID
D - 9089 - boot_pre_ddr_dtb_init
B - 412116 - PM: PM_DT_PARSING_ERR: charger
B - 414129 -
BUS: 0 PMIC A:2.0 B:2.2 C:2.2 D:2.0 E:2.3 H:1.0 I:1.1 J:1.1
BUS: 1 PMIC J:2.0 L:2.0
B - 423919 - PM: Reset by PSHOLD
B - 425719 - PM: Reset Type: Warm Reset
B - 429013 - PM: Warm reset count:0x3
B - 432947 - PM: Reset by PSHOLD
B - 436699 - PM: Reset Type: Warm Reset
B - 440023 - PM: Warm reset count:0x2
B - 443958 - PM: Reset by PSHOLD
B - 447679 - PM: Reset Type: Warm Reset
B - 451003 - PM: Warm reset count:0x1
B - 456036 - PM: PBS_RAM 0 reloading
B - 510356 - PM: PBS_RAM 1 reloading
B - 633515 - PM: PBS_RAM 2 reloading
B - 679814 - PM: SET_VAL:Skip
B - 680089 - PM: PSI: b0x0a_v0x97
B - 686036 - PM: Device Init # SPMI Transn: 15607
D - 282735 - pm_device_init, Delta
B - 691069 - pm_driver_init, Start
B - 704062 - PM: Driver Init # SPMI Transn: 713
D - 9516 - pm_driver_init, Delta
D - 305213 - sbl1_pmic_init
D - 28091 - media_init:2
B - 780739 - UFS Spec Version: 3.10
B - 783545 - UFS INQUIRY ID: SKhynix HN8T15BZGKX016 A002
B - 786198 - UFS Boot LUN: 1
B - 791902 - UFS Total Size: 256 GB
B - 807030 - UFS Speed: Gear 4 Lane 2 Rate B
D - 70363 - media_init:3
D - 30 - boot_wdog_disable_check
D - 61 - init-logstomedia
D - 0 - shrm_load_cancel
B - 820816 - SHRM - Image Load, Start
D - 152 - boot_cdt_init
B - 827678 - CDT - Image Load, Start
B - 830484 - CDT Version:3,Platform ID:31,Major ID:1,Minor ID:0,Subtype:0
D - 9455 - sbl1_hw_platform_pre_ddr
B - 847229 - usb: chgr - CDP_CHARGER
B - 847229 - usb: qusb_dci_eud_init
B - 851377 - usb: HS: usb_shared_xbl_dtb_node_init dtb inaccessible , 0x3
B - 860283 - usb: usb_hs_phy_cfg size , 0x20
B - 1061491 - usb: usb_dp_toggled_for_cdp , 0xc8
B - 1062620 - PM: Battery ID: 7667Ohm
B - 1066158 - PM: debug board connected
B - 1069848 - PM: CHG Init # SPMI Transn: 16375
B - 1073661 - vsense_init, Start
D - 0 - vsense_init, Delta
D - 251960 - sbl1_hw_pre_ddr_init
D - 91 - boot_fedl_check
D - 0 - boot_dload_handle_forced_dload_timeout
B - 1099525 - Pre_DDR_clock_init, Start
D - 0 - Pre_DDR_clock_init, Delta
D - 8875 - sbl1_ddr_set_params
B - 1112213 - sbl1_ddr_init, Start
B - 1115568 - LP5 DDR detected
B - 1118923 - PASS1 Cookie = 0xcafe1111
B - 1121973 - HAL_DDR_SDI_Recover() start: DBG PDC Tr = 0x1, First Pass expire = 0x0, First Pass complete = 0x1 , BIMC Alt ARES = 0x0 , PASS2 Cookie = 0xcafecab0
B - 1137314 - SHRM run state = 0x10
B - 1140974 - HAL_DDR_SDI_Recover() end : DBG PDC Tr = 0x1, First Pass expire = 0x0, First Pass complete = 0x1 , BIMC Alt ARES = 0x0 , PASS2 Cookie = 0xcafebabe
B - 1155889 - SHRM run state = 0x10
B - 1159305 - ddr_init status = 0 DDR recover normal pass2
D - 47367 - sbl1_ddr_init, Delta
D - 56425 - sbl1_ddr_init
D - 0 - store-logstomedia
B - 1174677 - do_ddr_training, Start
D - 0 - do_ddr_training, Delta
D - 6710 - xbl_trng_ddi_seq
D - 0 - store-logstomedia
D - 1312 - xbl_map_smem
D - 31 - boot_smem_debug_init
D - 0 - boot_smem_init
D - 1983 - boot_ddr_share_data_to_aop
D - 31 - boot_populate_ddr_details_shared_table
D - 0 - boot_update_ram_partition_table
B - 1209020 - Pimem init cmd, entry
D - 31 - Pimem init cmd, exit
B - 1219664 - External heap init, Start
B - 1220305 - External heap init, End
D - 25406 - sbl1_post_ddr_init
D - 0 - sbl1_hw_init_secondary
B - 1237690 - DDR - Image Load, Start
B - 1241258 - Find DTB for chipinfo:[7401e202020000] and platforminfo:[1f00010000000000]
B - 1250713 - DTB: looking for default D_DTB_NAME
B - 1255502 - DTB: published DEFAULT_BLOB_ID
D - 16714 - boot_platform_dtb_init
B - 1262273 - usb: ser_str_cookie_pid - b9209552
D - 3568 - boot_usb_update_serial
D - 0 - boot_usb_handle_charger
D - 91 - sbl1_hw_platform_smem
B - 1277706 - TCSR reg value 0x10
D - 3507 - ramdump_load_cancel
B - 1284599 - RamDump - Image Load, Start
D - 3142 - Auth Metadata
D - 21624 - RamDump - Image Loaded, Delta - (786392 Bytes)
B - 1311927 - boot_dload_entry
B - 1312750 - SBL1, End
D - 1201792 - SBL1, Delta
S - Flash Throughput, 215340 KB/s (861362 Bytes, 4941 us)
S - DDR Frequency, 200 MHz
B - 2333067 - PM: Driver Init # SPMI Transn: 761
B - 2508167 - PM: PM_DT_PARSING_ERR: charger
B - 3820979 - OCIMEM.BIN
B - 3821040 - CODERAM.BIN
B - 3823541 - DATARAM.BIN
B - 3826164 - MSGRAM0.BIN
B - 3828787 - MSGRAM1.BIN
B - 3831379 - MSGRAM2.BIN
B - 3833972 - MSGRAM3.BIN
B - 3836595 - MSGRAM4.BIN
B - 3839187 - MSGRAM5.BIN
B - 3841810 - MSGRAM6.BIN
B - 3844403 - MSGRAM7.BIN
B - 3846995 - MSGRAM8.BIN
B - 3849618 - MSGRAM9.BIN
B - 3852211 - MSGRAM10.BIN
B - 3854803 - MSGRAM11.BIN
B - 3857518 - MSGRAM12.BIN
B - 3860202 - MSGRAM13.BIN
B - 3862886 - MSGRAM14.BIN
B - 3865570 - MSGRAM15.BIN
B - 3868284 - SHRM_MEM.BIN
B - 3870968 - DCC_SRAM.BIN
B - 3873652 - DCC_CFG.BIN
B - 3876336 - CD_STRCT.BIN
B - 3878959 - CD_BTDDR.BIN
B - 3881643 - CD_BTIMM.BIN
B - 3884358 - CD_SHIMM.BIN
B - 3887042 - CPUCPFW.BIN
B - 3889726 - AOSS_ISL.BIN
B - 3892318 - SMEMINFO.BIN
B - 3895002 - SMEM_VER.BIN
B - 3897717 - PMIC_PON.BIN
B - 3900401 - PMON_HIS.BIN
B - 3903115 - RST_STAT.BIN
B - 3905799 - IPA_IU.BIN
B - 3908483 - IPA_SRAM.BIN
B - 3911015 - IPA_HRAM.BIN
B - 3913699 - IPA_MBOX.BIN
B - 3916383 - IPA_GSI.BIN
B - 3919067 - IPA_SEQ.BIN
B - 3921690 - PmicDump.bin
B - 3924282 - DDR_DATA.BIN
B - 3926966 - PIMEM.BIN
B - 3929681 - FSM_STS.BIN
B - 3932090 - FSM_CTRL.BIN
B - 3934713 - DBG_EN.BIN
B - 3937367 - DDRCS0_0.BIN
B - 3939898 - DDRCS1_0.BIN
B - 3942613 - DDRCS1_1.BIN
B - 3945297 - DDRCS2_0.BIN
B - 3947981 - DDRCS2_1.BIN
B - 3950665 - DDRCS2_2.BIN
B - 3953379 - load.cmm
B - 3958320 - Boot device check, skipping [0]
B - 3958412 - Boot device check, skipping [1]
B - 3962804 - get rd_format_if.init failed
B - 3967165 - Boot device check, skipping [3]
B - 3971313 - HFAT Dump Init
B - 3975888 - SD Dump Init
B - 5211077 - get rd_format_if.init failed
B - 5211199 - rd_media_if.media_hw_init
B - 5215286 - usb: init start
B - 5219465 - usb: usb_dci_get_chip_serial_number , 0x17c9eed0
B - 5227791 - usb: usb_get_product_str_desc_with_chip_serial , 0x15
B - 5233891 - usb: qusb_platform , 0x1f
B - 5234562 - usb: ss_lane_2nd
B - 5248623 - usb: ssusb_phy_init_success lane , 0x1
B - 5256004 - usb: usb: chgr , 0x2
B - 5455992 - usb: usb_dp_toggled_for_cdp , 0xc8
B - 5456785 - usb: ID:0x108, value: 0x1d80
B - 5460750 - usb: timer_start , 0x4c4b40
B - 5464898 - usb: ID:0xe0, value: 0x1
B - 5468863 - usb: VBUS High!
B - 5548407 - usb: SUPER , 0x900e
B - 5576711 - usb: ENUM success
B - 5576772 - Sahara Init
B - 5579944 - Sahara Open
B - 5589430 - usb: clear_ep_halt , 0x11
B - 5589613 - usb: resubmit urb , 0x11
B - 5593944 - usb: clear_ep_halt , 0x10
Hello handzhu,
Thank you for your reply. We could get dumped files by qpst. It looks raw binary files.
I have no idea to readout contents. Is there any tool to parse the dumped files?
We didn't modify the firmware and any changes. This reboot issue can be reproduced by the command "adb reboot".
Hi
If you have the qualcomm account, you can create a case to qualcomm, or you can get the below document from qualcomm createpoint(https://createpoint.qti.qualcomm.com/)
Qcap or CrashScope can analyse the ramdump, Also qualcomm has ramparser-tools for analyse qualcomm ramdump.
below doc describe how to use ramdump analyse tools:
80-NR964-54_QCAP SYSTEMS OVERVIEW
80-P7139-1_A_LA_Stability Analysis Overview
80-P7139-5_A_Introduction_Linux_Ramdump_Parser
SP80-PV345-5_SM8450/SM8475 Software Debug Manual
If you cann't get any tools as I mentioned, maybe you can connect the uart in HDK device and try to get the kernel log when system panic.
QCAP SYSTEMS OVERVIEW