[BUG] sim/smp is broken

[raiden00pl]

Description / Steps to reproduce the issue

on tag: nuttx-12.7.0-RC0:

./tools/configure.sh sim/smp
 make -j
 
 [raiden00:~/git/RTOS/nuttx/nuttx]$ ./nuttx                                                                                                                                                                                                                        
[1]    332900 segmentation fault (core dumped)  ./nuttx

On the current master (a613bcb) we don't get segmentation fault and we can boot to NSH but it's not functional: interaction with NSH lags like hell.

On which OS does this issue occur?

[OS: Linux]

What is the version of your OS?

Arch Linux

NuttX Version

nuttx-12.7.0-RC0, master

Issue Architecture

[Arch: simulator]

Issue Area

[Area: Kernel]

Verification

• I have verified before submitting the report.

[raiden00pl]

It looks like sim/nsh behaves the same. On the other hand sim/foc works fine.

EDIT: sim/nsh is OK. I must have checked something wrong before. The problem is in sim/smp

[xiaoxiang781216]

@hujun260 please take a look.

[hujun260]

#13933
fix this issue

[raiden00pl]

I'm reopening this because sim/smp is still broken. Now console output doesn't work properly.
Here are the details: #13933 (comment)

[raiden00pl]

another problem is assertion in ostest which happens randomly:

signest_test: With task locking
  Total signalled 2480  Odd=1240 Even=1240
  Total handled   2480  Odd=1240 Even=1240
  Total nested    0    Odd=0   Even=0  
[CPU1] dump_assert_info: Current Version: NuttX  10.4.0 6e12b3d74b Oct 12 2024 10:57:16 sim
[CPU1] dump_assert_info: Assertion failed : at file: signest.c:228 task(CPU1): ostest process: ostest 0x441c23
ostest_main: Exiting with status 256
stdio_test: Standard I/O Check: fprintf to stderr

[raiden00pl]

another issue in ostest is broken wdog_test that produce garbage output

wdog_test start...
[CPU2] wdtest_once 0 ns
[CPU2] wdtest_o[nCcPeU [31C] P nUsw0
d]te swtd_o[tnCecPesU 2t0] _ nwosdn
tceset _0on[ cCneP sU0
3 ]n sw
dtes[t_CoPncUe0 0]  nws[
dCPtUe2s] tw_dotnescte_o n[0cC ePn U0s3 
]n sw
dtest_[onCcPeU 00 ]n s[w
CdPtU2e]s twd_toensc[teC_ Po0Un 3cn]es  w
0d tness
t_[oCnPcUe0 ]0  nwsd
t[eCsPUt2_]o nwcde[tC Pe0Us 3tn]_ sow
dntcees t0_ o[nnCscP
eU 00 ]n sw
[dCtPeUs2t]_ owndctee s0t _nosn
ce 0 ns
[CPU1] wdtest_once 10 ns
[CPU1] wdtest_once 1 ns
[CP[[UCCP2U1P]] Uwd t0ews]td _owtncdeet s1e tsnst
__oon[nCPccU1e]e w  dte11st _ onnncess 1 

ns
[[CCPU1P] wUd[te2sCt]P_oUn ce0 w1] nds 
twde[tCsPeU1ts] wt_dt_eosotn_noncccee e1  n s1
1  n[CsnPU
1s] w
dtest_once 1 ns[
CPU0[]C[ CwPPUd1U]t ew2dst]tes t__owoncdne tc1 nees
s 1t [_CPnUo1s]n 
wdcteest_ on1ce  1 [nnsC
sP
U0] wdtest_once 1 ns
[CPU1] wdtest_on[cCPeU 21] 0w0 dnts
[esCtP[_CUPoU01n]]c  wedw ted1s0tt_ eonnsscet
 1_0 nosn
ce [1C[P0CPU U12n]] sw dtw
edstt_oencse t10_ nos
[ncCeP[ UC1P0U01]]  w ndtwsesd
t_tonecse t10_ nso[
nCcP[UeCP2 U]11]  0wwdd ttenestss_ot
n_ceo 1n0 cnse
 1[0C[ CPnPUsU1
] w0dte]st_ own[cedC 1P0t Un2es
]s twd_[CtPoeU1sn]t wc_dtoeesntc_ oen1 ce1 0100   nsn
ns
s
[CPU1] wdtest[_oCnPceU 210]  nsw
dtest_once 10 ns
[CPU1] wdtest_once 1000 ns
[CPU[2[]CC PPUw1U]d w0tdtee]sstt_ o_ncowe nd1c0t0e n es1
s00t [nC_PsU1o
] wndtecst_eon c[e1 C10P00U n20s]
  wnd[CtPsUe1
s] twd_teosnt_conece  110[00 Cn0s
P nUs0[
CP]U1 ] wwdtdestt_[oenCcesP 1Ut002 _]ns 
ownd[ctCePeU 1s] 1wtdt0_es0to_ nonncce se10
 0 n1s
00 ns[[C
CPU1P] Uwdt0est]_o n[cweC 1dP00t Unse
2s]t [C_wPUo1d] ntwdceteesst _ton1_ce0o 01n0 0 cnnses
 
1[C0PU01]  wndtesst
_once 100 ns
[CPU1] wdtest_once 10000 ns
[CP[UCP2U1]] w dtewstd_[otnCceeP s1U0t000 _]nso
 nwdc[tCePeU1 ]s t1wd_t0eost0n_ocn0cee  1 0n010 0sns0

0 [nCPsU1
] wdtest_onc[e 1C00P0 nUs
2[C]P[ CPUUw01]d] w dttweedstst_oten_cseo t10n_00co nsen
c e1[ CP0U110]0 w00dt 0es tn_nosnsce

 1000 ns
[CP[U[CPCU01P]] wU dt2ewst]d_otn ceew s10dt00_t nose
nscte[C _PU11o]0 nwd0ctes0et_ o nnc1es 01
0000 0ns 
ns[
C[PCPUU10] w]dte stw_ondce t100e0 nss
t_once 1000 ns
[CPU1] wdtest_once 100000 ns
[[CPCU1]P wdUt[e2stC_]onPc e U1w000d0]0t  nsew
sdtt[C_ePUo1s]n twcd_teoes nt_1con0ece0  100100000  0nns0
s0
 n[CsPU
1] wdtes[t_ConPceU 1020[0]0C n Ps
wU0d]t[C PewU1sd] wttdtee_ssto_ton_nccoe ne10c0 e00 1 n1s0
00000[C00PU 1 ]n nswd
ste
st_once 10000 [nCs
PU[0C[]CPP U1Uw] 2wdd]tte set_wsontdce_ to10en00c0s enst 
1_0o[0nCP0Uc10]  ewdnt ses
1t_o0nc0e 01000[0 0C nPnsUs
0
][ CPwU1]d wdtteset_osncte _10o00n0 cnse
 10000 ns
[CPU1] wdtest_once [1C00P0U0200]  nws
d[tCePsUt_0[oC]Pn Ucw1e]d  t1we0dst0te0_s0to0_n ocnnecs e
 110000000000 [n Csn
PsU
2] w[CdPtUe1s][t C_wPodUtne0cs]et  _wo1nd0ct0ee0 s01t000_ 0on0ns0c
 ens 
100[0C0P0U [2nC]PsU 
1w]d twedstte_[sotCn_PocUnec0 e] 1 100w00d00t000e0 s ntsn
_so
nce 1[C0P0U[01C]0P 0wU d2nt]es s
tw_dotnecse t1_[0oC0n0P0cU0e0  ]n1s 
0w0d0t0e0s[ tCn_PsUo1
n]c wed t1e0st[0_C0oPn0Uc0e2  ]n1 s0w0
0d0t0e snts_
o[nCcPeU 01]0 0w0d0t0e snts_
once 100000 ns
[C[P[UCCP0UP1]]U  ww2ddt]ets et_wsontdc_teoe n1sc00et0 0_010o 0nn0s
c00e0 0[1 CPn0U1s0]
0 w0dt0es0t_ onnc[esC 1P
0U0000]00  wnsd
te[sCtP[C_UPoU21n]]c we d twe1sdt0_t0on0ec0es 01t00_0 0o0n0ns0 
cnse
 100[0C0[PC0PUU010 ]] nw dswted
stt_eonscte _1o00n0c0[0e0C  nP1s
0U020]0[ 0CwP0Ud 1]tn wsed
tsestt__onocen 1[c0C0e0P0 0U010 n0]s
 0w0d0t[e0Cs0PtU 1_]no wsndtc
eest _o1n0ce0 01000[000C000P  nnUss
2
] [wCPdUt1]e wsdttes_t_oonncec 1e00 001000 n0s
0000 ns
[CPU1] wd_start with maximum delay, cancel OK, rest 2147483645
[CPU1] wdtest_recursive 1000000us
[CPU1] wd_start with maxi[[mCuCmPP dUUel02a]y],   wcwdan_dcse_tlsa OrtKta,  rwrteis tt wh2i 1mt4a7h4x8 i3m6m4ua5m
x[ iCdPmeU1lu]a myw d,td ecesatln_craeeyclu, rsO iKvc,ea  1nr0ec0s0e0tl0 0 2us1O
4K7,4 8r3e[6sC4Pt5U 1
]2[ wC1dP_4sUt70a4]rt8  3wwid6tth4 em5saxt
i_m[urCme PcdeuUlr2as]y,i  vcwaedn cte1le 0Os0Kt,0 _0r0re0setuc su2
1r4s74i8v36e45 
1[[C0CPU0P1U0] 00w]d0t 0ewusdts__r
sectuarsritv ew 1i0t0h0 0[0mC0auxPsi
Um2u]m  w[ddCeP_lUas1y]t ,wa drc_statn acrwtei lwt ihOthK  ,mm aaxrixemsiutmm  ud2em1la4 y7,d4 e8ca3ln6cae4yl5 ,
O [K,cC ParUens0ct] e 2w1l4d 7t4Oe8sK3t6,4_ 5r
re[eCcPsuU1tr]s  iw2dv1tee4 s7t1_40re08c0u30rs06i0v4eu5 s1

00[0C00P0uUs2
] [CwPdU[tC0eP]Us 1t]w _dwr_d_esstctarautr rwtsi tiwhv iemta hx1i m0mua0mx 0ide0mlu0amy0,  udcaesnlc
aeyl ,O Kc,a rnecste l2[ 14OC7K4P8,3U 64r25e]
s[ CtwP Ud21_]1 s4wd7tt4eas8rt3_t6r e4cw5ui
rst[iChvPe  Um100a]00 x0w0id0mutseu
smt _dree[clCuParUy1s],i wv de_cs at1na0rc0t e0w0li0t h0O umKas,x
i murm edselta y,2 [c1CanP4cUe7l04 ]O8 K3,w 6dr_4ess5tt 
a21r[4tC7 4Pw8iU36t24h5]
  [mCwPaUdx1it]m ewusdmtt ed_setr_leraecycu,ur rscsiavinev c1ee0 0l01 00O000Ku0,s0
 0r0eusst
 [2CP1U417] 4w8d3_s6[t4Ca5rPt
U [w2iC]tPh U wm0da]x_i smwutdmat rdeetsl tawy_,ir techac nucmrealsx iOivKme,u  mr1e s0dt0e 02l104a0740y8u,3s6 
4c5a
n[CcPeUl1 ] OwKd[,tCe PsrtUe_0sr]etc  uw2rds1_i4sv7et4 a81r030t60 04w050i
uts[
hC PmUa2x]i mwudmt edsetl_arye,c ucrasnicveel  1O0K0,0 0r0e0suts 
2147483645
[CPU0] wdtest_recursive 1000000us
[CPU1] recursive wdog triggered 6 times, elapsed tick 12
[CPU1] wdtest_recursive 10000000us
[CPU1] recursive wdog t[r[CiCPgPUgU2e0]r] e rdre ec6cu urtrsisimivevese , w wdedologag p tstreridig gggteeirrceekdd   1662  
tt[iiCmmPeeUss1,,]   eewlldaatppessseetdd_  rtteiicccukkr  s11i22v

e[[ CC1PP0UU0200]]0  0ww0dd0ttueesss
tt__rreeccuurr[ssCiiPvvUee1  ]11 00r00e00c00u00r00s00iuuvsse

 wdog trigg[e[CrCPePUdU 206]]   trrieemcceuusrr,ss iievvleea  pwwsddeoodgg   tttirrciikgg gg1ee2rr
ee[ddC  P66U  1tt]ii mmweedsst,,e  seetll_aarppessceeuddr  sttiiivccekk   1110220

0[[0CC0PP0UU020]u] s w
wddtteesstt_[_rCrePecUcu1ur]rs sirivevece u 1r10s00i000v00e00 00w00duuossg

 triggered [6[C CPtPUiU2m0]e] s r,re ececulurarspsisivevede   wtwdidocogkg   t1tr2ri
ig[ggCgePerUre1ed]d   6w6 d tttieimsmetess_,,r  eeeclluaarppsssieevdde   tt1ii0cc0kk0  0110220

0[[uCCsPP
UU20]]  wwdd[ttCeePssUtt__1rre]ec cururerscsiuivrves ie1v 0e10 0w00d00o00g00 0ut0sr0
iugsg
ered 6[ CtPiUm0e[]sC ,Pr eeUcl2u]arp ssrieevdce u trwidscokig  v1te2r 
iw[gdCgoPegUr 1e]td  rw6id tgtegisemtre_sre,ed c eu6lr astpiisvmeeed s 1t,0i 0c0ek0 l01a020p
us[seC
PdU 0t]i wcd[ktC eP1sU2t1
_][r CerPceUuc2ru]sr isviwevd et1 e0w0ds0ot0g_0 r0te0rcuiusgr
gseirveed  61 [0tC0iP0mUe00s]0, 0 r0eelucausprs
seidv et iwcdko [g1 2Ct
Pr[UiC2gPgU]e1 r]re edwc du6tr estsiitvm_eerse ,cw uderolsaigpv sete rd1i 0gt0gi0ec0rk0e 0d10 2u6
s [
tCiPmUe0]s ,w detleaspts_eredc utriscikv e1 21
0[0C0P0U020]0 uwsd
test_recursive 10000000us
[CPU1] recursive wdog triggered 6 times, elapsed tick 12
[CPU2] recursive wd[[oCCgPP UUt03r]]i  [grrCgeePeccUuru1rer]ssd ii rvve6eec   uwtwrddisooimggv e etts rrw,iidg goggegee lrrteaerddpi  gs66g e etdtri iemtemdsie ,sc6 ,k e t leial1mpae2sps
es,de  edtl iatcpiks [ce1Ckd2P  
Ut12i]2c k
r e1c2u
[rCsPiUv0e]  wrdeo[c[gCuC PrtPUsr1Uii]v3g eg]r e ewrcrdeuoedrgc s 6uit vrrtesii gimwgevdesoer,ge   dewt lrd6aio pgtgsgiee mdrte esrtd,ii  c6gek lg tae1ip2rms
eeesdd,   te6il ca[ktpC isP1me2Ued
2 s]t ,ir ceekcl ua1r2ps
[isCvePedU  0w]td oirg[ce CcktPu rUri11sg]2ig 
verere ecwdud ro6sg i tvtierm iewgsdgo,eg[r  CeetPdlrU ia36g]p g sterieremedcedu s r,t6s  iietvcliekam  pews1sde,2od
 g e tltiarcpiksg eg1d[e2 rC
tePidcU k62  1]t[2i C
mrPeeUsc0,u] r es[rliCeavPcpUeus1r e]sdw i rdvteoeic gcuwk rd sto1irg2v i
etg rwgidgeogrge ertderd i g66g  ettriiemdme es6s,  ,tei lmeaelpsas,pe dse letaidpsce kdt  i1tc2ik
c k 1122

wdog_test end...

[xiaoxiang781216]

look like sim_uart driver forget to protect the concurrent access:
https://github.com/apache/nuttx/blob/master/arch/sim/src/sim/sim_uart.c
we need add protection like the real uart driver.

[hujun260]

another problem is assertion in ostest which happens randomly:

signest_test: With task locking
  Total signalled 2480  Odd=1240 Even=1240
  Total handled   2480  Odd=1240 Even=1240
  Total nested    0    Odd=0   Even=0  
[CPU1] dump_assert_info: Current Version: NuttX  10.4.0 6e12b3d74b Oct 12 2024 10:57:16 sim
[CPU1] dump_assert_info: Assertion failed : at file: signest.c:228 task(CPU1): ostest process: ostest 0x441c23
ostest_main: Exiting with status 256
stdio_test: Standard I/O Check: fprintf to stderr

if revert one commit (sim: fix context-switch when do wdog callback()) signest_test looks good
git revert a3568af

[jerpelea]

backported #13968