Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh #50761

Closed
VincentBu opened this issue Apr 6, 2021 · 11 comments
Closed

Test failure JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh #50761

VincentBu opened this issue Apr 6, 2021 · 11 comments
Assignees
@EgorBo
Labels
arch-arm64 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI GCStress JitStress CLR JIT issues involving JIT internal stress modes os-mac-os-x macOS aka OSX
Milestone
7.0.0

Comments

@VincentBu
Copy link
Contributor

Failed again in runtime-coreclr gcstress-extra 20210404.2

Failed test:

CoreCLR OSX arm64 Checked gcstress0xc_jitstress2 @ OSX.1100.ARM64.Open
 -JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh

Error message:

Return code: 1
Raw output file: /private/tmp/helix/working/AA710954/w/A4990986/e/JIT/Regression/Reports/JIT.Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/AA710954/p/corerun Runtime_40444.dll ''
1000000000: FAILED, t2_result = 1, t2_finished is 1
FAILED
Expected: 100
Actual: 255
END EXECUTION - FAILED
Test Harness Exitcode is : 1
To run the test:
> set CORE_ROOT=/tmp/helix/working/AA710954/p
> /private/tmp/helix/working/AA710954/w/A4990986/e/JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh
Expected: True
Actual: False

Stack trace
   at JIT_Regression._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_sh()
@dotnet-issue-labeler dotnet-issue-labeler bot added area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI untriaged New issue has not been triaged by the area owner labels Apr 6, 2021
@BruceForstall BruceForstall added the JitStress CLR JIT issues involving JIT internal stress modes label Apr 6, 2021
@BruceForstall BruceForstall added this to the 6.0.0 milestone Apr 6, 2021
@BruceForstall BruceForstall removed the untriaged New issue has not been triaged by the area owner label Apr 6, 2021
@JulieLeeMSFT
Copy link
Member

@VincentBu can we get the failure history of this test from Kusto query?

@VincentBu
Copy link
Contributor Author

@JulieLeeMSFT , Hi, I can't get the failure history of this test from Kusto query.

@kunalspathak
Copy link
Member

@VincentBu - I am curious how do you spot failures and decide for which ones to open an issue? The query only returns the test failures for scheduled runs and not for manually triggered or the ones that got triggered from PR. The runtime-coreclr gcstress-extra Checked-gcstress0xc_jitstress2 failed from manual trigger .

Since it was failing on main, we might see that the query would return result for this test failures in next week or so.

@BruceForstall - FYI.

@VincentBu
Copy link
Contributor Author

Failed again in runtime-coreclr gcstress-extra 20210717.1

Failed test:

CoreCLR OSX arm64 Checked gcstress0xc_zapdisable @ OSX.1100.ARM64.Open

- JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh
- readytorun/coreroot_determinism/coreroot_determinism/coreroot_determinism.sh
- Loader\\ContextualReflection\\ContextualReflection\\ContextualReflection.cmd

One of error messages:

Return code:      1
Raw output file:      /tmp/helix/working/A7520915/w/A5D608F9/uploads/Reports/JIT.Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/A7520915/p/corerun Runtime_40444.dll ''
1000000000: FAILED, t2_result = 1, t2_finished is 1
FAILED
Expected: 100
Actual: 255
END EXECUTION - FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=/tmp/helix/working/A7520915/p
/private/tmp/helix/working/A7520915/w/A5D608F9/e/JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh
Expected: True
Actual:   False


Stack trace
   at JIT_Regression._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_sh() in JIT.Regression.XUnitWrapper.dll:token 0x6000a40+0x295

@sandreenko
Copy link
Contributor

sandreenko commented Jul 30, 2021 •
edited
Loading

probably fixed by #56059, it looks like it was failing in 50% runs so I triggered 4 to confirm.

https://dev.azure.com/dnceng/public/_build?definitionId=662&_a=summary

@sandreenko
Copy link
Contributor

Have not seen it failing in the last run, so closing.
Note: I saw JIT.IL_Conformance test failure here, the original issue for it was #56237 but then it was merged into #51250. So that one is still failing.

@echesakov
Copy link
Contributor

I saw this test failing again couple days ago - console.log - #20210822.1:

export COMPlus_TieredCompilation=0
export COMPlus_GCStress=0xC
export COMPlus_ReadyToRun=0
export COMPlus_ZapDisable=1

    JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh [FAIL]
      
      Return code:      1
      Raw output file:      /tmp/helix/working/9F6708F3/w/9CC808FB/uploads/Reports/JIT.Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.output.txt
      Raw output:
      BEGIN EXECUTION
      /tmp/helix/working/9F6708F3/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Runtime_40444.dll ''
      1000000000: FAILED, t2_result = 1, t2_finished is 1
      FAILED
      Expected: 100
      Actual: 255
      END EXECUTION - FAILED
      Test Harness Exitcode is : 1
      To run the test:
      > set CORE_ROOT=/tmp/helix/working/9F6708F3/p
      > /private/tmp/helix/working/9F6708F3/w/9CC808FB/e/JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_Regression._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_sh()
      Output:
        
        Return code:      1
        Raw output file:      /tmp/helix/working/9F6708F3/w/9CC808FB/uploads/Reports/JIT.Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.output.txt
        Raw output:
        BEGIN EXECUTION
        /tmp/helix/working/9F6708F3/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Runtime_40444.dll ''
        1000000000: FAILED, t2_result = 1, t2_finished is 1
        FAILED
        Expected: 100
        Actual: 255
        END EXECUTION - FAILED
        Test Harness Exitcode is : 1
        To run the test:
        > set CORE_ROOT=/tmp/helix/working/9F6708F3/p
        > /private/tmp/helix/working/9F6708F3/w/9CC808FB/e/JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh

@sandreenko Should we re-open the issue?

@sandreenko sandreenko modified the milestones: 6.0.0, 7.0.0 Aug 25, 2021
@sandreenko sandreenko reopened this Aug 25, 2021
@sandreenko sandreenko removed their assignment Nov 13, 2021
@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr gcstress-extra 20220109.1

Failed test:

CoreCLR OSX arm64 Checked gcstress0xc_zapdisable_heapverify1 @ OSX.1100.ARM64.Open

- JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh

Error message:

Return code:      1
Raw output file:      /tmp/helix/working/A6FE08F3/w/A13A08D2/uploads/Reports/JIT.Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.output.txt
Raw output:
BEGIN EXECUTION
/tmp/helix/working/A6FE08F3/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Runtime_40444.dll ''
1000000000: FAILED, t2_result = 1, t2_finished is 1
FAILED
Expected: 100
Actual: 255
END EXECUTION - FAILED
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=/tmp/helix/working/A6FE08F3/p
/private/tmp/helix/working/A6FE08F3/w/A13A08D2/e/JIT/Regression/JitBlue/Runtime_40444/Runtime_40444/Runtime_40444.sh
Expected: True
Actual:   False


Stack trace
   at JIT_Regression._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_sh()

@VincentBu
Copy link
Contributor Author

Failed again in: runtime-coreclr outerloop 20220315.2

Failed test:

R2R-CG2 windows x86 Checked @ Windows.10.Amd64.Open

- JIT\\Regression\\JitBlue\\Runtime_40444\\Runtime_40444\\Runtime_40444.cmd

Error message:

Could Not Find C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\IL-CG2\composite-r2r.dll
Could Not Find C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\Runtime_40444.dll.rsp
Unhandled exception. System.BadImageFormatException: Could not load file or assembly 'System.Security.Cryptography.Primitives, Version=6.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'. File is corrupt. (0x8013110E)
File name: 'System.Security.Cryptography.Primitives, Version=6.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' ---> System.BadImageFormatException: File is corrupt. (0x8013110E)
at ILCompiler.CoreRTNameMangler.SanitizeNameWithHash(String literal)
at ILCompiler.CoreRTNameMangler.set_CompilationUnitPrefix(String value)
at ILCompiler.Program.RunSingleCompilation(Dictionary2 inFilePaths, InstructionSetSupport instructionSetSupport, String compositeRootPath, Dictionary2 unrootedInputFilePaths, HashSet`1 versionBubbleModulesHash, CompilerTypeSystemContext typeSystemContext)
at ILCompiler.Program.Run(String[] args)
at ILCompiler.Program.Main(String[] args)

Return code:      1
Raw output file:      C:\h\w\B407098D\w\A45308DC\uploads\Reports\JIT.Regression\JitBlue\Runtime_40444\Runtime_40444\Runtime_40444.output.txt
Raw output:
BEGIN EXECUTION
Runtime_40444.dll
1 file(s) copied.
Response file: C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\Runtime_40444.dll.rsp
C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\IL-CG2\Runtime_40444.dll
-o:C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\Runtime_40444.dll
--targetarch:x86
--verify-type-and-field-layout
--method-layout:random
-r:C:\h\w\B407098D\p\System..dll
-r:C:\h\w\B407098D\p\Microsoft..dll
-r:C:\h\w\B407098D\p\mscorlib.dll
-r:C:\h\w\B407098D\p\netstandard.dll
-O
" "dotnet" "C:\h\w\B407098D\p\crossgen2\crossgen2.dll" @"C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\Runtime_40444.dll.rsp"   -r:C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\IL-CG2*.dll"
Crossgen2 failed with exitcode - -532462766
Test Harness Exitcode is : 1
To run the test:

set CORE_ROOT=C:\h\w\B407098D\p
C:\h\w\B407098D\w\A45308DC\e\JIT\Regression\JitBlue\Runtime_40444\Runtime_40444\Runtime_40444.cmd
Expected: True
Actual:   False


Stack trace
   at JIT_Regression._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_._JitBlue_Runtime_40444_Runtime_40444_Runtime_40444_cmd()

@VincentBu VincentBu added the blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs label Mar 16, 2022
@BruceForstall BruceForstall removed the blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs label Mar 16, 2022
@BruceForstall
Copy link
Member

This new failure has a different failure mode, so I opened #66690 to track it.

@kunalspathak
Copy link
Member

I don't see this failure in gcstress-extra.

@ghost ghost locked as resolved and limited conversation to collaborators Sep 10, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@EgorBo EgorBo

Labels
arch-arm64 area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI GCStress JitStress CLR JIT issues involving JIT internal stress modes os-mac-os-x macOS aka OSX
Projects
None yet
Milestone
7.0.0
Development

No branches or pull requests
7 participants
@EgorBo @echesakov @BruceForstall @kunalspathak @sandreenko @VincentBu @JulieLeeMSFT