Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 8 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
943509 dotnet/roslyn Run Unit Tests Log
943517 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76998
943510 dotnet/roslyn Run Integration Tests Log
941461 dotnet/roslyn Run Integration Tests Log
941307 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#77059
2635492 dotnet-interactive Test / Blame Log
940054 dotnet/roslyn Run Integration Tests Log
2634639 dotnet-fsharp CmdLine@2 Log
2633709 dotnet-interactive Test / Blame Log
2631578 dotnet-interactive Test / Blame Log
931325 dotnet/roslyn Run Integration Tests Log
930761 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76932
928955 dotnet/roslyn Run Integration Tests Log
928927 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76918
928738 dotnet/roslyn Run Integration Tests Log
927094 dotnet/roslyn Run Integration Tests Log
2625793 dotnet-interactive Test / Blame Log
924837 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76852
2625489 dotnet-interactive Test / Blame Log
2625493 dotnet-interactive Test / Blame Log
923681 dotnet/roslyn Run Integration Tests Log
923659 dotnet/roslyn Run Integration Tests Log
921574 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75581
2620937 dotnet-interactive Test / Blame Log
2620694 dotnet-interactive Test / Blame Log
917698 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76752
2619106 dotnet-interactive Test / Blame Log
914993 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76725
914308 dotnet/roslyn Run Integration Tests Log
914177 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76692
913987 dotnet/roslyn Run Integration Tests Log
912714 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76695
2616802 dotnet-interactive Test / Blame Log
2616717 dotnet-interactive Test / Blame Log
2615694 dotnet-fsharp CmdLine@2 Log
Build Definition Test Pull Request
944095 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46619
944078 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46637
944013 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46616
943963 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46615
943916 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46583
943870 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46623
943761 dotnet/aspire Aspire.EndToEnd.Tests.IntegrationServicesTests.Aspire.EndToEnd.Tests.IntegrationServicesTests.VerifyComponentWorks(resourceName: postgres)
943606 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#60214
943652 dotnet/aspire Aspire.Hosting.Milvus.Tests.WorkItemExecution
943601 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46611
943578 dotnet/aspire Aspire.Hosting.Milvus.Tests.WorkItemExecution
943479 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46609
943356 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46575
943280 dotnet/aspire Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.VerifyKafkaResource
943187 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46558
943097 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45552
943122 dotnet/aspire Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.VerifyKafkaResource
943020 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46377
943012 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46584
943061 dotnet/aspire Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.VerifyKafkaResource dotnet/aspire#7438
942938 dotnet/aspire Aspire.EndToEnd.Tests.IntegrationServicesTests.Aspire.EndToEnd.Tests.IntegrationServicesTests.VerifyComponentWorks dotnet/aspire#7435
942931 dotnet/aspire Aspire.Hosting.Redis.Tests.WorkItemExecution dotnet/aspire#7409
942780 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#43073
942796 dotnet/aspire Aspire.EndToEnd.Tests.IntegrationServicesTests.Aspire.EndToEnd.Tests.IntegrationServicesTests.VerifyComponentWorks(resourceName: postgres) dotnet/aspire#7329
942749 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46397
942658 dotnet/aspire Aspire.Hosting.PostgreSQL.Tests.WorkItemExecution dotnet/aspire#6104
942399 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46583
942597 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46601
942390 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#46359
942230 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46592
942435 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46598
942099 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46425
942174 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46583
942298 dotnet/aspire Aspire.Hosting.Milvus.Tests.WorkItemExecution dotnet/aspire#7425
942215 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46589
942197 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46502
942279 dotnet/aspire Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.VerifyKafkaResource dotnet/aspire#7422
941920 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46359
941767 dotnet/aspire Aspire.Hosting.PostgreSQL.Tests.WorkItemExecution dotnet/aspire#7422
941639 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.11.WorkItemExecution dotnet/sdk#46573
941781 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46575
941770 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46568
941779 dotnet/aspire Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.Aspire.Hosting.Kafka.Tests.KafkaFunctionalTests.VerifyKafkaResource
941747 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46377
941733 dotnet/aspire Aspire.EndToEnd.Tests.IntegrationServicesTests.Aspire.EndToEnd.Tests.IntegrationServicesTests.VerifyComponentWorks dotnet/aspire#6969
941711 dotnet/aspire Aspire.Hosting.Redis.Tests.WorkItemExecution
941637 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46572
941698 dotnet/aspire Aspire.Hosting.Nats.Tests.WorkItemExecution
941311 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46290
2635838 dotnet-roslyn workitem_94.WorkItemExecution
941135 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46233
941301 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46559
941219 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46564
941194 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46560
941138 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution dotnet/sdk#44843
941029 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46551
940939 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46528
940959 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46361
940947 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46530
940852 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#46556
940851 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46555
940810 dotnet/aspnetcore Microsoft.AspNetCore.Components.Endpoints.Tests--net8.0.WorkItemExecution
940696 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46296
940688 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#46359
940768 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46518
940507 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46509
940687 dotnet/sdk Microsoft.NET.Publish.Tests.dll.3.WorkItemExecution dotnet/sdk#46379
940701 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46286
940683 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46550
940664 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46499
940570 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46361
2635360 dotnet-roslyn workitem_10.WorkItemExecution
939306 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46498
940517 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46501
2635305 dotnet-roslyn workitem_197.WorkItemExecution
940482 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46518
940416 dotnet/roslyn workitem_5.WorkItemExecution
940388 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46511
940248 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46532
2635148 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
940208 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46531
940172 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46528
940086 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46485
940118 dotnet/aspire Aspire.Hosting.Azure.Tests.WorkItemExecution dotnet/aspire#7136
939821 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45384
2634874 dotnet-roslyn workitem_89.WorkItemExecution
939728 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46361
939793 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46518
939725 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46518
939608 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46502
939598 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46511
939521 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46495
939312 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46499
939318 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46502
939279 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46497
939159 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46493
939154 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46371
939129 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46487
938978 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46425
938964 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#46489
Displaying 100 of 657 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
30 159 692

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

@nagilson
Copy link
Member

nagilson commented Dec 3, 2024

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants