Test Log Signals/In-Progress logs

[Gracie-Work]

Summary

We are leveraging MSTest libraries to execute integration tests and report the results in Substrate pre-checkin system. The pkg we are referenced:
• Microsoft.VisualStudio.TestPlatform.ObjectModel 17.2.0
• Microsoft.TestPlatform.TranslationLayer 17.2.0

Our system uses VsTestConsoleWrapper to run tests and use a handler instance which implemented ITestRunEventsHandler interface to get the signal back from the test execution. We get the test execution results via API
• HandleTestRunComplete
• HandleTestRunStatsChange

But we noticed that these APIs only trigger signals when the individual test case execution is finished.

Background and Motivation

In terms of end-to-end tests, the tests take longer time to complete. User needs a debugging experience for in-progress logs.

Questions we have:
• Is there a way to get TestStarted signal?
• Can we have individual log event signal during individual test execution?
• Is it possible to get the in-progress logs for vstest.console.exe?

Proposed Feature

Take below test method as an example:
[TestMethod]
public void TestLogging()
{
Console.WriteLine("The first log");
Console.WriteLine("The second log");
}
What we are expecting is that
• Signal 1: Test TestLogging Started
• Signal 2: Test TestLogging Log Entry – The first log
• Signal 3: Test TestLogging Log Entry – The second log
• Signal 4: Test TestLogging finished

[nohwnd]

Closing because this should be no longer relevant (for Substrate).