Correlations between LLM requests

[code-junkie-403]

Hi, we are using a custom HTTP handler to track all LLM requests in each plugin. I'd like to check if there's a correlation ID we can use to link them together? Eg SK triggers Plugin1 -> Plugin2 -> Plugin3, we'd like to correlate all the LLM requests made by these plugins.

Thanks

[dmytrostruk]

@code-junkie-403 If you are interested in .NET, you can use log scopes to attach correlation ID to each log that's created during the same operation:
https://learn.microsoft.com/en-us/aspnet/core/fundamentals/logging/?view=aspnetcore-8.0#log-scopes

semantic-kernel/dotnet/samples/Concepts/Filtering/TelemetryWithFilters.cs

Lines 68 to 79 in 6b01468

	using (logger.BeginScope($"Transaction ID: [{transactionId}]"))
	{
	// Invoke prompt with arguments.
	const string Prompt = "Given the current time of day and weather, what is the likely color of the sky in {{$city}}?";
	var result = await kernel.InvokePromptAsync(Prompt, new(executionSettings) { ["city"] = "Boston" });
	Console.WriteLine(result);
	}
	// Output:
	// Transaction ID: [2d9ca2ce-8bf7-4d43-9f90-05eda7122aa2] Function InvokePromptAsync_Id invoking.
	// Transaction ID: [2d9ca2ce-8bf7-4d43-9f90-05eda7122aa2] Function arguments: {"city":"Boston"}

If you need programmatic access to correlation ID, you can use traces and activities:

• https://learn.microsoft.com/en-us/dotnet/core/diagnostics/distributed-tracing-concepts
• https://learn.microsoft.com/en-us/dotnet/core/diagnostics/distributed-tracing-instrumentation-walkthroughs