beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-09-30 22:26:36,549 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-09-30 22:26:37,723 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
INFO 2026-09-30 22:26:40,298 serve 4237 -- Started Serve in namespace "serve".
(ProxyActor pid=5056) INFO 2026-09-30 22:26:40,228 proxy 172.17.0.2 -- Proxy starting on node 8f26cb0e08d3b80f9b9b397f5ef843104fb132a232b9e3d1b9c256e4 (HTTP port: 8000).
(ProxyActor pid=5056) INFO 2026-09-30 22:26:40,295 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=5047) INFO 2026-09-30 22:26:40,398 controller 5047 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5047) INFO 2026-09-30 22:26:40,399 controller 5047 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5056) INFO 2026-09-30 22:26:40,403 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5056) INFO 2026-09-30 22:26:40,410 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f0cf2ac19f0>.
(ServeController pid=5047) INFO 2026-09-30 22:26:40,504 controller 5047 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5056) INFO 2026-09-30 22:26:44,620 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[])}.
INFO 2026-09-30 22:26:45,423 serve 4237 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,663 mnist_classifier_MNISTClassifier xtrkghla 3473fa48-dec3-4cae-bfc1-cdd566ec87dd -- POST / 200 579.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,666 mnist_classifier_MNISTClassifier xtrkghla 97551488-7a05-4949-835f-4774a073e075 -- POST / 200 557.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,669 mnist_classifier_MNISTClassifier xtrkghla 92a31758-678d-4377-8066-ae2ff2728880 -- POST / 200 560.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,670 mnist_classifier_MNISTClassifier xtrkghla 814cc053-e650-4ace-87f9-1039877de5c7 -- POST / 200 560.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,670 mnist_classifier_MNISTClassifier xtrkghla 0ce76f91-17e6-4858-99f7-6814b4ee77ef -- POST / 200 559.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,670 mnist_classifier_MNISTClassifier xtrkghla abeeece7-5e21-4440-a77b-2098d919783b -- POST / 200 558.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,671 mnist_classifier_MNISTClassifier xtrkghla 6a707da7-4197-46d3-8b49-0f16f1068ec2 -- POST / 200 556.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,671 mnist_classifier_MNISTClassifier xtrkghla 51cf91bc-9bb9-47cd-85e5-a79bfab0e580 -- POST / 200 556.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,671 mnist_classifier_MNISTClassifier xtrkghla 693ab11d-e0ef-4611-b317-28d49de6ef5d -- POST / 200 555.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,673 mnist_classifier_MNISTClassifier xtrkghla 32e46b37-a953-435d-ac6e-4776c7a1971c -- POST / 200 555.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,673 mnist_classifier_MNISTClassifier xtrkghla 95f2f234-6665-434b-8f97-60202bd3e395 -- POST / 200 556.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,673 mnist_classifier_MNISTClassifier xtrkghla 110dd736-f6b6-4140-93b8-4347bbdcf173 -- POST / 200 554.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,674 mnist_classifier_MNISTClassifier xtrkghla cb40b021-8aed-4cd9-87e1-072377a4e920 -- POST / 200 554.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,675 mnist_classifier_MNISTClassifier xtrkghla fa90b003-00db-422a-9b87-3ac550a7b7ef -- POST / 200 553.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,675 mnist_classifier_MNISTClassifier xtrkghla c356f858-e08b-465c-9f85-f5f1805809ca -- POST / 200 552.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,675 mnist_classifier_MNISTClassifier xtrkghla e214022e-f66d-41d4-ac0b-44eb821ab18e -- POST / 200 550.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,676 mnist_classifier_MNISTClassifier xtrkghla 3160f748-abbd-495c-accf-0129bcb7d30e -- POST / 200 548.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,676 mnist_classifier_MNISTClassifier xtrkghla 7d9853f2-6db8-4b14-9cc9-d08f9489fc0d -- POST / 200 548.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,676 mnist_classifier_MNISTClassifier xtrkghla 9e7361b4-befa-442d-9bfb-0b4b3467691c -- POST / 200 544.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,679 mnist_classifier_MNISTClassifier xtrkghla 91daaa7f-0a72-432d-88b7-41a9b943eb96 -- POST / 200 546.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,680 mnist_classifier_MNISTClassifier xtrkghla 13c76150-c1e9-4251-8e98-054c8450b8a0 -- POST / 200 544.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,681 mnist_classifier_MNISTClassifier xtrkghla 2fa7cf2d-34d5-494f-89ea-818d352a44c2 -- POST / 200 543.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,682 mnist_classifier_MNISTClassifier xtrkghla c4f1e6ad-9b5a-447b-ac8c-da4d98de9351 -- POST / 200 544.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,683 mnist_classifier_MNISTClassifier xtrkghla a9c32751-5e73-461c-b339-6f23d4a33722 -- POST / 200 545.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,684 mnist_classifier_MNISTClassifier xtrkghla abd5fd79-8f8a-4ac0-ac11-304b657ebc99 -- POST / 200 543.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,684 mnist_classifier_MNISTClassifier xtrkghla 87c8db66-938e-4a20-af12-06fc7e23a55c -- POST / 200 541.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,684 mnist_classifier_MNISTClassifier xtrkghla 34a11990-a12b-4202-83bb-17e7819106a9 -- POST / 200 541.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,686 mnist_classifier_MNISTClassifier xtrkghla f7f1285f-7019-4584-92f4-2cb1c2d2d679 -- POST / 200 540.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,791 mnist_classifier_MNISTClassifier xtrkghla b5836d0f-7ca3-4ba2-b96d-dafb09a9db7a -- POST / 200 645.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,795 mnist_classifier_MNISTClassifier xtrkghla b98ebeab-23d2-4b8e-a301-e42daad4cac3 -- POST / 200 645.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,798 mnist_classifier_MNISTClassifier xtrkghla 0e59645d-2ed2-4756-9a1d-8460b2b168d8 -- POST / 200 647.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,799 mnist_classifier_MNISTClassifier xtrkghla 63455e2d-89c9-42c1-aa31-2c7a50283753 -- POST / 200 647.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,799 mnist_classifier_MNISTClassifier xtrkghla 43fe91c9-afd0-44d7-bfd9-1f5f60703798 -- POST / 200 647.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,800 mnist_classifier_MNISTClassifier xtrkghla 8f42b37b-c0ed-4f0d-98bd-5395d0edc883 -- POST / 200 647.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,801 mnist_classifier_MNISTClassifier xtrkghla ef24d6ed-8d89-4e1c-85f3-b7eb08557267 -- POST / 200 649.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,802 mnist_classifier_MNISTClassifier xtrkghla f227ac80-c967-42af-84be-d77a18d9b9ba -- POST / 200 648.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,803 mnist_classifier_MNISTClassifier xtrkghla 1e9bc785-d29c-488d-960e-2be32ce0b372 -- POST / 200 648.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,804 mnist_classifier_MNISTClassifier xtrkghla 0a13eb36-e0f3-4572-8f5c-eada209ff2ee -- POST / 200 649.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,860 mnist_classifier_MNISTClassifier xtrkghla c51ca6cf-f3e3-4db3-add8-4c93e1198e79 -- POST / 200 703.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,860 mnist_classifier_MNISTClassifier xtrkghla e9b17913-8a1e-4fa9-b64b-737ff163e178 -- POST / 200 703.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,866 mnist_classifier_MNISTClassifier xtrkghla 102cb9da-0774-401b-ae38-314af3cc013a -- POST / 200 708.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,869 mnist_classifier_MNISTClassifier xtrkghla 7d10e8d8-220f-4198-be1a-402584d2091e -- POST / 200 711.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,870 mnist_classifier_MNISTClassifier xtrkghla 1d68fdd1-8015-4066-b311-a08c320fe56b -- POST / 200 710.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,870 mnist_classifier_MNISTClassifier xtrkghla 26cfada6-324d-4b54-9df6-58e7daeadcc5 -- POST / 200 705.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,871 mnist_classifier_MNISTClassifier xtrkghla 5c1abc7a-8e05-4bf1-8468-22953d38333a -- POST / 200 708.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,871 mnist_classifier_MNISTClassifier xtrkghla 87ac2240-bc4d-4037-8709-f760b266a3d5 -- POST / 200 703.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,872 mnist_classifier_MNISTClassifier xtrkghla 69d9c82f-efaf-453d-a1bf-48105cf08ee8 -- POST / 200 703.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,873 mnist_classifier_MNISTClassifier xtrkghla 7e6a2fac-6ed0-483a-b58a-50a9cd4b48a0 -- POST / 200 703.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,874 mnist_classifier_MNISTClassifier xtrkghla e73648c3-5425-4243-99a2-4db5f78eabe4 -- POST / 200 703.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,874 mnist_classifier_MNISTClassifier xtrkghla 8ac97e89-4598-49c6-8a41-d58ef70afc42 -- POST / 200 703.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,874 mnist_classifier_MNISTClassifier xtrkghla 69568356-89a2-4e16-94b2-5dc70fb13477 -- POST / 200 702.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,930 mnist_classifier_MNISTClassifier xtrkghla 90b3f87b-dc9d-4bf1-b419-5a0cea2f5d86 -- POST / 200 754.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,932 mnist_classifier_MNISTClassifier xtrkghla d2ac895a-c1bd-4af1-ba4a-6cc24facf3fe -- POST / 200 753.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,934 mnist_classifier_MNISTClassifier xtrkghla 857a9305-87b0-4d6e-a993-e4eef9db2a91 -- POST / 200 754.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,935 mnist_classifier_MNISTClassifier xtrkghla 178a9f1a-3b03-4ac8-9b53-4959b44da01f -- POST / 200 751.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,937 mnist_classifier_MNISTClassifier xtrkghla 561e8e86-3a61-4f1b-9cd4-331cbd6ccda6 -- POST / 200 756.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,937 mnist_classifier_MNISTClassifier xtrkghla 7f740cf4-eddf-4d77-838f-42142b03d219 -- POST / 200 751.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,938 mnist_classifier_MNISTClassifier xtrkghla ca6f1fa7-4f75-428f-8f30-8eb1fcdecd64 -- POST / 200 757.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,939 mnist_classifier_MNISTClassifier xtrkghla f34346c8-1a62-4d36-9c30-13eee37edf18 -- POST / 200 755.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,941 mnist_classifier_MNISTClassifier xtrkghla 1dbb5c7e-f584-49ff-8669-8e565b19cdc5 -- POST / 200 754.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,941 mnist_classifier_MNISTClassifier xtrkghla f49722f2-17cb-4fdb-ba50-df09e31d0ffd -- POST / 200 754.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,941 mnist_classifier_MNISTClassifier xtrkghla ab044e11-15be-487f-9a5c-18d83cc9b4fc -- POST / 200 753.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,942 mnist_classifier_MNISTClassifier xtrkghla dbf6b8e4-7b41-4dbc-8c42-7ad2ba78ed85 -- POST / 200 750.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,945 mnist_classifier_MNISTClassifier xtrkghla 2f274c4e-2f50-499a-bf46-7f7b6a3c1212 -- POST / 200 753.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,947 mnist_classifier_MNISTClassifier xtrkghla 69dd3134-ced0-4ca9-8548-92d42b451c03 -- POST / 200 752.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,947 mnist_classifier_MNISTClassifier xtrkghla 25d7968f-1c99-44a2-b785-30148cf797ca -- POST / 200 752.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,948 mnist_classifier_MNISTClassifier xtrkghla 63dabc20-ab13-4506-b560-6ea37745d2b0 -- POST / 200 753.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,952 mnist_classifier_MNISTClassifier xtrkghla 30df7750-4133-4275-adc9-7352eb7a2f64 -- POST / 200 756.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,953 mnist_classifier_MNISTClassifier xtrkghla d4836488-f481-40ee-900a-090fd31ec4ee -- POST / 200 757.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,954 mnist_classifier_MNISTClassifier xtrkghla 33cc7558-6b08-43fd-8aae-03742f040a21 -- POST / 200 757.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,954 mnist_classifier_MNISTClassifier xtrkghla dfcdc541-e669-43b6-910c-8ae22ae86a7a -- POST / 200 755.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,956 mnist_classifier_MNISTClassifier xtrkghla e0f35696-89ee-4477-ae8c-3613793e654c -- POST / 200 758.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,957 mnist_classifier_MNISTClassifier xtrkghla 605e3556-3acf-470c-8b57-a93307fa69d7 -- POST / 200 752.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,957 mnist_classifier_MNISTClassifier xtrkghla f3d914ab-a5cb-4d35-acfb-704c26351e41 -- POST / 200 757.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,957 mnist_classifier_MNISTClassifier xtrkghla a8bf4b4c-50c1-4f71-9005-e729b6162bb9 -- POST / 200 752.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,957 mnist_classifier_MNISTClassifier xtrkghla f47c03a1-fc51-4cb7-9940-915a40c751d7 -- POST / 200 758.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,959 mnist_classifier_MNISTClassifier xtrkghla e5893268-3b29-4620-bd97-25930d21f38c -- POST / 200 758.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,960 mnist_classifier_MNISTClassifier xtrkghla cc977ff4-90a9-4297-8851-67d048cc84e2 -- POST / 200 756.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,960 mnist_classifier_MNISTClassifier xtrkghla c88e459c-9cf9-499d-9b33-a14a1c7a40a7 -- POST / 200 755.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,961 mnist_classifier_MNISTClassifier xtrkghla 76747d20-a800-459f-b427-7a10cde942de -- POST / 200 754.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,961 mnist_classifier_MNISTClassifier xtrkghla 42e9b83e-de46-43e8-ace4-3125b62a9563 -- POST / 200 748.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,962 mnist_classifier_MNISTClassifier xtrkghla bde4d0f3-e975-4fdb-acaa-d4efba89403a -- POST / 200 752.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,962 mnist_classifier_MNISTClassifier xtrkghla 711daae2-c0a4-43ee-bf98-ebd0d56301b0 -- POST / 200 749.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,963 mnist_classifier_MNISTClassifier xtrkghla 3cbdc562-99bc-4d85-b91b-5077a57a3897 -- POST / 200 750.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,963 mnist_classifier_MNISTClassifier xtrkghla 21c94097-710e-4dd7-82a1-2a59301d9be1 -- POST / 200 748.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,964 mnist_classifier_MNISTClassifier xtrkghla 2e7f0898-0608-44ce-a451-6dcf4659834f -- POST / 200 748.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,964 mnist_classifier_MNISTClassifier xtrkghla 00cf7c02-5008-4bc2-82b3-5b1c2028c1a1 -- POST / 200 747.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,965 mnist_classifier_MNISTClassifier xtrkghla 8eac7e1a-7265-4183-af50-7f085e1ebe20 -- POST / 200 749.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,965 mnist_classifier_MNISTClassifier xtrkghla d3db6106-500d-4ee7-8d91-bf0dfbd98105 -- POST / 200 746.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,965 mnist_classifier_MNISTClassifier xtrkghla 2eff4f8a-f052-41f7-a561-c41295a4fb10 -- POST / 200 742.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,966 mnist_classifier_MNISTClassifier xtrkghla 15dd91d8-a303-4cf1-8e7f-4077df237f47 -- POST / 200 749.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,966 mnist_classifier_MNISTClassifier xtrkghla 7087cf29-96f6-4931-af44-5dd8cfbed0a8 -- POST / 200 745.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,966 mnist_classifier_MNISTClassifier xtrkghla e3c6514a-1aec-4aa1-8e94-ddbde99384f7 -- POST / 200 743.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,967 mnist_classifier_MNISTClassifier xtrkghla f3d17476-df43-4c03-9b86-6cc94f0b439d -- POST / 200 745.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,967 mnist_classifier_MNISTClassifier xtrkghla 5b191317-b1f0-49bf-a1bb-0a15686894db -- POST / 200 744.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,967 mnist_classifier_MNISTClassifier xtrkghla ad01738e-5804-4689-af94-edeb9d87854d -- POST / 200 744.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,968 mnist_classifier_MNISTClassifier xtrkghla 0ffc6f5c-93b1-45d8-9992-73a8380c1e96 -- POST / 200 743.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,968 mnist_classifier_MNISTClassifier xtrkghla a7589a29-49cf-4d39-9db1-11dd316badc0 -- POST / 200 741.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,969 mnist_classifier_MNISTClassifier xtrkghla de9e1b32-cd61-4c88-820a-34a448ebbbda -- POST / 200 739.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,969 mnist_classifier_MNISTClassifier xtrkghla 25756b5b-9530-4569-b2c9-2f4dccac8533 -- POST / 200 738.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,970 mnist_classifier_MNISTClassifier xtrkghla 28bbfece-6e32-4f14-a3da-74a02f4d5806 -- POST / 200 459.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,970 mnist_classifier_MNISTClassifier xtrkghla a46a6480-001b-4c30-ba75-8ec1631187ec -- POST / 200 458.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,970 mnist_classifier_MNISTClassifier xtrkghla ef1bfbe0-aee1-4ed0-a98b-c268e2564248 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,970 mnist_classifier_MNISTClassifier xtrkghla d4e8577f-06c3-4d23-9310-b5c59774031e -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,971 mnist_classifier_MNISTClassifier xtrkghla c7794cb8-aae3-4a53-8973-568d4f76a041 -- POST / 200 279.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,972 mnist_classifier_MNISTClassifier xtrkghla 1ee8b00c-6eb8-4667-bbb4-214a4bc2e331 -- POST / 200 280.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,972 mnist_classifier_MNISTClassifier xtrkghla 51c555df-2d1f-43d9-9a05-e519db16cdd7 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,973 mnist_classifier_MNISTClassifier xtrkghla c352c128-195c-4f02-b972-25ad213853e7 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,973 mnist_classifier_MNISTClassifier xtrkghla 8f1851e3-dd0f-4a15-829b-9a21dbbfd234 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,974 mnist_classifier_MNISTClassifier xtrkghla 3a53c095-9d24-454e-9f7c-1da33353a1ed -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,974 mnist_classifier_MNISTClassifier xtrkghla 9d9de376-9405-49c5-8793-7b5c3fa66c10 -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,975 mnist_classifier_MNISTClassifier xtrkghla 9e671127-38ec-4a87-a1da-74b2a63aca04 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,976 mnist_classifier_MNISTClassifier xtrkghla 0af946f5-7a5c-4a8d-a16c-845ed8fcd935 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,976 mnist_classifier_MNISTClassifier xtrkghla 7cf0ce8a-b722-4ec8-8fd5-a4ff12322816 -- POST / 200 271.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,976 mnist_classifier_MNISTClassifier xtrkghla 64af2871-2259-41fc-a33f-a0e33f3d6180 -- POST / 200 270.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,977 mnist_classifier_MNISTClassifier xtrkghla a14b5a68-afee-4087-89e7-682b65830a93 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,977 mnist_classifier_MNISTClassifier xtrkghla cf309062-9c96-40d5-9817-fe0759b1651d -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,978 mnist_classifier_MNISTClassifier xtrkghla 5fc4d0b3-b7db-465b-a791-8dbb256c5416 -- POST / 200 270.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,978 mnist_classifier_MNISTClassifier xtrkghla 18db27bb-a1a5-44dc-b93f-a6da54d57473 -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,979 mnist_classifier_MNISTClassifier xtrkghla f0c149a4-d0de-40bc-9e74-37f3f7cb5123 -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,979 mnist_classifier_MNISTClassifier xtrkghla 334af69d-05f8-4889-8803-c49ea8115356 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,979 mnist_classifier_MNISTClassifier xtrkghla 6127bcaf-35d6-45ff-88b5-3d349a85953b -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,980 mnist_classifier_MNISTClassifier xtrkghla c1b09da2-7b73-45b9-b3a8-f9a63c7c37f8 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,980 mnist_classifier_MNISTClassifier xtrkghla caf93616-87a0-473f-b54a-23e21b2a1d0b -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,981 mnist_classifier_MNISTClassifier xtrkghla d57cd918-843f-479c-bed9-326b30d634e3 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,982 mnist_classifier_MNISTClassifier xtrkghla 358cbf8f-f2ad-4eaa-9a17-4fc449b05e29 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,982 mnist_classifier_MNISTClassifier xtrkghla cd97e50c-519b-4ee4-b48d-d6b5c140ef59 -- POST / 200 267.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,982 mnist_classifier_MNISTClassifier xtrkghla 3f1db872-bcd5-4934-8010-3f6c97cb4505 -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,983 mnist_classifier_MNISTClassifier xtrkghla b78dd865-a2ff-48d9-9022-e7dff332b39a -- POST / 200 203.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,983 mnist_classifier_MNISTClassifier xtrkghla e29425e1-c8a2-41fc-a5eb-67545c66bcf4 -- POST / 200 172.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,986 mnist_classifier_MNISTClassifier xtrkghla ef47b567-61f1-478e-a808-4e11e4d2ffbf -- POST / 200 155.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,986 mnist_classifier_MNISTClassifier xtrkghla 553dce34-0f21-48e4-b877-9b8542847e0b -- POST / 200 155.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,987 mnist_classifier_MNISTClassifier xtrkghla a2e2e4fa-9780-4fff-9200-c0f194aba55a -- POST / 200 155.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,987 mnist_classifier_MNISTClassifier xtrkghla 96f3270f-b88d-4c2c-b6b5-301d1b357b73 -- POST / 200 155.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,991 mnist_classifier_MNISTClassifier xtrkghla 0a606df2-cc4b-4a75-be48-dc9f6031a972 -- POST / 200 158.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,994 mnist_classifier_MNISTClassifier xtrkghla 1de9b6ee-2a7e-41ac-8e20-19906c12e639 -- POST / 200 160.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,995 mnist_classifier_MNISTClassifier xtrkghla eb744ed9-e5da-4149-a34e-aa72c2b10374 -- POST / 200 161.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,996 mnist_classifier_MNISTClassifier xtrkghla 3a45fd37-0ba7-4cc7-b4f8-336f7c11d9c1 -- POST / 200 161.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,996 mnist_classifier_MNISTClassifier xtrkghla 1f9f3921-5591-4f79-8c4d-c13814cb22ba -- POST / 200 145.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:46,997 mnist_classifier_MNISTClassifier xtrkghla ff5715fd-b6d0-4a6a-9af1-9490c1739603 -- POST / 200 143.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,043 mnist_classifier_MNISTClassifier xtrkghla 4b4c435d-4a48-4590-b763-ffdff52102ad -- POST / 200 154.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,089 mnist_classifier_MNISTClassifier xtrkghla 664897c2-a5e3-4fea-b3b4-8033d48dcd19 -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,089 mnist_classifier_MNISTClassifier xtrkghla b4671761-220b-44e7-8596-0b10e1c2c114 -- POST / 200 200.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,089 mnist_classifier_MNISTClassifier xtrkghla c632eb1c-75e1-4a0a-98ec-bcb16985d22b -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla 1edaa8fb-5075-4c90-a179-ab9475730002 -- POST / 200 197.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla 5ebf23a1-0128-4fbb-97cf-bf97dd1f0d10 -- POST / 200 196.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla 62d7afeb-068a-492b-ace2-f329d4ff4077 -- POST / 200 195.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla f0d7e72e-5165-4578-9757-241d0562d4d9 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla d8fd8a51-2202-444d-b942-c711f5f940d5 -- POST / 200 194.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla 88b6e79a-a0a8-4319-9aef-51360c05d7d4 -- POST / 200 194.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,090 mnist_classifier_MNISTClassifier xtrkghla 8e2aba30-6312-442d-85c1-4894f8eca366 -- POST / 200 193.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,185 mnist_classifier_MNISTClassifier xtrkghla 1982e74c-f5a3-4bc5-a054-4023581a37b5 -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,190 mnist_classifier_MNISTClassifier xtrkghla 95759a71-8db8-46b2-bc29-91424bed0ac7 -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,191 mnist_classifier_MNISTClassifier xtrkghla b9e01352-caa3-4eb2-adc7-ab0cc7550e5d -- POST / 200 190.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,192 mnist_classifier_MNISTClassifier xtrkghla 25bf7095-f0be-4f77-b076-29c429895c87 -- POST / 200 188.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,192 mnist_classifier_MNISTClassifier xtrkghla 8f298804-89b5-4ae6-a5ac-f3b73dcf10d8 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,192 mnist_classifier_MNISTClassifier xtrkghla 32ab34dc-d738-4fd6-8fd4-fd0d4553705b -- POST / 200 186.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,192 mnist_classifier_MNISTClassifier xtrkghla f4957ffb-5bd6-48cf-8fb0-1205472e38bd -- POST / 200 179.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,192 mnist_classifier_MNISTClassifier xtrkghla be5d0979-5d61-4b64-b7e7-15236d877639 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,193 mnist_classifier_MNISTClassifier xtrkghla b89a4b9d-5c7e-4b6c-8d31-077faddf1a01 -- POST / 200 183.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,193 mnist_classifier_MNISTClassifier xtrkghla d73a530f-813c-478c-a314-41aa031cadd5 -- POST / 200 182.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,193 mnist_classifier_MNISTClassifier xtrkghla d678fe3e-5dbe-4809-b9a1-3c3ac1ec5c1f -- POST / 200 181.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,193 mnist_classifier_MNISTClassifier xtrkghla b5c1525d-dfc9-4d02-861e-4d44ebb7c7b4 -- POST / 200 178.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,193 mnist_classifier_MNISTClassifier xtrkghla f188e693-5af2-4ae6-a960-cd66ea1bd440 -- POST / 200 176.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,193 mnist_classifier_MNISTClassifier xtrkghla d7c320b6-a58b-4261-a93b-df6ab409c1ba -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,342 mnist_classifier_MNISTClassifier xtrkghla 785faf05-c4be-4800-be2f-ae9f533f22b8 -- POST / 200 324.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,343 mnist_classifier_MNISTClassifier xtrkghla 0fdad461-8cb7-43dc-b80c-26a8ca5206d2 -- POST / 200 324.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,344 mnist_classifier_MNISTClassifier xtrkghla c9276c33-c13f-4c0d-a8c7-1bc4baecd83f -- POST / 200 324.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,344 mnist_classifier_MNISTClassifier xtrkghla c05d79d6-8f20-4458-85a2-d93e51407824 -- POST / 200 324.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,345 mnist_classifier_MNISTClassifier xtrkghla 7eb93a58-8bfe-46d2-88b6-1f221eaaa400 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,346 mnist_classifier_MNISTClassifier xtrkghla ef03f24f-f2d7-4430-93a5-98812b6caa3d -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,347 mnist_classifier_MNISTClassifier xtrkghla e44ca7bb-9b90-4179-93b3-38dcdd31fb81 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,347 mnist_classifier_MNISTClassifier xtrkghla 87c8ecf7-a3fe-4452-bbac-ffb981b4603b -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,348 mnist_classifier_MNISTClassifier xtrkghla 36735e1c-2b4b-4ec8-8fce-c08ac1798f0d -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,348 mnist_classifier_MNISTClassifier xtrkghla 311384ec-e963-4015-a026-35a8a322bb13 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,348 mnist_classifier_MNISTClassifier xtrkghla bee38936-dcac-4c8b-9271-8601077a6792 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,349 mnist_classifier_MNISTClassifier xtrkghla 668b8b58-19eb-4750-ab07-d83ce5e77af8 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,349 mnist_classifier_MNISTClassifier xtrkghla f04583ce-6062-454d-a2b4-e6bc5ba3fd02 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,349 mnist_classifier_MNISTClassifier xtrkghla df08d59a-7df6-462d-9e10-49f52fe337d0 -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,349 mnist_classifier_MNISTClassifier xtrkghla c14e5bd2-8152-4fcc-ae23-19ee0405df9d -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,350 mnist_classifier_MNISTClassifier xtrkghla 527c99b3-d71d-49cf-b14e-2807de25d858 -- POST / 200 253.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,350 mnist_classifier_MNISTClassifier xtrkghla 90040215-a851-44c6-a5e3-0af3a67b1aa5 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,350 mnist_classifier_MNISTClassifier xtrkghla 0f6a0750-bb8b-4394-91c8-de2158b3dda8 -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,351 mnist_classifier_MNISTClassifier xtrkghla ad3d0450-57ce-450f-a833-b00eb515f461 -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,351 mnist_classifier_MNISTClassifier xtrkghla bcbee87a-3bfe-4b55-a1a5-e5ddc581eff1 -- POST / 200 254.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,352 mnist_classifier_MNISTClassifier xtrkghla 3a2f0310-1ec4-4f0d-a6f3-b097b4b2b836 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,353 mnist_classifier_MNISTClassifier xtrkghla 74635bed-9db8-44a1-bf46-5f2217a12f7d -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,353 mnist_classifier_MNISTClassifier xtrkghla 53bdcaa3-5397-4246-8a58-cd1ce3fe6326 -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,354 mnist_classifier_MNISTClassifier xtrkghla badef0bc-d042-4a81-929c-9b837825371f -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,355 mnist_classifier_MNISTClassifier xtrkghla b0dd45e5-6420-4b73-81ea-e7006c32a440 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,355 mnist_classifier_MNISTClassifier xtrkghla 3e00d9b9-aa1e-4d41-ad50-2dca7944566c -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,356 mnist_classifier_MNISTClassifier xtrkghla 464a14a1-91e0-4a09-b734-74e5b4857265 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,356 mnist_classifier_MNISTClassifier xtrkghla 3e77c738-5ecd-4178-84ed-2e4d35bc29a5 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,356 mnist_classifier_MNISTClassifier xtrkghla efdee531-e5b1-40d7-af00-8d680ffdab4b -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,357 mnist_classifier_MNISTClassifier xtrkghla 5066612d-1101-4a84-92af-1dad98093914 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,357 mnist_classifier_MNISTClassifier xtrkghla f4ce0063-aa6b-41e9-a6a7-57f617b917dd -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,358 mnist_classifier_MNISTClassifier xtrkghla 823f0ab4-3fbd-498c-9cd9-abd42b9ed3dc -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,359 mnist_classifier_MNISTClassifier xtrkghla c813cc59-e10c-4be8-a510-fb38607b555a -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,359 mnist_classifier_MNISTClassifier xtrkghla e3f67563-3a37-440d-bfef-7e322970b86f -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,359 mnist_classifier_MNISTClassifier xtrkghla de05d5d8-49e2-4f51-8ded-15283751075f -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,360 mnist_classifier_MNISTClassifier xtrkghla 3218cadd-8cc0-453b-b342-7c79afb8d72b -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,360 mnist_classifier_MNISTClassifier xtrkghla fa717aa4-af15-49e4-b0c7-2478720840b1 -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,361 mnist_classifier_MNISTClassifier xtrkghla 4f0b6063-4261-44dc-a1cc-5a77154e4794 -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,361 mnist_classifier_MNISTClassifier xtrkghla 4439a54a-0dbe-4862-919a-867de85aa150 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,362 mnist_classifier_MNISTClassifier xtrkghla 94a6f2d0-fd3a-431d-9fc0-f3ed604094b2 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,364 mnist_classifier_MNISTClassifier xtrkghla fefa9661-3c96-46fb-9059-f156d4fe6088 -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,366 mnist_classifier_MNISTClassifier xtrkghla 64b1808a-25fc-44eb-8c4a-2b4e8e7de487 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,367 mnist_classifier_MNISTClassifier xtrkghla 15377d14-193b-42d9-91cb-54d66813c3a5 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,369 mnist_classifier_MNISTClassifier xtrkghla ffe5b1fa-4915-4d19-b05b-4101d8258490 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,369 mnist_classifier_MNISTClassifier xtrkghla ce7620b2-1dca-417e-bcf9-c92a58f525ab -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,371 mnist_classifier_MNISTClassifier xtrkghla d4b0c8aa-b784-4b04-9365-bd63953c5770 -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,371 mnist_classifier_MNISTClassifier xtrkghla aa5066d9-70a8-4af4-83ba-84c72d8d04eb -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,371 mnist_classifier_MNISTClassifier xtrkghla 489684dc-0e18-4008-99fe-a9f2d3341bdb -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,372 mnist_classifier_MNISTClassifier xtrkghla 68edaeeb-61dd-4183-b56b-07cacffd306b -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,372 mnist_classifier_MNISTClassifier xtrkghla 1173ff52-fdd9-4b24-bdbd-2a8692240204 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,373 mnist_classifier_MNISTClassifier xtrkghla 93d00b09-9cbf-49b6-97da-611aae699ca3 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,373 mnist_classifier_MNISTClassifier xtrkghla 61075e6e-1824-4b36-8d93-61c4ef3e7e17 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,373 mnist_classifier_MNISTClassifier xtrkghla 679132f1-d97a-46a1-b940-3ae47ae0f1af -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,373 mnist_classifier_MNISTClassifier xtrkghla 61dc27ea-ebdb-4b09-aa84-0bcb87c8ba91 -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,373 mnist_classifier_MNISTClassifier xtrkghla 8c8ff29a-b434-48fd-8d62-528223e363e7 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,376 mnist_classifier_MNISTClassifier xtrkghla b17fe07b-92d7-4aa7-b66a-cb21853f5359 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,451 mnist_classifier_MNISTClassifier xtrkghla 5efcb714-0ee5-487d-a7ca-1a5105633bfa -- POST / 200 331.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,465 mnist_classifier_MNISTClassifier xtrkghla 69f29323-95d9-474d-9e7d-2f6e460895a8 -- POST / 200 345.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,467 mnist_classifier_MNISTClassifier xtrkghla 80191c42-d5f1-4874-8cd2-3e79944232be -- POST / 200 345.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,467 mnist_classifier_MNISTClassifier xtrkghla a628f3bf-13d8-413a-b31c-ed2f00b5a224 -- POST / 200 345.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,467 mnist_classifier_MNISTClassifier xtrkghla 2027e3a7-bd23-42ed-a92f-0b6d74c8f810 -- POST / 200 343.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,467 mnist_classifier_MNISTClassifier xtrkghla 980141d7-39d4-42f2-b60b-0e94a85baae9 -- POST / 200 342.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,467 mnist_classifier_MNISTClassifier xtrkghla 90fc38b1-b421-49e1-8281-72a5c986d5a9 -- POST / 200 342.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,468 mnist_classifier_MNISTClassifier xtrkghla 59fde1c9-9132-4a29-8d2e-ecb9663533c0 -- POST / 200 339.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,468 mnist_classifier_MNISTClassifier xtrkghla 989de50d-0ae7-4e78-8e03-1f4b5f754c05 -- POST / 200 338.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,468 mnist_classifier_MNISTClassifier xtrkghla 42c55925-39b6-4c1a-88db-fe94b66ae793 -- POST / 200 337.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,468 mnist_classifier_MNISTClassifier xtrkghla 2bcff08a-ceb0-4fa8-bb53-7eab82cf6e02 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,468 mnist_classifier_MNISTClassifier xtrkghla 663698c3-4810-4270-b00b-6c65f0b4fd85 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,468 mnist_classifier_MNISTClassifier xtrkghla e4994e49-9eeb-467b-a157-9b53efba3d62 -- POST / 200 336.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,469 mnist_classifier_MNISTClassifier xtrkghla dbfa3fe5-682a-4485-846c-167523227cab -- POST / 200 326.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,469 mnist_classifier_MNISTClassifier xtrkghla 4e35c511-7539-4162-a581-b689341df251 -- POST / 200 326.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,469 mnist_classifier_MNISTClassifier xtrkghla 4e7feac0-93ad-45d4-a30e-7bda0be93683 -- POST / 200 325.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,469 mnist_classifier_MNISTClassifier xtrkghla 4ea85b36-188e-4923-9c0f-b71e3c5621a1 -- POST / 200 324.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,469 mnist_classifier_MNISTClassifier xtrkghla 2695ea4c-ec6c-4c3c-8699-e2b555f66709 -- POST / 200 324.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,469 mnist_classifier_MNISTClassifier xtrkghla 39a2d472-3c36-4cc4-b653-c138403fcd2d -- POST / 200 324.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,470 mnist_classifier_MNISTClassifier xtrkghla cfbe39ab-2d33-406c-8b08-9ad26d969106 -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,470 mnist_classifier_MNISTClassifier xtrkghla e4df5871-c689-470d-a97a-32e0824cf8a1 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,470 mnist_classifier_MNISTClassifier xtrkghla 9557bba3-cefe-4e58-820a-7541476abe0b -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,470 mnist_classifier_MNISTClassifier xtrkghla 183e6084-11a2-4386-adf8-3b227addbde7 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,470 mnist_classifier_MNISTClassifier xtrkghla cb619ca2-df11-4f22-804b-2bbc4e17e227 -- POST / 200 265.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,470 mnist_classifier_MNISTClassifier xtrkghla 7c011276-de9c-4ca1-b22a-e10e332ce0f5 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,471 mnist_classifier_MNISTClassifier xtrkghla eea8fee6-2ce1-47a4-817b-14bfa1445c71 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,471 mnist_classifier_MNISTClassifier xtrkghla 06e896ea-a62e-49f9-97c9-e23483ae9f80 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,471 mnist_classifier_MNISTClassifier xtrkghla d639d13a-62f2-4355-9d2e-6d24f23b99ba -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,471 mnist_classifier_MNISTClassifier xtrkghla cf12cd56-0272-4dbc-ae7f-a5279f8b3aae -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,472 mnist_classifier_MNISTClassifier xtrkghla 9214886f-01de-4d4f-ac9f-87dc32cc905f -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,472 mnist_classifier_MNISTClassifier xtrkghla f97b0ec5-969f-4d60-8f7a-9461b7232f92 -- POST / 200 235.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,472 mnist_classifier_MNISTClassifier xtrkghla b45cc635-6547-43bb-a4f1-5db7d29d61b7 -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,472 mnist_classifier_MNISTClassifier xtrkghla 283ec5ad-0b70-475a-ac06-57d50545a06d -- POST / 200 231.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,473 mnist_classifier_MNISTClassifier xtrkghla 2f2e7acc-019d-49ef-a8b0-3d6543e40088 -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,473 mnist_classifier_MNISTClassifier xtrkghla 40214a3a-1243-4cd6-9fd0-d2f8c48de4fe -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,473 mnist_classifier_MNISTClassifier xtrkghla ebb8b0f3-2ba8-428a-85af-69de20b64083 -- POST / 200 227.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,473 mnist_classifier_MNISTClassifier xtrkghla 83162bc6-74f3-490c-8b12-f21130e8ca69 -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,475 mnist_classifier_MNISTClassifier xtrkghla 0e32925b-f00a-4818-bff0-a93cfee9d4cf -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,475 mnist_classifier_MNISTClassifier xtrkghla 3c9b35af-67ed-4290-85f9-2678a0efd66c -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,475 mnist_classifier_MNISTClassifier xtrkghla d536208d-ec3f-4122-a990-753740f79d86 -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,477 mnist_classifier_MNISTClassifier xtrkghla e9247960-2b59-4f10-8209-2aae3bb6a700 -- POST / 200 222.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,478 mnist_classifier_MNISTClassifier xtrkghla 0059036e-4639-4e1c-918d-af253db63e80 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,479 mnist_classifier_MNISTClassifier xtrkghla 3fcce322-d645-49c8-b4ba-98dd15d3d836 -- POST / 200 223.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,479 mnist_classifier_MNISTClassifier xtrkghla 6472d247-7e9e-411c-8a3e-bac193a85a83 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,753 mnist_classifier_MNISTClassifier xtrkghla a58746cf-ec7c-441f-a0a6-5c181f3e12d6 -- POST / 200 373.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,754 mnist_classifier_MNISTClassifier xtrkghla c260fb05-cd64-44e8-9eaa-7f76fbf35617 -- POST / 200 376.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,755 mnist_classifier_MNISTClassifier xtrkghla 39eed740-8495-407f-a949-bad7490419ec -- POST / 200 373.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,755 mnist_classifier_MNISTClassifier xtrkghla b908c836-700d-4543-90a2-b69ffae1efac -- POST / 200 373.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,756 mnist_classifier_MNISTClassifier xtrkghla d10ce69c-eaea-42e8-82d3-fbd9a902ed82 -- POST / 200 374.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,756 mnist_classifier_MNISTClassifier xtrkghla d22b0a62-6c58-4f26-a0da-e9559a87e8fe -- POST / 200 372.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,758 mnist_classifier_MNISTClassifier xtrkghla 5dc979c4-5ba8-42ed-8b0e-31b55627f65b -- POST / 200 374.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,759 mnist_classifier_MNISTClassifier xtrkghla 0cd28283-028b-4a38-9d45-bae9d4f5bf5e -- POST / 200 374.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,761 mnist_classifier_MNISTClassifier xtrkghla 8dffbd75-5bef-42f9-80f8-a7897b0aa078 -- POST / 200 370.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,761 mnist_classifier_MNISTClassifier xtrkghla 9d4ab19c-1f29-49f1-ac08-96bf44b7c1a0 -- POST / 200 368.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,761 mnist_classifier_MNISTClassifier xtrkghla e950a659-fd12-48e8-a084-4a6b24bad63a -- POST / 200 366.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,762 mnist_classifier_MNISTClassifier xtrkghla 771fb0d3-7ae1-40ce-accf-6368b0b658ff -- POST / 200 363.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,762 mnist_classifier_MNISTClassifier xtrkghla 5f7f4445-0e71-4601-a61d-17603cb68c2d -- POST / 200 361.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,763 mnist_classifier_MNISTClassifier xtrkghla e442b0ac-9554-4217-b716-e8a5c075d4e7 -- POST / 200 354.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,763 mnist_classifier_MNISTClassifier xtrkghla a2a70fd8-c6d8-4d98-90c3-feb8d1cc5ba7 -- POST / 200 362.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,764 mnist_classifier_MNISTClassifier xtrkghla 4f4fa2f4-51b1-4e96-8ce4-10e3837a7126 -- POST / 200 357.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,764 mnist_classifier_MNISTClassifier xtrkghla 25c30582-f7c3-4406-9f19-c260705bca5b -- POST / 200 357.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,765 mnist_classifier_MNISTClassifier xtrkghla cf9ea5a6-18c8-46d1-824f-84535dbdad2e -- POST / 200 355.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,766 mnist_classifier_MNISTClassifier xtrkghla 6d77cf20-0b16-41e1-aea7-b5ee53371233 -- POST / 200 347.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,766 mnist_classifier_MNISTClassifier xtrkghla 798b2e30-4c2c-4657-854c-9fa84b861294 -- POST / 200 351.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,766 mnist_classifier_MNISTClassifier xtrkghla 138806e3-19f3-4b94-b6d2-4fd1551d2e89 -- POST / 200 350.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,768 mnist_classifier_MNISTClassifier xtrkghla 5d4fe56a-1e9b-4e83-87b2-1fba9fe0d7d6 -- POST / 200 350.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,768 mnist_classifier_MNISTClassifier xtrkghla d8da4570-bd1a-4825-9067-abca877f8463 -- POST / 200 348.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,922 mnist_classifier_MNISTClassifier xtrkghla 89e68dbe-39c8-4655-a3c1-ea132f4ef9d7 -- POST / 200 501.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,922 mnist_classifier_MNISTClassifier xtrkghla 557d2d0e-241b-4818-9fd1-d8370310d92b -- POST / 200 501.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,923 mnist_classifier_MNISTClassifier xtrkghla 76c2c1a5-ffc6-4581-a20f-dba969095483 -- POST / 200 504.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,923 mnist_classifier_MNISTClassifier xtrkghla 84d1a41a-2797-4862-8697-566dba42535b -- POST / 200 503.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,924 mnist_classifier_MNISTClassifier xtrkghla 3dc0961e-a2e0-4941-ac0f-4eedacb02cbb -- POST / 200 502.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,924 mnist_classifier_MNISTClassifier xtrkghla 8333e387-d9be-4e2b-8a18-5a73c6e33b75 -- POST / 200 503.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,925 mnist_classifier_MNISTClassifier xtrkghla 08448078-dd2b-4f8f-b4f7-f1067ae9c61d -- POST / 200 499.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,925 mnist_classifier_MNISTClassifier xtrkghla 52679b6c-5e15-4d7e-89e9-5d6ed73c5be8 -- POST / 200 498.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,926 mnist_classifier_MNISTClassifier xtrkghla b2e1a435-23d3-415e-ad08-ca104746451a -- POST / 200 496.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,927 mnist_classifier_MNISTClassifier xtrkghla 25577fd8-38c0-4c0c-8b84-56bf629302f7 -- POST / 200 497.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,928 mnist_classifier_MNISTClassifier xtrkghla 43ff166e-5f49-4e40-b1ef-5a58961f9380 -- POST / 200 495.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,928 mnist_classifier_MNISTClassifier xtrkghla c9129996-e483-43a1-a4c5-2002db336e82 -- POST / 200 478.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,930 mnist_classifier_MNISTClassifier xtrkghla f3bb5612-f8dc-4539-aa9a-bb2ac558096f -- POST / 200 479.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,930 mnist_classifier_MNISTClassifier xtrkghla 85d498d2-98a9-4722-96c5-f4aea7edb8dd -- POST / 200 465.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,931 mnist_classifier_MNISTClassifier xtrkghla 7d481d87-f7bd-4db0-96f8-25e5932efc64 -- POST / 200 465.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,931 mnist_classifier_MNISTClassifier xtrkghla b3fd344a-d60b-48ef-bc21-0879da0a688a -- POST / 200 449.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,931 mnist_classifier_MNISTClassifier xtrkghla 1828d4b4-fdf7-4e9b-a39f-193d37e6918d -- POST / 200 448.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,932 mnist_classifier_MNISTClassifier xtrkghla 1f14e111-6f2a-431c-a783-369c6e705262 -- POST / 200 448.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,932 mnist_classifier_MNISTClassifier xtrkghla 12ea9e3d-c07c-4b9d-a448-8e43a0febda2 -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,933 mnist_classifier_MNISTClassifier xtrkghla 234bfcb2-fac3-4a4f-80f7-be115b5f8d3d -- POST / 200 429.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,933 mnist_classifier_MNISTClassifier xtrkghla c46c0f64-dd32-478a-a950-1e4b8053bcc7 -- POST / 200 426.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,933 mnist_classifier_MNISTClassifier xtrkghla a5b7677d-8f49-482d-bb0a-25ea7b8079ca -- POST / 200 426.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,933 mnist_classifier_MNISTClassifier xtrkghla b0f2f479-676d-491f-83d2-6eee9ab2fad9 -- POST / 200 426.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,934 mnist_classifier_MNISTClassifier xtrkghla f3b30313-7a70-4afa-9161-5604f8bb0e93 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,934 mnist_classifier_MNISTClassifier xtrkghla b3de8020-b8e0-43a3-a52d-2bca813befca -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,935 mnist_classifier_MNISTClassifier xtrkghla 164e71f2-02a4-4b5d-a1a2-4c0343c874c2 -- POST / 200 424.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,935 mnist_classifier_MNISTClassifier xtrkghla 73c37513-7f5b-4689-bd20-f3f2a955c725 -- POST / 200 424.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,936 mnist_classifier_MNISTClassifier xtrkghla 991e51c7-8f2a-4ab1-b17b-faef1679a752 -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,936 mnist_classifier_MNISTClassifier xtrkghla 2664c80d-4718-46b3-907a-873b1531c110 -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,937 mnist_classifier_MNISTClassifier xtrkghla 112ad8b1-413b-41a8-ae30-6e80f3bd9197 -- POST / 200 421.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,937 mnist_classifier_MNISTClassifier xtrkghla 4076ec4a-8e92-4649-a336-1247974dd8ee -- POST / 200 422.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,938 mnist_classifier_MNISTClassifier xtrkghla 0bdadd93-c88d-4206-b2d4-dbe1ea1dc4c8 -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,938 mnist_classifier_MNISTClassifier xtrkghla 0edaf096-10d8-4229-aa60-c9dbf0156348 -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,939 mnist_classifier_MNISTClassifier xtrkghla 6bf8500a-cc38-49cf-8409-75594231731b -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,940 mnist_classifier_MNISTClassifier xtrkghla 684a143a-d9eb-45e6-9e7c-0ee557e1d75e -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,941 mnist_classifier_MNISTClassifier xtrkghla 654a57c9-3558-4496-a006-6782c263f6d9 -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,942 mnist_classifier_MNISTClassifier xtrkghla eaf5ee3a-8727-4f4f-aaa1-13b35ea04741 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,942 mnist_classifier_MNISTClassifier xtrkghla 9f2e44db-2a82-4d3a-8e25-4a0d19204425 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,943 mnist_classifier_MNISTClassifier xtrkghla 05ade72b-74d0-481d-977d-b80174d8abeb -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,943 mnist_classifier_MNISTClassifier xtrkghla 7167bcd1-2702-4ea9-8b0d-0ec6f9b14eee -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,943 mnist_classifier_MNISTClassifier xtrkghla 09ec3c24-9bab-44e3-b248-80473b993f7f -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,944 mnist_classifier_MNISTClassifier xtrkghla 64ac9b56-e43f-4788-ab19-15e43e634f63 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,944 mnist_classifier_MNISTClassifier xtrkghla 6c9eb2da-2206-4aa4-87ba-105659fec342 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,945 mnist_classifier_MNISTClassifier xtrkghla 4b31c089-6ebf-4955-a718-f12a836064aa -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,945 mnist_classifier_MNISTClassifier xtrkghla 05bddac5-af21-4504-b6cb-b6162b486795 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,946 mnist_classifier_MNISTClassifier xtrkghla 31dde3e4-f3f5-474b-8812-2e43230cfa2d -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,946 mnist_classifier_MNISTClassifier xtrkghla e38718ec-c3da-4d64-b686-d5dee3b01306 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,947 mnist_classifier_MNISTClassifier xtrkghla 5a625655-8228-4e9f-8c3d-7de76889770b -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,947 mnist_classifier_MNISTClassifier xtrkghla 25b55c77-0c37-4061-836b-4a8092d39fb6 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,947 mnist_classifier_MNISTClassifier xtrkghla fd4454f0-4c5d-4683-a00d-1b0285e5ac24 -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,948 mnist_classifier_MNISTClassifier xtrkghla a1f97385-93e9-49bb-ac4e-fec811d45c33 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,950 mnist_classifier_MNISTClassifier xtrkghla 1734a7bc-9f83-4b9d-a6a9-48b8b67165f0 -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,950 mnist_classifier_MNISTClassifier xtrkghla e232d5dc-687c-46f3-a2ec-c890dbc57d36 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,950 mnist_classifier_MNISTClassifier xtrkghla b41cab11-96f3-4a7c-a9ca-820d24aa7052 -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,951 mnist_classifier_MNISTClassifier xtrkghla ddc512ab-43e7-42da-9cd6-2f3878b05905 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,951 mnist_classifier_MNISTClassifier xtrkghla 11803ad4-52de-44bd-b1c2-5e4b03a92c12 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,952 mnist_classifier_MNISTClassifier xtrkghla c9e482ee-e9f8-4994-9c21-00fc52821ea3 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,953 mnist_classifier_MNISTClassifier xtrkghla df0a1539-6316-4367-846c-365be105b226 -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,954 mnist_classifier_MNISTClassifier xtrkghla b0d49def-fc7a-4713-bf74-7477c498ccd6 -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,954 mnist_classifier_MNISTClassifier xtrkghla 3b46c1f5-561a-4651-b338-8dd908080ea7 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,955 mnist_classifier_MNISTClassifier xtrkghla d98400e8-f979-4f4f-96eb-0748989a2988 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,961 mnist_classifier_MNISTClassifier xtrkghla aef57703-e6a0-4488-a1b6-daa65c69d488 -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,966 mnist_classifier_MNISTClassifier xtrkghla 5444b079-df15-4e6e-b432-584ce910f443 -- POST / 200 266.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,970 mnist_classifier_MNISTClassifier xtrkghla 6b45b0a8-ffd5-46c4-9629-163ec00066d9 -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,971 mnist_classifier_MNISTClassifier xtrkghla 8bcc33ed-8ffa-41fa-aacf-4c3dec631b97 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,972 mnist_classifier_MNISTClassifier xtrkghla ef2bce7f-007e-414e-bfd4-d8e697831358 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,973 mnist_classifier_MNISTClassifier xtrkghla 680f4bdf-4e6e-43ce-99dc-ae47d491c745 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,975 mnist_classifier_MNISTClassifier xtrkghla 7c96ae77-39c5-4d12-be0d-b9e5d6e8c67e -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,975 mnist_classifier_MNISTClassifier xtrkghla a94daf8c-5775-4082-a4d4-2476c97d64e8 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,976 mnist_classifier_MNISTClassifier xtrkghla 8457ad02-45d2-4a5f-bb6d-6157ba7702b1 -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,977 mnist_classifier_MNISTClassifier xtrkghla d51ee6d0-dbac-4e82-a115-c730e8e32f0d -- POST / 200 269.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,979 mnist_classifier_MNISTClassifier xtrkghla 6e76529b-3251-428d-a2a7-ac8b310f6e2e -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,980 mnist_classifier_MNISTClassifier xtrkghla fb1e9180-e707-472f-89a7-baad513ee323 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,983 mnist_classifier_MNISTClassifier xtrkghla ad5c5030-bbc3-4185-bdb8-c428db809499 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,984 mnist_classifier_MNISTClassifier xtrkghla 403666f7-5f11-43d6-a4ba-6222ef817488 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,985 mnist_classifier_MNISTClassifier xtrkghla 30b53362-2777-4c2c-8593-cfe0133a8e54 -- POST / 200 274.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,985 mnist_classifier_MNISTClassifier xtrkghla f1798e7f-42ad-4939-848d-359589a4a085 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,985 mnist_classifier_MNISTClassifier xtrkghla 92667ce9-a0f1-4ef1-a4ea-6d73b2a480f0 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,985 mnist_classifier_MNISTClassifier xtrkghla a3a63fe2-977f-493a-8418-455fceeb8f82 -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,987 mnist_classifier_MNISTClassifier xtrkghla 2d189316-a421-4bca-a8f1-785450b2b785 -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,987 mnist_classifier_MNISTClassifier xtrkghla 360eb108-bdfc-42eb-ab54-fb152f17e4ec -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,987 mnist_classifier_MNISTClassifier xtrkghla b15984cf-b706-4148-93d2-2b8f3cc2bb9a -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,987 mnist_classifier_MNISTClassifier xtrkghla 227451e1-47a5-4b2e-aa6c-739d57af949e -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,987 mnist_classifier_MNISTClassifier xtrkghla e6615323-bc30-46b3-8f17-aa7f238df19a -- POST / 200 193.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,987 mnist_classifier_MNISTClassifier xtrkghla b01d6638-3361-4b9c-b0f6-7a4ff07977ec -- POST / 200 192.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,988 mnist_classifier_MNISTClassifier xtrkghla 76a548f6-fadd-49a4-b018-287433037c63 -- POST / 200 192.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,988 mnist_classifier_MNISTClassifier xtrkghla a0ec9358-30f9-408f-a89e-377526c71dff -- POST / 200 192.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,988 mnist_classifier_MNISTClassifier xtrkghla 92574228-c5d9-4172-9613-9e7cb30a1417 -- POST / 200 190.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,988 mnist_classifier_MNISTClassifier xtrkghla d010813a-ccc7-4acd-b0dc-fd0f08ccd18b -- POST / 200 190.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,988 mnist_classifier_MNISTClassifier xtrkghla bfb662a4-9a44-49f9-ab8b-6c7fb3584c20 -- POST / 200 188.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,988 mnist_classifier_MNISTClassifier xtrkghla df9c5879-f37e-48c0-9073-6de0ea2a39d4 -- POST / 200 190.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,989 mnist_classifier_MNISTClassifier xtrkghla cdc2f084-4dfc-41b6-95f3-fc9f0e1e37c5 -- POST / 200 188.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,989 mnist_classifier_MNISTClassifier xtrkghla 7f74207c-c902-4920-9300-2723a6fd3d5f -- POST / 200 186.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,989 mnist_classifier_MNISTClassifier xtrkghla a169dcfd-add6-49d1-a983-8a135310392a -- POST / 200 186.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,996 mnist_classifier_MNISTClassifier xtrkghla 1fc75c10-ab62-4385-8061-6c9d1b5c91d4 -- POST / 200 193.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:47,998 mnist_classifier_MNISTClassifier xtrkghla bda821c4-5a77-40ec-b775-dfe572cdc6b3 -- POST / 200 195.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,001 mnist_classifier_MNISTClassifier xtrkghla 2a8df2c7-7e0c-4a86-a653-03740832c7ea -- POST / 200 196.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,003 mnist_classifier_MNISTClassifier xtrkghla b64ce6c7-9138-4ddb-89aa-dcdad219bbb4 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,003 mnist_classifier_MNISTClassifier xtrkghla 0b66864f-8648-4cc2-8d2d-61378c341919 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,007 mnist_classifier_MNISTClassifier xtrkghla 7279a9bd-34de-4a2d-a19c-18033c1614c8 -- POST / 200 200.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,204 mnist_classifier_MNISTClassifier xtrkghla d2ef2684-f661-4ee4-b642-7b31c8686ec5 -- POST / 200 227.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,204 mnist_classifier_MNISTClassifier xtrkghla 8e7f9a26-f4d3-4dc0-a212-47e49a966df0 -- POST / 200 189.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,207 mnist_classifier_MNISTClassifier xtrkghla 0883065d-b890-41cf-811a-b7a55a7d1657 -- POST / 200 191.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,210 mnist_classifier_MNISTClassifier xtrkghla 26808665-66d7-44a3-9be8-570c0b8ef64d -- POST / 200 189.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,212 mnist_classifier_MNISTClassifier xtrkghla bbe43e15-0c77-4e80-907e-d9aa3a251392 -- POST / 200 190.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,220 mnist_classifier_MNISTClassifier xtrkghla 5535a2b7-8197-41f3-99a0-69da202a26d6 -- POST / 200 198.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,222 mnist_classifier_MNISTClassifier xtrkghla b764aed9-a4d0-4ed0-b50d-e0ed7f8fe576 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,222 mnist_classifier_MNISTClassifier xtrkghla 49f3d65a-94e7-416b-b674-ac978d11a594 -- POST / 200 197.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,224 mnist_classifier_MNISTClassifier xtrkghla 1eef7e5b-22e5-49be-ab09-25cfabb3ad79 -- POST / 200 198.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,226 mnist_classifier_MNISTClassifier xtrkghla 07cba6cc-df74-4186-9dcb-ac4f5eec8511 -- POST / 200 198.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,226 mnist_classifier_MNISTClassifier xtrkghla ad9db294-7aba-4f8d-a456-5fcbbc405326 -- POST / 200 198.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,229 mnist_classifier_MNISTClassifier xtrkghla dedd0d02-4ae0-4097-96fb-f8f05527ee21 -- POST / 200 200.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,231 mnist_classifier_MNISTClassifier xtrkghla c712b6e6-0b6b-4844-8683-10d17d547824 -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,232 mnist_classifier_MNISTClassifier xtrkghla b133968d-ddb2-438b-8900-94de91bd5075 -- POST / 200 200.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,234 mnist_classifier_MNISTClassifier xtrkghla 1b1257cd-7df9-41ee-ac48-9cbbe57d57e0 -- POST / 200 203.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,235 mnist_classifier_MNISTClassifier xtrkghla 4f045665-8c8a-49f2-9103-1da8ceca718f -- POST / 200 201.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,235 mnist_classifier_MNISTClassifier xtrkghla 3dae3f46-9821-4912-8744-3baf498ba637 -- POST / 200 201.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,237 mnist_classifier_MNISTClassifier xtrkghla 6022738e-c96a-4e5a-9e70-bc89da8c256f -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,239 mnist_classifier_MNISTClassifier xtrkghla 1fe52bd5-ff7e-407e-8401-f74e2a0dd480 -- POST / 200 202.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,242 mnist_classifier_MNISTClassifier xtrkghla 48892fec-0e58-42b3-8008-5bc52da987f1 -- POST / 200 205.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,244 mnist_classifier_MNISTClassifier xtrkghla a59b6121-470a-49a3-87a1-a6f1ab370800 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,244 mnist_classifier_MNISTClassifier xtrkghla e3ae6e82-1381-46a7-96a1-620c6a665a9b -- POST / 200 206.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,245 mnist_classifier_MNISTClassifier xtrkghla ddc30340-775f-40cb-8926-a12ca47c1236 -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,246 mnist_classifier_MNISTClassifier xtrkghla 6b6db533-2bec-4361-a23d-adc351042f35 -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,252 mnist_classifier_MNISTClassifier xtrkghla bebf22ef-7f57-486f-9125-6c0b1401df7b -- POST / 200 211.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,254 mnist_classifier_MNISTClassifier xtrkghla ac1371c9-fdae-4f17-a02a-b07fb3a863c7 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,256 mnist_classifier_MNISTClassifier xtrkghla b584ed09-7d59-4abb-aaac-a8eebafbc11a -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,257 mnist_classifier_MNISTClassifier xtrkghla ba701eeb-29cb-490a-a6d7-4fb70ad5169b -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,335 mnist_classifier_MNISTClassifier xtrkghla 8e979ea7-2ced-48b6-bfb6-eb35eebf047f -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,339 mnist_classifier_MNISTClassifier xtrkghla 3a1c1d89-16a0-4a7d-a9e8-fe24405932f3 -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,341 mnist_classifier_MNISTClassifier xtrkghla bc06527a-87c6-4794-92a5-ccc3501da15e -- POST / 200 294.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,344 mnist_classifier_MNISTClassifier xtrkghla 52f532ed-cff2-4136-93b7-5b7aa16d060d -- POST / 200 297.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,345 mnist_classifier_MNISTClassifier xtrkghla b241664e-acaa-438c-a8b3-f2dae43c0a04 -- POST / 200 298.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,347 mnist_classifier_MNISTClassifier xtrkghla a0ebb0b3-4d57-426c-9dc5-794d11bbe832 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,348 mnist_classifier_MNISTClassifier xtrkghla 794c947a-273a-40b4-ab1a-02844528a839 -- POST / 200 299.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,349 mnist_classifier_MNISTClassifier xtrkghla 44ce96fc-a97f-439f-b722-e281f708c525 -- POST / 200 300.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,351 mnist_classifier_MNISTClassifier xtrkghla 5028e553-09a2-4619-917b-fb8e12967595 -- POST / 200 302.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,352 mnist_classifier_MNISTClassifier xtrkghla 4522330c-d19a-4fa3-aff5-30b7609c75e1 -- POST / 200 301.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,355 mnist_classifier_MNISTClassifier xtrkghla c3875eb6-38e4-484e-9849-493b193c0d6a -- POST / 200 303.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,357 mnist_classifier_MNISTClassifier xtrkghla d472e1b3-0d08-49e2-b38a-bd54cf8ad03e -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,357 mnist_classifier_MNISTClassifier xtrkghla 63652c7c-f518-443a-b2ee-f811bcb208be -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,358 mnist_classifier_MNISTClassifier xtrkghla 00a1acb5-1c66-48a1-8c5f-95df141b1214 -- POST / 200 303.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,360 mnist_classifier_MNISTClassifier xtrkghla 770cd89f-4077-44f1-afb0-3632ee8b80bf -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,362 mnist_classifier_MNISTClassifier xtrkghla 079363c6-2619-4bba-9d9e-d9f4f74a48d8 -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,364 mnist_classifier_MNISTClassifier xtrkghla f4e22233-a0d3-498e-a516-4a924006f472 -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,365 mnist_classifier_MNISTClassifier xtrkghla 81e1d3d8-fd89-4fd0-ada1-0270ef76fd2d -- POST / 200 306.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,365 mnist_classifier_MNISTClassifier xtrkghla 420f437f-4e29-489b-b75b-3eaf7fd76c31 -- POST / 200 306.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,366 mnist_classifier_MNISTClassifier xtrkghla de17ec98-d285-4122-b69b-622b8e99e24b -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,366 mnist_classifier_MNISTClassifier xtrkghla 9a1ed61f-dc05-47f1-ba0b-92104c632c91 -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,366 mnist_classifier_MNISTClassifier xtrkghla 4143d0a4-aa7e-43dd-b78d-aef1a42f430d -- POST / 200 300.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,366 mnist_classifier_MNISTClassifier xtrkghla c3b18481-0ee0-4681-a3f3-5fa464e4a0a6 -- POST / 200 298.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,367 mnist_classifier_MNISTClassifier xtrkghla 5e50c37f-addd-40a2-b56c-fa20de21e372 -- POST / 200 297.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,368 mnist_classifier_MNISTClassifier xtrkghla dbce9489-2a29-4cf8-b8ef-4043e7092ecb -- POST / 200 296.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,369 mnist_classifier_MNISTClassifier xtrkghla f3775a20-e42e-4480-897a-638d36324161 -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,369 mnist_classifier_MNISTClassifier xtrkghla 6405c5d5-7615-428f-9d8b-210ee5ef142b -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,370 mnist_classifier_MNISTClassifier xtrkghla 2d5f9eaf-4beb-4cfb-8838-b35fffbd1940 -- POST / 200 297.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,370 mnist_classifier_MNISTClassifier xtrkghla 04c45102-3143-4f30-8b67-be4b5a5ec936 -- POST / 200 297.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,370 mnist_classifier_MNISTClassifier xtrkghla 9aae2486-4632-4817-934d-b9f987be68e8 -- POST / 200 297.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,371 mnist_classifier_MNISTClassifier xtrkghla 8b0975b7-e900-4583-8971-afaed9299ee6 -- POST / 200 296.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,372 mnist_classifier_MNISTClassifier xtrkghla cf0a143c-5b0c-4691-90f2-96f33efece8d -- POST / 200 296.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,373 mnist_classifier_MNISTClassifier xtrkghla 3b9ff5c8-7760-4db4-8369-5b5467236a35 -- POST / 200 297.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,373 mnist_classifier_MNISTClassifier xtrkghla d7c0e425-6c60-47cd-92d5-868312f4433e -- POST / 200 295.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,373 mnist_classifier_MNISTClassifier xtrkghla 47584576-f8ce-40d3-9545-2381dd9cdec0 -- POST / 200 292.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,374 mnist_classifier_MNISTClassifier xtrkghla 4eefb03b-73a8-4258-82f0-c84578898333 -- POST / 200 291.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,374 mnist_classifier_MNISTClassifier xtrkghla b01ddb6b-437e-4829-8c4f-e44c4d6c4fd4 -- POST / 200 290.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,375 mnist_classifier_MNISTClassifier xtrkghla e13c9f08-7832-4c7e-acd7-bb880d3115bb -- POST / 200 289.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,375 mnist_classifier_MNISTClassifier xtrkghla e0d98a96-0696-40c1-b07f-17a65843b36a -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,375 mnist_classifier_MNISTClassifier xtrkghla c6cedf6a-9bcd-47e7-9ef5-54acd9b81ac7 -- POST / 200 271.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,377 mnist_classifier_MNISTClassifier xtrkghla b90fe9b9-b48b-491f-81e7-e1d6111a98b6 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,382 mnist_classifier_MNISTClassifier xtrkghla 94d094f3-86c3-4385-8fcd-96861127b4e9 -- POST / 200 277.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,390 mnist_classifier_MNISTClassifier xtrkghla 0a344444-933e-4a28-a5bf-4dae9296f5f9 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,390 mnist_classifier_MNISTClassifier xtrkghla 2c9a4bf1-8642-46b8-b793-f23943714f1c -- POST / 200 283.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,392 mnist_classifier_MNISTClassifier xtrkghla 25a28e6c-1b91-4244-b14d-278614aa8851 -- POST / 200 280.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,648 mnist_classifier_MNISTClassifier xtrkghla 7c295141-7663-4a17-893e-5fd9f546278a -- POST / 200 520.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,649 mnist_classifier_MNISTClassifier xtrkghla 55c0df37-59c3-4c3e-8cc8-0447ca0df5eb -- POST / 200 520.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,649 mnist_classifier_MNISTClassifier xtrkghla 612f6e05-22ad-4415-b10b-909f6dbe7d1b -- POST / 200 520.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,649 mnist_classifier_MNISTClassifier xtrkghla 647dadcb-8d75-4d51-8722-c9ce85312388 -- POST / 200 520.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,650 mnist_classifier_MNISTClassifier xtrkghla e3875a93-582e-4c5b-8c40-487db09ad080 -- POST / 200 518.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,650 mnist_classifier_MNISTClassifier xtrkghla a1f6c686-0bc1-4564-8c2a-8e8d1e12038e -- POST / 200 516.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,650 mnist_classifier_MNISTClassifier xtrkghla a7721b5e-6231-4f7a-a005-d178c7c4b981 -- POST / 200 514.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,651 mnist_classifier_MNISTClassifier xtrkghla 889d2e3f-b3d6-4640-8823-bdf172a8bea8 -- POST / 200 514.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,651 mnist_classifier_MNISTClassifier xtrkghla 05c5e1a3-06dd-4271-9418-d8f8d5251791 -- POST / 200 497.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,652 mnist_classifier_MNISTClassifier xtrkghla c5fbd221-8e52-4b3e-991e-cfab8c4f564b -- POST / 200 495.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,653 mnist_classifier_MNISTClassifier xtrkghla 1cf949ed-cd67-4449-8d1a-0c53978ec593 -- POST / 200 493.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,654 mnist_classifier_MNISTClassifier xtrkghla c0d68609-9da4-47e7-81b7-8eb7f0d3e8ee -- POST / 200 493.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,655 mnist_classifier_MNISTClassifier xtrkghla 3b0fd7b9-75aa-4826-ae8b-883758a5f75e -- POST / 200 493.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,659 mnist_classifier_MNISTClassifier xtrkghla 3d1437c0-557d-48f6-8f86-200381544029 -- POST / 200 495.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,661 mnist_classifier_MNISTClassifier xtrkghla d950b966-40a4-440b-beaa-da40f2744302 -- POST / 200 493.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,667 mnist_classifier_MNISTClassifier xtrkghla 24a44c1f-353e-4e6a-a284-d76c410c7d1b -- POST / 200 499.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,671 mnist_classifier_MNISTClassifier xtrkghla d73f5550-55c6-44a3-b74d-505fc5bde432 -- POST / 200 502.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,678 mnist_classifier_MNISTClassifier xtrkghla 3e871a63-642a-453a-9da3-2ed34bddada9 -- POST / 200 509.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,679 mnist_classifier_MNISTClassifier xtrkghla aa492a69-6c39-4a4f-8d6e-2317c8b43800 -- POST / 200 509.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,679 mnist_classifier_MNISTClassifier xtrkghla 90fb5923-b146-4fc2-a929-f0b0602d3995 -- POST / 200 508.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,680 mnist_classifier_MNISTClassifier xtrkghla 54131dae-cc24-47d7-8150-c40534abc36b -- POST / 200 502.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,681 mnist_classifier_MNISTClassifier xtrkghla a2ced577-2795-4b8b-a71e-147131f510b3 -- POST / 200 503.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,681 mnist_classifier_MNISTClassifier xtrkghla d658f97e-7b19-4f25-b859-1a14cd8699a3 -- POST / 200 500.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,682 mnist_classifier_MNISTClassifier xtrkghla 7e33620a-4426-4aa0-a700-f447f9649bd0 -- POST / 200 500.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,683 mnist_classifier_MNISTClassifier xtrkghla 9d99ef9b-1276-4391-842b-5e17b8b36c32 -- POST / 200 499.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,684 mnist_classifier_MNISTClassifier xtrkghla a9911ba2-3541-4e04-9f20-ac883f9be1f2 -- POST / 200 500.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,684 mnist_classifier_MNISTClassifier xtrkghla b9520e3c-7b53-4b79-b004-f8e8fbf2d088 -- POST / 200 497.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,813 mnist_classifier_MNISTClassifier xtrkghla a665ba36-6ae2-4865-a65d-4993984b79d9 -- POST / 200 582.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,814 mnist_classifier_MNISTClassifier xtrkghla 38bb0421-6aab-4c19-b338-47fba5da9963 -- POST / 200 582.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,814 mnist_classifier_MNISTClassifier xtrkghla 7efe621e-bad3-43e2-ab6b-e018e0f324d0 -- POST / 200 577.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,815 mnist_classifier_MNISTClassifier xtrkghla 98841c2f-03a5-4f37-a163-da899f0511b2 -- POST / 200 568.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,815 mnist_classifier_MNISTClassifier xtrkghla 8da658c1-e06d-478d-825f-86ab6ef4f2b6 -- POST / 200 554.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,816 mnist_classifier_MNISTClassifier xtrkghla 5b62f9bc-3832-4250-83eb-c9aa1a7402ff -- POST / 200 544.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,816 mnist_classifier_MNISTClassifier xtrkghla 6b6e309d-13b8-4086-91f2-be14f1fca47c -- POST / 200 544.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,817 mnist_classifier_MNISTClassifier xtrkghla 34424cbd-ea6c-4a41-b46b-acafe8df1d0c -- POST / 200 544.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,817 mnist_classifier_MNISTClassifier xtrkghla 039d02b5-cfef-43eb-a23b-942514f2c751 -- POST / 200 544.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,818 mnist_classifier_MNISTClassifier xtrkghla 531616f7-b23f-4072-8a32-ba2d0618fcd9 -- POST / 200 543.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,819 mnist_classifier_MNISTClassifier xtrkghla 4077fc79-970e-4c28-9579-bbefb9a2c181 -- POST / 200 544.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,820 mnist_classifier_MNISTClassifier xtrkghla 85bf1232-e577-4610-ab1c-a36d2cb766bf -- POST / 200 544.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,822 mnist_classifier_MNISTClassifier xtrkghla ad219f3c-f546-44c5-bdb1-c8f76256804a -- POST / 200 545.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,823 mnist_classifier_MNISTClassifier xtrkghla dbefc4cb-3648-4b50-a0af-6ad419c2c9da -- POST / 200 546.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,823 mnist_classifier_MNISTClassifier xtrkghla 621690cb-6dbc-4031-8be5-484a04027b7e -- POST / 200 541.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,823 mnist_classifier_MNISTClassifier xtrkghla 32945102-0d6e-47a2-8441-eac027d6fcf6 -- POST / 200 539.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,825 mnist_classifier_MNISTClassifier xtrkghla adf35e5a-8b32-4618-8723-ce3d964a5832 -- POST / 200 540.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,825 mnist_classifier_MNISTClassifier xtrkghla caa71a11-47be-40c7-8828-9012b47f5e97 -- POST / 200 539.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,826 mnist_classifier_MNISTClassifier xtrkghla 0c1c4cfb-8d3e-4521-8c50-a32653df104b -- POST / 200 539.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,826 mnist_classifier_MNISTClassifier xtrkghla 797ada32-c298-4f42-9fcc-e972298449c0 -- POST / 200 537.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,828 mnist_classifier_MNISTClassifier xtrkghla 9222b01e-ee9f-492a-b129-39eb20acc023 -- POST / 200 538.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,829 mnist_classifier_MNISTClassifier xtrkghla e96d69c3-a0bc-4bc3-86d9-d469c428e1ef -- POST / 200 539.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,829 mnist_classifier_MNISTClassifier xtrkghla 0e5090f8-54b2-4a04-8374-e75b52a1fc87 -- POST / 200 538.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,829 mnist_classifier_MNISTClassifier xtrkghla 42b9bda7-8326-45b7-bc02-83ef3bb92b15 -- POST / 200 538.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,830 mnist_classifier_MNISTClassifier xtrkghla f35c8c9e-e912-47a2-8745-5a94bf6a2620 -- POST / 200 538.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,830 mnist_classifier_MNISTClassifier xtrkghla 595e0824-3cb5-4cf0-bafa-007f7e3a3940 -- POST / 200 536.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,830 mnist_classifier_MNISTClassifier xtrkghla de02590b-0a04-451c-96b4-3a3c91d7a364 -- POST / 200 533.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,831 mnist_classifier_MNISTClassifier xtrkghla 5391936b-5901-4d1e-b14f-41baf9158af1 -- POST / 200 533.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,831 mnist_classifier_MNISTClassifier xtrkghla d66e8510-0abd-4f3d-af42-ef1f9d1cf317 -- POST / 200 470.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,831 mnist_classifier_MNISTClassifier xtrkghla 3b70ee6c-0e5f-4864-9df5-e0b22d1e231a -- POST / 200 470.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,832 mnist_classifier_MNISTClassifier xtrkghla ba278574-8652-4110-8481-e1f63a6617e3 -- POST / 200 438.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,832 mnist_classifier_MNISTClassifier xtrkghla 888d1e40-ef09-4f5d-9d59-93cfd616bb44 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,833 mnist_classifier_MNISTClassifier xtrkghla 94e9fd0b-ce1c-43cc-b2a2-10f19b3cedf0 -- POST / 200 437.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,833 mnist_classifier_MNISTClassifier xtrkghla ed505823-a6f7-46ce-a4ec-327083d1d57c -- POST / 200 435.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,833 mnist_classifier_MNISTClassifier xtrkghla ad732f68-77b0-414b-838b-b3df87a64025 -- POST / 200 435.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,834 mnist_classifier_MNISTClassifier xtrkghla 5f2797a4-3489-4540-902b-4a44c3e2dc8c -- POST / 200 434.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,834 mnist_classifier_MNISTClassifier xtrkghla 26e90479-d538-4a5a-8dfb-427d30f2e0f4 -- POST / 200 433.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,834 mnist_classifier_MNISTClassifier xtrkghla c25c3656-36cd-4343-bb62-86afdb441eec -- POST / 200 424.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,835 mnist_classifier_MNISTClassifier xtrkghla 0adf4384-6e89-4de7-b1b1-599e29a858c4 -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,835 mnist_classifier_MNISTClassifier xtrkghla 1a868fac-99f9-4ba8-9729-15ba429a4e4e -- POST / 200 414.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,835 mnist_classifier_MNISTClassifier xtrkghla 798e7ab5-b66a-4117-b5d7-464e5868f59e -- POST / 200 412.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,836 mnist_classifier_MNISTClassifier xtrkghla 342befbc-e814-46d8-a72b-3dd3ff85a678 -- POST / 200 412.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,836 mnist_classifier_MNISTClassifier xtrkghla 6487aeb7-0f21-4752-8f8c-522405132dce -- POST / 200 408.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,836 mnist_classifier_MNISTClassifier xtrkghla 9c1ac25f-2bed-4fec-953b-34f177899137 -- POST / 200 407.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,837 mnist_classifier_MNISTClassifier xtrkghla 91384c23-ca62-4e1b-af25-4dbea8172c35 -- POST / 200 407.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,837 mnist_classifier_MNISTClassifier xtrkghla 6273dcfd-e93a-4cad-9b85-d5a0b16ef952 -- POST / 200 407.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,837 mnist_classifier_MNISTClassifier xtrkghla 60852c78-6832-48d8-936c-4d7791d2d19a -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,838 mnist_classifier_MNISTClassifier xtrkghla 12647e2c-ffd5-42a4-a6db-700748b6a1f2 -- POST / 200 407.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,838 mnist_classifier_MNISTClassifier xtrkghla b8997dab-20fb-4909-923f-4706ff0e1190 -- POST / 200 407.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,838 mnist_classifier_MNISTClassifier xtrkghla 1157f9d5-8365-4e3c-aed2-9ac5c0e13954 -- POST / 200 406.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,839 mnist_classifier_MNISTClassifier xtrkghla cd5ed468-1c68-4c64-afa1-dba5e45a0d4d -- POST / 200 405.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,839 mnist_classifier_MNISTClassifier xtrkghla d55ef408-4a97-4a1f-a470-f05e1fbe140d -- POST / 200 405.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,839 mnist_classifier_MNISTClassifier xtrkghla 625a53b4-662a-4962-8f36-f07d43e5861f -- POST / 200 404.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,840 mnist_classifier_MNISTClassifier xtrkghla 2a0ee1dc-f0c3-499d-ac19-3cdb7687cead -- POST / 200 401.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,841 mnist_classifier_MNISTClassifier xtrkghla ed52fa6f-609f-494d-a9c3-ffb08f23ecbe -- POST / 200 401.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,842 mnist_classifier_MNISTClassifier xtrkghla d25752c5-d2f7-45bf-98bc-1da01cca775e -- POST / 200 400.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,842 mnist_classifier_MNISTClassifier xtrkghla 8dce8c5f-d8f3-490d-b8bd-52e998f4f810 -- POST / 200 401.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,843 mnist_classifier_MNISTClassifier xtrkghla e23cf237-4791-41b5-887b-2fc5c38ab83d -- POST / 200 401.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,844 mnist_classifier_MNISTClassifier xtrkghla 45317e07-7749-452f-8234-8ca7a9036fd3 -- POST / 200 401.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,844 mnist_classifier_MNISTClassifier xtrkghla 4c499860-2e9b-4530-a69b-9602e7ff08be -- POST / 200 399.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,844 mnist_classifier_MNISTClassifier xtrkghla babd9b64-3e21-438c-8e1d-b13d0b609669 -- POST / 200 396.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,845 mnist_classifier_MNISTClassifier xtrkghla 5277e0cf-5e4d-4196-9c3d-45cda2f69a75 -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,845 mnist_classifier_MNISTClassifier xtrkghla fdbcc9bb-097a-4d09-8476-d1f50a6835d9 -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,845 mnist_classifier_MNISTClassifier xtrkghla 31820e63-01d0-463f-b8ba-bef39e4f9b10 -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,846 mnist_classifier_MNISTClassifier xtrkghla d008ec7c-a57d-47b3-ab43-56cc2d6e928e -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,846 mnist_classifier_MNISTClassifier xtrkghla d4944f01-5fbf-4d66-9d04-c82cd02ccea4 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,847 mnist_classifier_MNISTClassifier xtrkghla 4ac847c6-adc6-49ac-9f3b-6ff9121a01f2 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,847 mnist_classifier_MNISTClassifier xtrkghla 7884dd47-196b-403e-bed9-a1665efd8b85 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,847 mnist_classifier_MNISTClassifier xtrkghla 29ba4927-5a5b-400d-bd39-0fd48ccaf79e -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,847 mnist_classifier_MNISTClassifier xtrkghla 592b7e69-3f4c-4fdb-b2ef-5044eec6585b -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,848 mnist_classifier_MNISTClassifier xtrkghla fbdf155f-6acf-4129-9d17-1942962a04ad -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,848 mnist_classifier_MNISTClassifier xtrkghla 21f3d50d-b335-4526-a38d-31084de07b7e -- POST / 200 240.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,849 mnist_classifier_MNISTClassifier xtrkghla 2a8a10bf-00c6-4fb3-9d5e-8f205372813c -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,849 mnist_classifier_MNISTClassifier xtrkghla e0530c3e-6672-4e51-9ed6-85f0cc30cfac -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,850 mnist_classifier_MNISTClassifier xtrkghla f654af1d-f459-4f81-a3f7-6f13fa8a0b01 -- POST / 200 215.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,850 mnist_classifier_MNISTClassifier xtrkghla ba3d6a5c-637d-4858-b59a-392203c66848 -- POST / 200 202.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,851 mnist_classifier_MNISTClassifier xtrkghla 6fbf55ea-3fee-48b3-bd4b-0367cd323e23 -- POST / 200 157.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,851 mnist_classifier_MNISTClassifier xtrkghla d2d8857a-c5dc-4067-be68-1952c1fe222c -- POST / 200 142.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,851 mnist_classifier_MNISTClassifier xtrkghla b2fd8e9b-cdef-43e4-a0f1-c8c25ff1076c -- POST / 200 142.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,851 mnist_classifier_MNISTClassifier xtrkghla b5dccb4d-3717-4195-b3f0-74888163b612 -- POST / 200 142.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,852 mnist_classifier_MNISTClassifier xtrkghla 225d9d70-8e89-4f54-8455-10f9c199325a -- POST / 200 142.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,852 mnist_classifier_MNISTClassifier xtrkghla e2746ff8-64dc-422f-b072-010274914b22 -- POST / 200 142.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,853 mnist_classifier_MNISTClassifier xtrkghla 0d281cb3-88d4-41b0-9717-8097c60c7af1 -- POST / 200 139.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,853 mnist_classifier_MNISTClassifier xtrkghla 5d33acc6-047c-48ba-95fd-723888af584b -- POST / 200 141.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,853 mnist_classifier_MNISTClassifier xtrkghla 33ceea53-923c-4fb2-9944-44555fcc119b -- POST / 200 140.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,855 mnist_classifier_MNISTClassifier xtrkghla 8fa55c71-f631-4c73-8759-979921f87036 -- POST / 200 141.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,855 mnist_classifier_MNISTClassifier xtrkghla f9969edb-4027-493c-9f5f-7b69683ec548 -- POST / 200 141.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,856 mnist_classifier_MNISTClassifier xtrkghla fb1850aa-8f29-45d1-a216-2bf47155a0d6 -- POST / 200 141.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,856 mnist_classifier_MNISTClassifier xtrkghla 7cc47116-e037-40dc-ba48-a32c4c294c47 -- POST / 200 139.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,857 mnist_classifier_MNISTClassifier xtrkghla 42fbf9e8-8db2-4d26-82b3-c6956e3ef3c2 -- POST / 200 139.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,861 mnist_classifier_MNISTClassifier xtrkghla b0803186-cf5a-44ae-8cb8-0d151d8872f5 -- POST / 200 142.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,863 mnist_classifier_MNISTClassifier xtrkghla c0ad0092-79c9-4f71-abeb-e646b9e83e52 -- POST / 200 137.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,865 mnist_classifier_MNISTClassifier xtrkghla 707ef8fd-adf8-458f-9258-2824e2b1bb64 -- POST / 200 139.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,867 mnist_classifier_MNISTClassifier xtrkghla 2a02b9d0-5efc-4ce6-a4a9-50dc2a27f5ee -- POST / 200 138.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,868 mnist_classifier_MNISTClassifier xtrkghla 11d8d62b-0922-4017-9dd2-ec92209ddcfa -- POST / 200 140.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,870 mnist_classifier_MNISTClassifier xtrkghla cdc03e57-736a-4df7-96f2-f860f28fb652 -- POST / 200 141.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,871 mnist_classifier_MNISTClassifier xtrkghla 0c6c3b8f-f2f0-4acb-a0dd-7fd76413530e -- POST / 200 140.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,873 mnist_classifier_MNISTClassifier xtrkghla 77f71dcf-8fd9-47bc-bc8f-149ef4caff7d -- POST / 200 141.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,875 mnist_classifier_MNISTClassifier xtrkghla 77a08019-a3b8-426b-b594-2d3be5c0e54a -- POST / 200 143.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:48,875 mnist_classifier_MNISTClassifier xtrkghla db906aa8-f94f-4dc9-8366-561cb2d435b1 -- POST / 200 142.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,095 mnist_classifier_MNISTClassifier xtrkghla 218ac892-d665-4eea-bfe8-3b5c4cefccb1 -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,101 mnist_classifier_MNISTClassifier xtrkghla 34c6563d-8b51-497b-a9e5-51a9a04bdb53 -- POST / 200 223.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,102 mnist_classifier_MNISTClassifier xtrkghla a226dfe5-5b75-4792-84cc-7dec0f8d03c3 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,106 mnist_classifier_MNISTClassifier xtrkghla c1f17b3c-057c-446a-ae31-59ba0640dda2 -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,107 mnist_classifier_MNISTClassifier xtrkghla eccf8b06-76aa-420b-821a-d8c2f09a2c20 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,108 mnist_classifier_MNISTClassifier xtrkghla 9636ceda-6eab-40c0-96b0-aa48f4d8a098 -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,109 mnist_classifier_MNISTClassifier xtrkghla fda1f4b7-96c7-4baf-a7ef-6a2697de36b0 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,112 mnist_classifier_MNISTClassifier xtrkghla 29ab66c1-85a9-4e5f-82fa-df7b14acb2e5 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,113 mnist_classifier_MNISTClassifier xtrkghla f12880c7-2cec-477d-881b-d79f79e22a88 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,114 mnist_classifier_MNISTClassifier xtrkghla 3c2fa0c2-c111-4ea2-b2a6-870d7dc3650e -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,114 mnist_classifier_MNISTClassifier xtrkghla 96209f8a-6887-4aaf-94fa-86babef38a22 -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,115 mnist_classifier_MNISTClassifier xtrkghla 27837efe-3b8a-4485-8a39-ad9e3c8fc118 -- POST / 200 212.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,116 mnist_classifier_MNISTClassifier xtrkghla 7c9856ca-3333-462a-bd48-6cd28c0ecc61 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,116 mnist_classifier_MNISTClassifier xtrkghla 896b461c-9d89-4930-88fe-8b0d07b4b880 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,116 mnist_classifier_MNISTClassifier xtrkghla 51cb2211-72ec-453f-94db-8fd5d1b70b7a -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,117 mnist_classifier_MNISTClassifier xtrkghla 14a96ccc-9476-4bc4-a19d-b87baf2b49bd -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,117 mnist_classifier_MNISTClassifier xtrkghla 3c0f0368-0164-44a4-9af0-0f0e1c242db8 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,118 mnist_classifier_MNISTClassifier xtrkghla e5c39678-25f8-4f6f-9787-1d26a47545eb -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,118 mnist_classifier_MNISTClassifier xtrkghla 1adca2cb-ce12-4716-8147-79f51c00de3f -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,119 mnist_classifier_MNISTClassifier xtrkghla a80cf08e-377c-4acc-b438-cea570d977af -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,120 mnist_classifier_MNISTClassifier xtrkghla ba8c02bd-5f3c-40cf-9f5b-6b1da25ab68e -- POST / 200 210.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,201 mnist_classifier_MNISTClassifier xtrkghla 65bf1583-2e22-4ec2-bc09-74c5d3482a13 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,203 mnist_classifier_MNISTClassifier xtrkghla 27b1769a-a5a7-4f95-8efa-ae313a7e75df -- POST / 200 289.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,204 mnist_classifier_MNISTClassifier xtrkghla f2ceb2a6-4cdd-49c2-8bbb-8d54ca3741f8 -- POST / 200 289.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,204 mnist_classifier_MNISTClassifier xtrkghla d295f778-fb3d-46b2-a1fc-0862bdb25cba -- POST / 200 289.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,204 mnist_classifier_MNISTClassifier xtrkghla 017902c3-4602-4c8c-baff-e333da2f3f5b -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,204 mnist_classifier_MNISTClassifier xtrkghla 6f727198-08f0-498e-a1de-7d7533077b16 -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,205 mnist_classifier_MNISTClassifier xtrkghla 01e50f70-2f1a-4880-ae59-b2dad9e0478b -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,205 mnist_classifier_MNISTClassifier xtrkghla d88a8d06-42a8-434e-a767-2fade2b00e3c -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,206 mnist_classifier_MNISTClassifier xtrkghla 34713ce7-fb7d-4208-89ce-df8d363bd696 -- POST / 200 261.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,207 mnist_classifier_MNISTClassifier xtrkghla 3f8eb88f-cdf4-4617-8523-d659000da0c3 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,209 mnist_classifier_MNISTClassifier xtrkghla 756a460a-255c-44ec-86e3-6b30035322c2 -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,210 mnist_classifier_MNISTClassifier xtrkghla a93780b8-3a33-468f-889e-6327de30bc92 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,210 mnist_classifier_MNISTClassifier xtrkghla 542a081f-9b74-4dda-be9e-093b8146bab8 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,211 mnist_classifier_MNISTClassifier xtrkghla c86cece3-3453-441e-b3ec-8cddaf125686 -- POST / 200 225.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,211 mnist_classifier_MNISTClassifier xtrkghla 5744f922-7588-4f2f-8bcd-89707030dea8 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,217 mnist_classifier_MNISTClassifier xtrkghla 6be8cd87-27ae-4800-ba6e-7937ae5e02ae -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,220 mnist_classifier_MNISTClassifier xtrkghla 165eb897-b8f7-4c81-8522-43700a648452 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,221 mnist_classifier_MNISTClassifier xtrkghla 75426318-1119-40de-a6c9-af08f2dbe82d -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,222 mnist_classifier_MNISTClassifier xtrkghla d9100e2a-dd02-4d76-b374-33d9eeff85df -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,223 mnist_classifier_MNISTClassifier xtrkghla 77533ee9-37c4-4909-a1cb-151db4346882 -- POST / 200 221.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,231 mnist_classifier_MNISTClassifier xtrkghla 6b851349-fdd4-4812-bbf5-9efdf821f1af -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,233 mnist_classifier_MNISTClassifier xtrkghla c7a9c5d3-85f9-47de-b0c5-2a42c6514e07 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,235 mnist_classifier_MNISTClassifier xtrkghla 98a93155-9cf5-4560-a8f8-68b6bf1212a4 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,239 mnist_classifier_MNISTClassifier xtrkghla 254b749d-7300-4364-b872-2a2cb6f5b244 -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,240 mnist_classifier_MNISTClassifier xtrkghla ef3cfafa-ddbc-4e36-aba4-ac50da615c97 -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,241 mnist_classifier_MNISTClassifier xtrkghla e5b0309c-9060-4dd4-a695-5b4f52e549c9 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,242 mnist_classifier_MNISTClassifier xtrkghla 63369287-78fa-40c2-800d-37104302fe73 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,244 mnist_classifier_MNISTClassifier xtrkghla f7f15c36-07ec-4725-b9bf-ffde3d64d6f0 -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,245 mnist_classifier_MNISTClassifier xtrkghla 477a9105-42f4-4f3e-a3d4-ed98015c3e64 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,246 mnist_classifier_MNISTClassifier xtrkghla d420989b-c8ba-4cc7-aafb-eddb3bceddc6 -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,251 mnist_classifier_MNISTClassifier xtrkghla b238dbc5-4ecc-46aa-9d88-3f56cb7aee35 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,252 mnist_classifier_MNISTClassifier xtrkghla bacbcd4a-5609-4fc8-934d-996bdb799801 -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,253 mnist_classifier_MNISTClassifier xtrkghla 04be7cad-6f8d-458c-a2d3-f18038c056d4 -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,253 mnist_classifier_MNISTClassifier xtrkghla 4820d1c4-2482-4a20-9aec-c1a985c62ebf -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,253 mnist_classifier_MNISTClassifier xtrkghla 6dfc5756-ef26-4575-afef-a97dfe54f553 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,254 mnist_classifier_MNISTClassifier xtrkghla c2741d45-fbaa-4286-a203-b5be8019c909 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,254 mnist_classifier_MNISTClassifier xtrkghla d7eb0c58-7d9f-4774-86e1-42b54330d563 -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,254 mnist_classifier_MNISTClassifier xtrkghla 7c1a48d2-9063-4092-8d66-b2f587486510 -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,254 mnist_classifier_MNISTClassifier xtrkghla c8b24297-26c3-4565-b6e8-3f15dde00ca3 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,255 mnist_classifier_MNISTClassifier xtrkghla fea10394-06ef-4c43-8e40-a1bc0480272e -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,255 mnist_classifier_MNISTClassifier xtrkghla 72b250b2-910c-4f34-8883-a3d0d8700728 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,256 mnist_classifier_MNISTClassifier xtrkghla f0ba6801-3c36-4cd5-a84f-e5b98464bb72 -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,256 mnist_classifier_MNISTClassifier xtrkghla ac81b1b1-f085-4e3e-919d-8b2214f8013f -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,256 mnist_classifier_MNISTClassifier xtrkghla d6e25054-00c0-459f-81e6-6d7f936a9bfd -- POST / 200 227.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,258 mnist_classifier_MNISTClassifier xtrkghla 9113d6e3-eda0-4476-9813-4799e526573a -- POST / 200 228.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,259 mnist_classifier_MNISTClassifier xtrkghla 11d0307a-80fe-4036-a7c3-3331dcea6733 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,259 mnist_classifier_MNISTClassifier xtrkghla d0ff1a66-4d61-47be-8219-28e5a7607113 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,259 mnist_classifier_MNISTClassifier xtrkghla f5adada5-f0bd-4715-971b-10d0534778ad -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,260 mnist_classifier_MNISTClassifier xtrkghla 533d0061-c440-4b93-85b8-e9f40a206e48 -- POST / 200 227.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,340 mnist_classifier_MNISTClassifier xtrkghla 2ab7a620-d65f-4006-87d5-94973e395673 -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,343 mnist_classifier_MNISTClassifier xtrkghla ecd1dfad-86f1-4683-ac03-209ddd576d10 -- POST / 200 307.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,344 mnist_classifier_MNISTClassifier xtrkghla 8c8ae951-0eef-4f07-b7e2-d4f7120cc97a -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,345 mnist_classifier_MNISTClassifier xtrkghla fa02cfbe-6a7c-489a-a011-2a68ffa2fce7 -- POST / 200 306.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,347 mnist_classifier_MNISTClassifier xtrkghla b3f243cf-bf93-4e3b-ad44-591e6d6be01c -- POST / 200 309.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,348 mnist_classifier_MNISTClassifier xtrkghla 95f16036-1fd0-4073-94b9-e9fc25cad40e -- POST / 200 310.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,349 mnist_classifier_MNISTClassifier xtrkghla dbbf2f55-90b5-461e-94d9-8c3dfaedd256 -- POST / 200 311.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,351 mnist_classifier_MNISTClassifier xtrkghla 6a7d165f-b4d5-43f6-9c15-b9d1d34d80fc -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,354 mnist_classifier_MNISTClassifier xtrkghla ec379c69-c464-4fb5-a54b-ba99e5261d7c -- POST / 200 315.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,355 mnist_classifier_MNISTClassifier xtrkghla 7f677e16-9752-429f-9e48-ba49cf96834b -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,355 mnist_classifier_MNISTClassifier xtrkghla acd467f5-9373-4fc6-aab0-79591baa05d8 -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,359 mnist_classifier_MNISTClassifier xtrkghla 31eb9272-7a77-4de8-9d40-434afeffe715 -- POST / 200 314.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,361 mnist_classifier_MNISTClassifier xtrkghla ea9f027b-1fe5-4575-bdd6-2ce7594ec3e9 -- POST / 200 313.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,362 mnist_classifier_MNISTClassifier xtrkghla 9a865b0b-2a5c-4f66-8ceb-7ffcecc7ef20 -- POST / 200 313.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,363 mnist_classifier_MNISTClassifier xtrkghla 54995473-3255-4794-84f7-9b53119ff63f -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,363 mnist_classifier_MNISTClassifier xtrkghla f69c47e8-1731-4569-b7ef-f6911d7ae707 -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,364 mnist_classifier_MNISTClassifier xtrkghla e7b34a64-4b2e-4f76-ae56-9c6e06cc4c25 -- POST / 200 311.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,364 mnist_classifier_MNISTClassifier xtrkghla 32911045-dabf-49cb-952e-66c27cdd34aa -- POST / 200 311.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,365 mnist_classifier_MNISTClassifier xtrkghla 1d0fb740-6d10-41fc-b8bc-efbb3ddd36cf -- POST / 200 311.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,365 mnist_classifier_MNISTClassifier xtrkghla 90be46b8-a57a-4182-90b7-a6e1d96786d1 -- POST / 200 310.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,374 mnist_classifier_MNISTClassifier xtrkghla 9637ab46-f3eb-4104-9358-d61e02eafe58 -- POST / 200 317.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,374 mnist_classifier_MNISTClassifier xtrkghla 7830da39-1a59-46b5-96cd-ac11297239bb -- POST / 200 317.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,375 mnist_classifier_MNISTClassifier xtrkghla 31d49395-7ad5-4d2a-aa75-8e320d860b77 -- POST / 200 317.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,376 mnist_classifier_MNISTClassifier xtrkghla 2b631ca3-9c32-4acc-a3b6-90e37c15ad45 -- POST / 200 318.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,376 mnist_classifier_MNISTClassifier xtrkghla de28eddd-b404-4b0d-a063-f9003f5d16ab -- POST / 200 317.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,380 mnist_classifier_MNISTClassifier xtrkghla 5d9abf78-0afc-46d5-9652-143e8baed53f -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,382 mnist_classifier_MNISTClassifier xtrkghla b00d7b88-7337-46b6-a031-1dad38b5e336 -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,383 mnist_classifier_MNISTClassifier xtrkghla 62880bf8-21b0-47da-b388-99849dee7e03 -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,386 mnist_classifier_MNISTClassifier xtrkghla 06c2e126-0dc9-4cca-a2d0-6d40b9b1d6dc -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,389 mnist_classifier_MNISTClassifier xtrkghla c848495c-8083-414b-a1bd-de36d3705bcb -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,390 mnist_classifier_MNISTClassifier xtrkghla 582dd8ad-90bd-4f61-bcd4-b2d3220dd815 -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,391 mnist_classifier_MNISTClassifier xtrkghla 393e932e-f6a9-41ec-82b9-e7b1f1337df7 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,392 mnist_classifier_MNISTClassifier xtrkghla b3caf3dd-b74b-48c9-975c-fad41baa55c2 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,393 mnist_classifier_MNISTClassifier xtrkghla 0ec1a3b3-b984-4af7-9d1d-8b994ee9d200 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,394 mnist_classifier_MNISTClassifier xtrkghla 68dcd282-ce3f-4d0d-81fe-f414cfeb019a -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,395 mnist_classifier_MNISTClassifier xtrkghla 985b15e1-a26a-4f48-9ebb-cdef51368eef -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,397 mnist_classifier_MNISTClassifier xtrkghla e35f31f2-f6b6-4576-b391-a01f30ce6e62 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,397 mnist_classifier_MNISTClassifier xtrkghla 7f7c339f-5d3b-4e0b-b5c0-874f3c7a979f -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,397 mnist_classifier_MNISTClassifier xtrkghla 2a7a0096-d690-4631-956e-8ae292cee889 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,398 mnist_classifier_MNISTClassifier xtrkghla a88565e0-096a-4fb3-a3e3-d085dc8a6057 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,399 mnist_classifier_MNISTClassifier xtrkghla 5fae4ea2-3e38-4b5c-b6d7-22172568a7e4 -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,406 mnist_classifier_MNISTClassifier xtrkghla 11fab5e3-cf44-437e-83e5-98a5463aa538 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,408 mnist_classifier_MNISTClassifier xtrkghla 234fd7bb-f1f9-4199-8f2e-3df07b5bf865 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,409 mnist_classifier_MNISTClassifier xtrkghla 203855a7-a106-4bfe-868b-1d29623417e2 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,410 mnist_classifier_MNISTClassifier xtrkghla 6261817b-86a0-4485-a048-28f89eb466c9 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,410 mnist_classifier_MNISTClassifier xtrkghla d3fbef23-9077-4314-ad16-24d6ca6d31d3 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,411 mnist_classifier_MNISTClassifier xtrkghla dd6da06c-327c-4f24-af77-f2b03bf22ac8 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,411 mnist_classifier_MNISTClassifier xtrkghla b5cc2390-db87-415c-b8e8-7be3c7853676 -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,412 mnist_classifier_MNISTClassifier xtrkghla aec181c2-5e52-4cc5-914a-307d0a9ae1e6 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,412 mnist_classifier_MNISTClassifier xtrkghla 8e909c46-8e38-401b-9cf7-adb32646f95a -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,412 mnist_classifier_MNISTClassifier xtrkghla e40e220d-7f3a-436e-b0cc-178870c9619e -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,644 mnist_classifier_MNISTClassifier xtrkghla 1c844c12-1390-48a5-9ab6-3a4756435711 -- POST / 200 375.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,648 mnist_classifier_MNISTClassifier xtrkghla da643560-77bc-4131-a6e2-0d89bd47f5fe -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,652 mnist_classifier_MNISTClassifier xtrkghla b7451810-55b1-4416-b32a-c9f0d743f5ad -- POST / 200 442.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,657 mnist_classifier_MNISTClassifier xtrkghla 1ed18f7a-d80a-4cf4-878f-17a2d4f41d50 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,658 mnist_classifier_MNISTClassifier xtrkghla 3062f04e-d7e5-4b53-b3c3-f302ac814001 -- POST / 200 407.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,658 mnist_classifier_MNISTClassifier xtrkghla b1970138-bb42-4ddf-99c8-568601319b62 -- POST / 200 408.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,659 mnist_classifier_MNISTClassifier xtrkghla e0dffbe9-7745-40b5-85ae-7db47c7c6a4f -- POST / 200 408.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,660 mnist_classifier_MNISTClassifier xtrkghla 73e95871-2e71-4142-a145-7dfaf4e27d73 -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,661 mnist_classifier_MNISTClassifier xtrkghla 2ee1f884-2027-4dfa-a905-198b808f8a52 -- POST / 200 393.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,661 mnist_classifier_MNISTClassifier xtrkghla 3d38e57a-998c-434d-82c8-59b108dfcd41 -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,662 mnist_classifier_MNISTClassifier xtrkghla 0f74e1c8-686f-48b6-b1b8-532b39e8f135 -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,663 mnist_classifier_MNISTClassifier xtrkghla 37145be0-dc3e-46f4-8fb9-9a946d2a4af1 -- POST / 200 392.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,663 mnist_classifier_MNISTClassifier xtrkghla 9a37f11e-465e-4256-b06b-77e420590790 -- POST / 200 392.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,664 mnist_classifier_MNISTClassifier xtrkghla 234022b8-3db5-4c6b-b1c7-051c28893da7 -- POST / 200 391.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,665 mnist_classifier_MNISTClassifier xtrkghla 5969b407-4d0a-45c4-a96c-4885a3916e43 -- POST / 200 392.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,666 mnist_classifier_MNISTClassifier xtrkghla 4fb5ba87-b768-460a-b9dd-5cde937a4886 -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,666 mnist_classifier_MNISTClassifier xtrkghla 6ffaec51-6876-4972-a2bf-e5edd3877c1b -- POST / 200 391.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,666 mnist_classifier_MNISTClassifier xtrkghla 34176d7e-543c-4c04-bb01-e66af16579f2 -- POST / 200 387.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,667 mnist_classifier_MNISTClassifier xtrkghla 57faa227-f7b0-43ce-a5b9-68111d2e5a8d -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,667 mnist_classifier_MNISTClassifier xtrkghla 34d54bee-d9ee-40fd-9184-019d5d00c478 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,667 mnist_classifier_MNISTClassifier xtrkghla 95d6aa6b-d02b-4a3a-bce5-d883e26c99cb -- POST / 200 384.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,668 mnist_classifier_MNISTClassifier xtrkghla fac2dff8-b9d5-43c3-b2b7-e29c7d8fc483 -- POST / 200 381.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,669 mnist_classifier_MNISTClassifier xtrkghla cc03b091-fc94-41c4-a692-b198e68f0978 -- POST / 200 380.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,670 mnist_classifier_MNISTClassifier xtrkghla 5406b7ae-5feb-4d07-a4ee-6813c1073c3a -- POST / 200 384.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,670 mnist_classifier_MNISTClassifier xtrkghla ef3d9ded-1b89-4684-abe7-e8c804f0b80e -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,671 mnist_classifier_MNISTClassifier xtrkghla cfb7bba3-2fd8-4ad1-869e-fa187e20ad20 -- POST / 200 384.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,671 mnist_classifier_MNISTClassifier xtrkghla 91b86a61-45cd-44f6-890b-eb2c4b3109ca -- POST / 200 385.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,673 mnist_classifier_MNISTClassifier xtrkghla d1dcc3e8-0c68-46ec-844a-4f6ca9203258 -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,673 mnist_classifier_MNISTClassifier xtrkghla e20571e9-6e53-450b-9c4e-3c41ece8c154 -- POST / 200 382.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,674 mnist_classifier_MNISTClassifier xtrkghla ca431397-8acb-4f0c-a0e7-bfa985c0ff60 -- POST / 200 382.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,674 mnist_classifier_MNISTClassifier xtrkghla 70dc00d0-6ca5-4101-8cd0-edb7e85a4520 -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,675 mnist_classifier_MNISTClassifier xtrkghla 5c9cc4bf-32bf-4213-95f3-c370fa18d74f -- POST / 200 382.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,675 mnist_classifier_MNISTClassifier xtrkghla 923526da-4b1d-4e03-990c-f9872e66099c -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,807 mnist_classifier_MNISTClassifier xtrkghla 64ebdf96-d0ad-4d80-9658-4cc46e04aac7 -- POST / 200 513.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,808 mnist_classifier_MNISTClassifier xtrkghla f6e1de71-5ebd-421c-b732-08b25f4ca9c6 -- POST / 200 514.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,809 mnist_classifier_MNISTClassifier xtrkghla ad6bb845-630d-4475-b685-842aca7a4cf0 -- POST / 200 507.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,809 mnist_classifier_MNISTClassifier xtrkghla 1626ab7d-819b-4bdb-b99e-0958ec7a47d7 -- POST / 200 508.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,810 mnist_classifier_MNISTClassifier xtrkghla c27d35d0-6fd1-42bf-89b0-11bedb656cbf -- POST / 200 511.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,811 mnist_classifier_MNISTClassifier xtrkghla 53dd6fd0-b975-4a11-a690-b898758ef0ce -- POST / 200 509.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,811 mnist_classifier_MNISTClassifier xtrkghla c508f597-cf75-40be-8466-04347d5325bb -- POST / 200 507.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,812 mnist_classifier_MNISTClassifier xtrkghla 757076e2-3531-45de-bd3e-f0c5aab601ec -- POST / 200 506.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,812 mnist_classifier_MNISTClassifier xtrkghla 09a0406e-762d-4d83-95f3-c64e2aaffcd7 -- POST / 200 503.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,813 mnist_classifier_MNISTClassifier xtrkghla d77bfa5b-b962-4a8b-ab7e-865c106e89b5 -- POST / 200 504.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,813 mnist_classifier_MNISTClassifier xtrkghla 0289ea48-d956-4e26-ae9e-f2ce3b0708f0 -- POST / 200 504.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,817 mnist_classifier_MNISTClassifier xtrkghla 40c5dfa1-e821-4ca0-bad6-65b4c4e24150 -- POST / 200 503.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,818 mnist_classifier_MNISTClassifier xtrkghla cf481a34-e49d-4847-b122-53636de1a3e3 -- POST / 200 505.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,818 mnist_classifier_MNISTClassifier xtrkghla 03054811-92cc-49f8-94a9-3740783614f2 -- POST / 200 505.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,819 mnist_classifier_MNISTClassifier xtrkghla f0bbbbc2-1bbc-4b66-a13c-4445ded1f839 -- POST / 200 501.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,819 mnist_classifier_MNISTClassifier xtrkghla 017c547a-39e9-4767-b0c9-e4fcaa636b6a -- POST / 200 501.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,819 mnist_classifier_MNISTClassifier xtrkghla 148a788b-5a39-4ca4-81db-609639d1f671 -- POST / 200 426.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,820 mnist_classifier_MNISTClassifier xtrkghla 6460b055-dff6-4f2d-bc29-e4b04c4dd672 -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,820 mnist_classifier_MNISTClassifier xtrkghla 53151cd2-1374-4183-880e-e41a37e4ef45 -- POST / 200 410.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,820 mnist_classifier_MNISTClassifier xtrkghla e890cfeb-f3c2-44a7-87b3-8f175a1679ad -- POST / 200 410.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,821 mnist_classifier_MNISTClassifier xtrkghla b27ab01c-5bb3-4808-b1c6-0fa673004122 -- POST / 200 406.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,821 mnist_classifier_MNISTClassifier xtrkghla dea45d97-ffb4-4d8b-962f-170309c240c3 -- POST / 200 401.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,821 mnist_classifier_MNISTClassifier xtrkghla d2a85abe-68ed-4c16-98d9-fc1843ff63f1 -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,822 mnist_classifier_MNISTClassifier xtrkghla 8577a205-fc37-4a2c-925f-2d931bb47d40 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,822 mnist_classifier_MNISTClassifier xtrkghla 77f4d418-5152-4386-a193-7633d1b2d2f9 -- POST / 200 397.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,822 mnist_classifier_MNISTClassifier xtrkghla 9f9b51a4-5b77-4995-b0d4-37cbf3274b13 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,822 mnist_classifier_MNISTClassifier xtrkghla 545bc56b-5bc6-4726-8d19-5fe774f3bcc3 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,823 mnist_classifier_MNISTClassifier xtrkghla f29d349b-1ade-4c3d-bc75-241e46943492 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,823 mnist_classifier_MNISTClassifier xtrkghla cdcf146f-931b-4016-8c29-053b7134f250 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,825 mnist_classifier_MNISTClassifier xtrkghla 9ea7338b-dd10-40e6-bd7c-36afdf4f74cb -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,825 mnist_classifier_MNISTClassifier xtrkghla 74b291bf-77a7-4e3f-a000-0523e61d6377 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,826 mnist_classifier_MNISTClassifier xtrkghla ab444dc3-703e-4a71-877f-05e697a5d474 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,828 mnist_classifier_MNISTClassifier xtrkghla d21eed50-9991-45f4-bf5a-f90fc15b54fe -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,832 mnist_classifier_MNISTClassifier xtrkghla 62e94fc5-bf33-4d84-94d1-d493e36b297e -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,833 mnist_classifier_MNISTClassifier xtrkghla fb671900-940d-46aa-b76d-e02ffcb0b143 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,834 mnist_classifier_MNISTClassifier xtrkghla d6da7c65-1a88-48dc-ae3e-1dea8d08fde1 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,834 mnist_classifier_MNISTClassifier xtrkghla c695bb32-718e-46ca-bd71-c92e738b5163 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,834 mnist_classifier_MNISTClassifier xtrkghla 2864901b-9bc7-4b04-b1e2-b586bb6a8570 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,834 mnist_classifier_MNISTClassifier xtrkghla 72c00830-c4b2-4250-a773-a135edd2efee -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,835 mnist_classifier_MNISTClassifier xtrkghla b9c108b9-0d82-4db0-a204-a314e4e7bf5e -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,835 mnist_classifier_MNISTClassifier xtrkghla e0835065-2503-4c65-a745-24cba35810be -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,835 mnist_classifier_MNISTClassifier xtrkghla 72e1ce1c-eb51-4401-be2d-58fd1aa4988a -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,835 mnist_classifier_MNISTClassifier xtrkghla d9c76e92-0ec9-458c-843a-5e5690792909 -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,835 mnist_classifier_MNISTClassifier xtrkghla 924b6c00-147b-4f7a-9869-421d28b93e52 -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,835 mnist_classifier_MNISTClassifier xtrkghla 70c80770-f0df-4a85-a1c0-d2a661201d9f -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,836 mnist_classifier_MNISTClassifier xtrkghla bacba374-b3dd-460e-acfb-98cdfc10bd2a -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,836 mnist_classifier_MNISTClassifier xtrkghla 48c9f6f8-febf-4960-9d2c-fb2cd7f5e98d -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,837 mnist_classifier_MNISTClassifier xtrkghla ce9c124c-dfef-4c25-ae39-6b4d9b0f1707 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,837 mnist_classifier_MNISTClassifier xtrkghla 8329f20d-3864-4a28-9d3b-29ce579ed07a -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,839 mnist_classifier_MNISTClassifier xtrkghla 34f527e0-f592-43fc-867f-d15c0b9835d3 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,843 mnist_classifier_MNISTClassifier xtrkghla 40bcef2c-10eb-40dd-8f8c-01865a865188 -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,846 mnist_classifier_MNISTClassifier xtrkghla d39ce6f9-1e09-4510-8f79-1cec0c55d2c6 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,852 mnist_classifier_MNISTClassifier xtrkghla 981b7e98-1bc6-4dbc-ab6c-3e20e916aab9 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,853 mnist_classifier_MNISTClassifier xtrkghla 12617cd0-3443-4526-af28-59affbbdde43 -- POST / 200 220.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,853 mnist_classifier_MNISTClassifier xtrkghla 1e07ccc6-d3cd-4c13-8d2e-45538c09a09e -- POST / 200 177.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,854 mnist_classifier_MNISTClassifier xtrkghla e3337f63-2ed6-4fbe-bf59-b3133f817d8d -- POST / 200 174.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,855 mnist_classifier_MNISTClassifier xtrkghla 0801922e-f7c3-44b8-9af9-485fd94eecdc -- POST / 200 173.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,856 mnist_classifier_MNISTClassifier xtrkghla 9673cd6f-b396-4c90-9d0f-3c21bacbd622 -- POST / 200 174.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,856 mnist_classifier_MNISTClassifier xtrkghla 44a0d9a8-56fb-491d-9ecd-915713b74673 -- POST / 200 174.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,857 mnist_classifier_MNISTClassifier xtrkghla f6854282-56a4-4b7f-96c7-871a42f49d52 -- POST / 200 170.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,857 mnist_classifier_MNISTClassifier xtrkghla 045d7bc3-102a-48f6-9c1f-93019773756d -- POST / 200 171.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,857 mnist_classifier_MNISTClassifier xtrkghla 88b2ace2-afd5-4e90-9de3-9f2ec5892ca4 -- POST / 200 168.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,859 mnist_classifier_MNISTClassifier xtrkghla a4d21370-a25f-4649-a0bd-18ff5848d1ce -- POST / 200 170.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,860 mnist_classifier_MNISTClassifier xtrkghla df28f0f0-b3e4-419c-8039-c148f82fffe7 -- POST / 200 169.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,861 mnist_classifier_MNISTClassifier xtrkghla fb6a2b44-8051-4ae6-a988-f245dec52481 -- POST / 200 170.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,862 mnist_classifier_MNISTClassifier xtrkghla b40dac1f-d0c8-454a-b28d-2f8fa57d29e3 -- POST / 200 170.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,862 mnist_classifier_MNISTClassifier xtrkghla ee0c4317-e65a-4a59-a267-958c45154b3a -- POST / 200 170.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,862 mnist_classifier_MNISTClassifier xtrkghla cae8b049-ab4c-45a3-a7dd-29caa6ac5b02 -- POST / 200 169.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,867 mnist_classifier_MNISTClassifier xtrkghla 679a76e5-d92b-42bf-96f0-6e8eb0e16cb6 -- POST / 200 174.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,869 mnist_classifier_MNISTClassifier xtrkghla e2e18b48-6ba3-442d-81a9-c41704031e2f -- POST / 200 175.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,870 mnist_classifier_MNISTClassifier xtrkghla 8c578989-3221-49c2-8582-2b3ca4a9ddeb -- POST / 200 176.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,871 mnist_classifier_MNISTClassifier xtrkghla 870322de-5ffb-43c7-8932-292fa07cb16c -- POST / 200 175.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,871 mnist_classifier_MNISTClassifier xtrkghla fcc9373f-9722-4180-856d-d481f1458777 -- POST / 200 176.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,873 mnist_classifier_MNISTClassifier xtrkghla fe9fba6d-2df4-4dc7-b960-93b86e41df5f -- POST / 200 172.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,873 mnist_classifier_MNISTClassifier xtrkghla 8934f568-6042-4afd-a3be-1ad8208183c4 -- POST / 200 171.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,873 mnist_classifier_MNISTClassifier xtrkghla 3870339b-89d9-464f-af13-07adb9b7a6c5 -- POST / 200 170.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,873 mnist_classifier_MNISTClassifier xtrkghla bc4592e2-f7a6-4601-b044-a642c0bf0850 -- POST / 200 169.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,874 mnist_classifier_MNISTClassifier xtrkghla 448ff38c-d79e-45c2-950d-d085953c1124 -- POST / 200 168.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,874 mnist_classifier_MNISTClassifier xtrkghla 243a099a-ab7e-411c-8710-2ba5a9379416 -- POST / 200 168.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,875 mnist_classifier_MNISTClassifier xtrkghla 11c11296-194a-44c6-91d4-2adc05509b32 -- POST / 200 283.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,876 mnist_classifier_MNISTClassifier xtrkghla 344e934a-e2c3-43d9-b592-744fee3490fd -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,877 mnist_classifier_MNISTClassifier xtrkghla 1ad1927e-cadf-4942-b65d-e31a7f8b9302 -- POST / 200 284.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,877 mnist_classifier_MNISTClassifier xtrkghla cb5ffb30-193b-4d8e-831c-6b159c7054cd -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,877 mnist_classifier_MNISTClassifier xtrkghla 86041b03-0892-42a2-87c8-2b5db442c95a -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,878 mnist_classifier_MNISTClassifier xtrkghla d10a48a5-f1f3-41a1-925b-e38739c715a5 -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,878 mnist_classifier_MNISTClassifier xtrkghla c96b91d9-f703-44a5-bafa-5267b7d13c2a -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,878 mnist_classifier_MNISTClassifier xtrkghla 8fa984af-ecbd-42d1-9fd2-7299e863581e -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,879 mnist_classifier_MNISTClassifier xtrkghla 0ece5c83-f4ce-4705-be2a-5283c351947b -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,879 mnist_classifier_MNISTClassifier xtrkghla 9d53dec7-3205-4e04-a8c1-8a5294367c58 -- POST / 200 281.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,879 mnist_classifier_MNISTClassifier xtrkghla e8daafff-6944-44ab-826f-f6304dfe1880 -- POST / 200 281.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,880 mnist_classifier_MNISTClassifier xtrkghla 511f8579-7903-418a-a299-203a51dd144d -- POST / 200 281.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,880 mnist_classifier_MNISTClassifier xtrkghla 08e4f7e8-fb4f-4aec-95e4-23cd5e3b87b8 -- POST / 200 280.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,880 mnist_classifier_MNISTClassifier xtrkghla a0ac411e-8c0e-4005-a45a-403717c5e5b3 -- POST / 200 278.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,881 mnist_classifier_MNISTClassifier xtrkghla e5e01b85-3ded-4c89-88fd-d72dc75bd795 -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,922 mnist_classifier_MNISTClassifier xtrkghla 976835f9-2b64-4dfb-a994-0cf5b59d187d -- POST / 200 212.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,965 mnist_classifier_MNISTClassifier xtrkghla 85089aaf-c176-41a3-959a-1969f40e3fb5 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,965 mnist_classifier_MNISTClassifier xtrkghla 2e60614a-d89f-4341-b683-a7b93fb2bbee -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,966 mnist_classifier_MNISTClassifier xtrkghla 6b444a48-a1fc-4f1a-8fd4-1af2df859a93 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,966 mnist_classifier_MNISTClassifier xtrkghla 4c33e177-807c-401b-bb66-34c82f4bf4e3 -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:49,966 mnist_classifier_MNISTClassifier xtrkghla 78e84b6b-7abb-479d-b340-1abdec820e3a -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,066 mnist_classifier_MNISTClassifier xtrkghla 99b13e8c-11ce-4d92-937a-a3eb73f7f6f2 -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,074 mnist_classifier_MNISTClassifier xtrkghla 068394f0-bb19-4a4d-9018-fb186369ab43 -- POST / 200 172.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,075 mnist_classifier_MNISTClassifier xtrkghla dbabd15b-a7a9-4525-b613-25d69485f870 -- POST / 200 176.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,075 mnist_classifier_MNISTClassifier xtrkghla c5983194-53a9-4f4c-a878-7eba1caf1f04 -- POST / 200 175.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,075 mnist_classifier_MNISTClassifier xtrkghla 7d1b97ef-c9a5-4b24-9b5c-5d442e666e9a -- POST / 200 174.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,075 mnist_classifier_MNISTClassifier xtrkghla 3b3ccda1-0d70-4bb4-a40c-a3d0d1beac14 -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,075 mnist_classifier_MNISTClassifier xtrkghla ec337ad3-d6e2-4144-95f0-2e694c14b689 -- POST / 200 187.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,076 mnist_classifier_MNISTClassifier xtrkghla b7b21862-69a9-4677-b5f3-f2bfbf1635c4 -- POST / 200 184.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,076 mnist_classifier_MNISTClassifier xtrkghla bd46aed2-4d81-4e6d-8212-75d4b0a6654f -- POST / 200 181.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,076 mnist_classifier_MNISTClassifier xtrkghla 8dbff493-b314-41f0-8a4c-42aa057c257b -- POST / 200 181.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,076 mnist_classifier_MNISTClassifier xtrkghla 434c1b5e-3c4e-4c51-9d86-9f2c6e173746 -- POST / 200 180.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,076 mnist_classifier_MNISTClassifier xtrkghla 46eabfad-0964-4a28-8272-51a6395cb0b1 -- POST / 200 178.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,076 mnist_classifier_MNISTClassifier xtrkghla 59047d7d-fb92-4d98-9e5f-27529d321576 -- POST / 200 178.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,077 mnist_classifier_MNISTClassifier xtrkghla f14c454a-ab5b-4edb-a8a4-6b2e43611d44 -- POST / 200 179.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,077 mnist_classifier_MNISTClassifier xtrkghla e23603bc-4cc3-4c10-ae2a-e7cfc14e1ac9 -- POST / 200 173.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,202 mnist_classifier_MNISTClassifier xtrkghla bf1d98d5-54e2-4634-b090-d6604f804096 -- POST / 200 298.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,206 mnist_classifier_MNISTClassifier xtrkghla 9f799e8e-20c5-41b9-a33c-3700077f1f17 -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,207 mnist_classifier_MNISTClassifier xtrkghla 84f00720-c6f7-4c03-8ffa-d5ce4d2572c2 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,208 mnist_classifier_MNISTClassifier xtrkghla 15e4fc72-46b0-4884-9fd0-bc764c4b46ea -- POST / 200 299.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,212 mnist_classifier_MNISTClassifier xtrkghla 59acb8df-12db-46a3-bcfd-6644ec88e35a -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,212 mnist_classifier_MNISTClassifier xtrkghla 6df65590-f80e-49db-a58b-8f83d2912223 -- POST / 200 301.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,215 mnist_classifier_MNISTClassifier xtrkghla 113eb0d0-98a2-4df1-bde4-2734bfc3f768 -- POST / 200 303.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,216 mnist_classifier_MNISTClassifier xtrkghla 7a9300e4-94e0-44f6-9906-5ccd17842050 -- POST / 200 303.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,216 mnist_classifier_MNISTClassifier xtrkghla 4b115b64-d943-457f-b40d-ea2e661e29c9 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,218 mnist_classifier_MNISTClassifier xtrkghla a77e63e7-26ba-40f8-a98d-a049d5ef0f44 -- POST / 200 305.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,219 mnist_classifier_MNISTClassifier xtrkghla 1a8b287c-53b9-4ca8-a97a-7db2d28fcab9 -- POST / 200 305.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,220 mnist_classifier_MNISTClassifier xtrkghla d052e9ff-50b6-4a01-b857-7b526aaea6e8 -- POST / 200 306.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,220 mnist_classifier_MNISTClassifier xtrkghla 47d7fe5b-8fc8-4992-99a4-ecec98e64849 -- POST / 200 305.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,221 mnist_classifier_MNISTClassifier xtrkghla e2b2b412-10f5-47e8-a7d4-dfa512a565fa -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,222 mnist_classifier_MNISTClassifier xtrkghla 8d5831fd-fcb7-45eb-b967-09487c9c4c00 -- POST / 200 304.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,224 mnist_classifier_MNISTClassifier xtrkghla 3db0bb64-b0b5-4327-8fe7-5b7ad7ce168f -- POST / 200 305.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,226 mnist_classifier_MNISTClassifier xtrkghla e0b224ae-b775-4575-b012-7cc04b59d662 -- POST / 200 307.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,232 mnist_classifier_MNISTClassifier xtrkghla 251256c1-b589-4018-92e0-21f1d53db7bd -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,233 mnist_classifier_MNISTClassifier xtrkghla 433ca14a-1c97-499d-ac86-0d57a094d1f2 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,234 mnist_classifier_MNISTClassifier xtrkghla 43d4ed49-5e63-4dd5-a647-87a12a7574a0 -- POST / 200 266.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,234 mnist_classifier_MNISTClassifier xtrkghla 4aa450b6-e4b0-4155-b486-faf6bac4274b -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,234 mnist_classifier_MNISTClassifier xtrkghla 0b6f3676-bee5-4606-be59-58f73e58c63b -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,237 mnist_classifier_MNISTClassifier xtrkghla dcffe06b-f399-4f27-bb53-8a4cebd15bef -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,238 mnist_classifier_MNISTClassifier xtrkghla c7d66b6d-4c3e-411a-aab2-03856c493c31 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,239 mnist_classifier_MNISTClassifier xtrkghla 4343fa9a-fa9a-45b3-b8fb-128dc0e5acef -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,240 mnist_classifier_MNISTClassifier xtrkghla 7b50738a-a6d8-4bd1-8529-a8b37f87f2d4 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,242 mnist_classifier_MNISTClassifier xtrkghla 98295b42-fa75-47e8-8e74-b151cd8128b5 -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,243 mnist_classifier_MNISTClassifier xtrkghla 74491854-4a26-446a-9a89-16a7fca67c74 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,243 mnist_classifier_MNISTClassifier xtrkghla 49562971-6da0-4e7a-bc94-39783f869701 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,249 mnist_classifier_MNISTClassifier xtrkghla 8523d534-82ff-4cc6-9c81-2b1a0bc5d4dd -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,249 mnist_classifier_MNISTClassifier xtrkghla 604f1ce8-266c-44af-8025-af4eb62b2705 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,250 mnist_classifier_MNISTClassifier xtrkghla e95ccda8-915b-4350-a34c-c44b4e0b10e3 -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,251 mnist_classifier_MNISTClassifier xtrkghla 979c1b3c-da33-49f3-8d9d-6f5f8ac50235 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,251 mnist_classifier_MNISTClassifier xtrkghla 61304b1c-fb93-4251-bddc-a751c10f9386 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,251 mnist_classifier_MNISTClassifier xtrkghla 3d700b95-62b9-45e3-814a-e5aaaec1d339 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,251 mnist_classifier_MNISTClassifier xtrkghla 5d7f149d-390d-4c54-99a3-1a5110141187 -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,251 mnist_classifier_MNISTClassifier xtrkghla 26cb622d-0595-44b7-8e8f-39baf1ccf880 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,252 mnist_classifier_MNISTClassifier xtrkghla 8079a5b5-e92a-4693-b1bf-d99c41c0c598 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,252 mnist_classifier_MNISTClassifier xtrkghla 6c8dcadd-efa7-4adf-a7bc-9803a23309e8 -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,252 mnist_classifier_MNISTClassifier xtrkghla 6d5a84bb-6bd3-4aca-a3c4-6b4111e8161b -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,253 mnist_classifier_MNISTClassifier xtrkghla b078497f-4ab1-4b42-b514-01c4ab7ea3e6 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,253 mnist_classifier_MNISTClassifier xtrkghla 1060b7e8-1f46-41be-94ed-41f2cb8ecbee -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,253 mnist_classifier_MNISTClassifier xtrkghla f45eb24e-9e38-4eda-9dcf-462f4eb6e1ac -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,253 mnist_classifier_MNISTClassifier xtrkghla 4b559541-0b65-4f82-b275-e38cad11a7a7 -- POST / 200 255.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,253 mnist_classifier_MNISTClassifier xtrkghla 614299d0-cc91-4d7b-bf66-31c210160a33 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,254 mnist_classifier_MNISTClassifier xtrkghla 22bfb50a-8b09-489b-8485-fde09faf5378 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,254 mnist_classifier_MNISTClassifier xtrkghla e4a52043-06af-45da-9b5d-74fad5a7f09b -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,254 mnist_classifier_MNISTClassifier xtrkghla daaf15c5-f82b-444b-8fa4-df8db8d45755 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,254 mnist_classifier_MNISTClassifier xtrkghla 8d15699a-e251-4215-940a-f7884ce7a198 -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,254 mnist_classifier_MNISTClassifier xtrkghla f264bed9-d30c-464c-b490-512aa694f7ad -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,254 mnist_classifier_MNISTClassifier xtrkghla caee82f7-891a-434d-bdb7-6cff3ff34484 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,255 mnist_classifier_MNISTClassifier xtrkghla fa41d2a2-ba37-44d1-825e-ddffc5f95950 -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,255 mnist_classifier_MNISTClassifier xtrkghla e4d89c93-0860-4cf0-9918-5a8073854014 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,255 mnist_classifier_MNISTClassifier xtrkghla 9ca854d1-868f-424f-a4ea-39665b586b91 -- POST / 200 247.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,255 mnist_classifier_MNISTClassifier xtrkghla b96d340f-5d38-4c19-ae85-f8ea9951c9e5 -- POST / 200 244.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,255 mnist_classifier_MNISTClassifier xtrkghla a3ad7394-74b1-491a-9cdb-4c901aae4ddd -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,255 mnist_classifier_MNISTClassifier xtrkghla dfd2272f-465a-4b5a-9387-6908534abd7d -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,256 mnist_classifier_MNISTClassifier xtrkghla 5907d54e-ff4a-4957-b780-d3cb652c9b28 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,256 mnist_classifier_MNISTClassifier xtrkghla bc6e05ae-1c2e-4c53-b1be-e57b23bae3f8 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,256 mnist_classifier_MNISTClassifier xtrkghla 643a4c32-1538-4a65-b934-fefcd83b6714 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,256 mnist_classifier_MNISTClassifier xtrkghla 5a0d015c-d8ea-4983-a0eb-7fd049aeec3c -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,311 mnist_classifier_MNISTClassifier xtrkghla ef605b7d-2eeb-4c76-b618-7eb821adf0ec -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,469 mnist_classifier_MNISTClassifier xtrkghla de143b0a-b456-424a-9bc0-a9dea8bf8361 -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,471 mnist_classifier_MNISTClassifier xtrkghla 25da40bf-b310-42cb-8ad1-100e2c18dd32 -- POST / 200 449.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,471 mnist_classifier_MNISTClassifier xtrkghla a94edac7-136f-4851-987b-946e13d3fc6c -- POST / 200 449.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,472 mnist_classifier_MNISTClassifier xtrkghla 0fa02eec-2578-43a2-adcb-da9d6afafc85 -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,472 mnist_classifier_MNISTClassifier xtrkghla 72a4e8d3-fdcd-45c8-a6e2-cc9a3882f980 -- POST / 200 446.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,473 mnist_classifier_MNISTClassifier xtrkghla e816186f-61b0-4363-bdf8-7a45d5a18ecf -- POST / 200 445.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,474 mnist_classifier_MNISTClassifier xtrkghla 8fe29d75-86b0-40b8-a26c-856e426288f6 -- POST / 200 445.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,474 mnist_classifier_MNISTClassifier xtrkghla 291a1fad-16bc-4026-8024-6df02a7a807f -- POST / 200 444.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,474 mnist_classifier_MNISTClassifier xtrkghla dd30d057-8431-4cc1-91f0-7e478952db62 -- POST / 200 444.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,475 mnist_classifier_MNISTClassifier xtrkghla 5f1a1e96-3b2e-4414-8f60-bcf0ee17abcb -- POST / 200 444.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,475 mnist_classifier_MNISTClassifier xtrkghla f94a83ae-0950-4f4f-9180-872ed7c00120 -- POST / 200 444.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,476 mnist_classifier_MNISTClassifier xtrkghla da1afac9-6d29-4eee-aa82-5853d1cee7df -- POST / 200 443.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,476 mnist_classifier_MNISTClassifier xtrkghla 6668103e-7154-48a2-9230-695f4edca6b2 -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,477 mnist_classifier_MNISTClassifier xtrkghla a8c7adac-676d-47c7-868d-8844e947d374 -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,477 mnist_classifier_MNISTClassifier xtrkghla 20eb975c-ee25-4aa2-ac78-083e640e842d -- POST / 200 437.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,479 mnist_classifier_MNISTClassifier xtrkghla b3ef530b-0831-416c-8aa3-a285e11b788e -- POST / 200 439.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,489 mnist_classifier_MNISTClassifier xtrkghla 90dfeb86-7f21-40cd-b0af-ef74658cf630 -- POST / 200 449.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,490 mnist_classifier_MNISTClassifier xtrkghla 7408304c-7a4c-4908-88bd-d2d660892cc8 -- POST / 200 395.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,490 mnist_classifier_MNISTClassifier xtrkghla fdcfce87-572a-4628-91bc-17af664c2ce6 -- POST / 200 394.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,491 mnist_classifier_MNISTClassifier xtrkghla 1e029b71-67f1-4977-9da0-b8c4b0b2f1e9 -- POST / 200 394.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,491 mnist_classifier_MNISTClassifier xtrkghla de743815-a997-4985-b08e-5ca04e84ad1b -- POST / 200 394.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,492 mnist_classifier_MNISTClassifier xtrkghla 51f05768-7275-4974-8ec7-88e9718c4add -- POST / 200 393.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,492 mnist_classifier_MNISTClassifier xtrkghla a49c6e63-3656-41a3-817c-1719f825a0c5 -- POST / 200 389.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,493 mnist_classifier_MNISTClassifier xtrkghla 44acb15a-698c-4e1f-abc6-abfd52ed8599 -- POST / 200 378.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,494 mnist_classifier_MNISTClassifier xtrkghla 4ea8e360-1ff2-4c78-b714-34fe49b7555e -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,494 mnist_classifier_MNISTClassifier xtrkghla d93c9a88-6cd4-44ea-be02-d6707ddc8651 -- POST / 200 369.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,495 mnist_classifier_MNISTClassifier xtrkghla f780b2c0-cbdb-4aa5-a69f-4a99e4f27e16 -- POST / 200 369.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,495 mnist_classifier_MNISTClassifier xtrkghla dd5ad9aa-2ab0-467d-916c-59f3120dea9d -- POST / 200 365.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,496 mnist_classifier_MNISTClassifier xtrkghla 8d589ab7-6cfc-4c91-a726-5ced73e91e6d -- POST / 200 364.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,498 mnist_classifier_MNISTClassifier xtrkghla 902babcc-e247-49c0-b7d2-16bad0380585 -- POST / 200 365.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,499 mnist_classifier_MNISTClassifier xtrkghla 93675ab0-0fce-47e2-8a1f-05eefc3fe474 -- POST / 200 365.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,499 mnist_classifier_MNISTClassifier xtrkghla 0e1a72e2-dd28-4d00-bfea-520e2e108903 -- POST / 200 364.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,499 mnist_classifier_MNISTClassifier xtrkghla 09e03fc6-ffd8-4077-b06b-b99c5be5e16c -- POST / 200 360.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,500 mnist_classifier_MNISTClassifier xtrkghla a59cbe8c-78ad-479e-ae9a-67e50bdd8cbb -- POST / 200 360.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,501 mnist_classifier_MNISTClassifier xtrkghla 948d7ffb-475b-4043-aab6-6726cfa2b0fc -- POST / 200 358.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,502 mnist_classifier_MNISTClassifier xtrkghla 3c2fdf16-3ca8-4790-90b1-1cea551b3346 -- POST / 200 358.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,503 mnist_classifier_MNISTClassifier xtrkghla 60432b00-d1f5-4714-b39b-30fb989a3ca4 -- POST / 200 359.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,503 mnist_classifier_MNISTClassifier xtrkghla 64840d55-c2f5-4c94-919a-8727735901c2 -- POST / 200 360.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,519 mnist_classifier_MNISTClassifier xtrkghla 5d793160-ad1e-4129-87ad-1f0b6bdcdef8 -- POST / 200 280.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,531 mnist_classifier_MNISTClassifier xtrkghla 228c5221-fca3-4691-a6dc-dcb464e91270 -- POST / 200 278.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,532 mnist_classifier_MNISTClassifier xtrkghla 9ceff5b3-55a6-45c8-90ac-766659cfc7a8 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,613 mnist_classifier_MNISTClassifier xtrkghla 2b3f9f5e-9822-421b-ad1d-f048dfecd889 -- POST / 200 351.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,614 mnist_classifier_MNISTClassifier xtrkghla 209d032f-2242-4391-a325-e438b2653a93 -- POST / 200 348.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,614 mnist_classifier_MNISTClassifier xtrkghla 5239eaee-f210-4d01-8558-d3ddb093c12e -- POST / 200 348.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,615 mnist_classifier_MNISTClassifier xtrkghla 11d3f05f-1d90-464d-b2da-8349db5b8c8b -- POST / 200 349.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,615 mnist_classifier_MNISTClassifier xtrkghla dca82b5f-f4cb-4ee9-98bc-a2a9f27d3606 -- POST / 200 349.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,616 mnist_classifier_MNISTClassifier xtrkghla f5e25586-9827-4e88-bb61-c48ac6698b85 -- POST / 200 349.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,616 mnist_classifier_MNISTClassifier xtrkghla 795d657f-acad-49c4-94e4-a65108bca2f4 -- POST / 200 348.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,617 mnist_classifier_MNISTClassifier xtrkghla 134b04de-bba3-428d-a0cb-583aa5a88bb9 -- POST / 200 344.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,618 mnist_classifier_MNISTClassifier xtrkghla 1ca01f5b-7288-4177-961c-6e9e9f297723 -- POST / 200 345.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,619 mnist_classifier_MNISTClassifier xtrkghla 17a86e66-c708-4b3b-b970-4f4f98abcf61 -- POST / 200 350.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,620 mnist_classifier_MNISTClassifier xtrkghla 9913e1c9-10d3-492b-bd21-d58c27f6a5e5 -- POST / 200 350.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,620 mnist_classifier_MNISTClassifier xtrkghla a81733ee-6591-4d9a-890d-d82ab762e021 -- POST / 200 350.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,621 mnist_classifier_MNISTClassifier xtrkghla 1651e559-6798-4daa-beeb-16eb8fb3af7f -- POST / 200 350.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,622 mnist_classifier_MNISTClassifier xtrkghla 70f7db13-1da4-481c-8bfc-6849e7c8f80a -- POST / 200 350.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,623 mnist_classifier_MNISTClassifier xtrkghla 53e5e233-b678-43c7-ba3d-b8c735f0add0 -- POST / 200 346.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,623 mnist_classifier_MNISTClassifier xtrkghla dd94d95e-13e8-4761-bb73-af19c7253325 -- POST / 200 348.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,624 mnist_classifier_MNISTClassifier xtrkghla 3d880919-540b-4d3a-967b-727af094397f -- POST / 200 343.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,624 mnist_classifier_MNISTClassifier xtrkghla 98d31964-5d46-47a5-bab9-ee67fda16777 -- POST / 200 341.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,624 mnist_classifier_MNISTClassifier xtrkghla 947e01c5-19e8-4462-9474-7a9fd413789a -- POST / 200 341.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,625 mnist_classifier_MNISTClassifier xtrkghla 58fbfcba-69fd-480a-8672-97010b402035 -- POST / 200 340.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,625 mnist_classifier_MNISTClassifier xtrkghla 20c7598c-5b85-4488-9e9f-dfe4c1e32e29 -- POST / 200 340.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,625 mnist_classifier_MNISTClassifier xtrkghla 3f325f89-c439-4f17-90b6-08b2a502400a -- POST / 200 337.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,626 mnist_classifier_MNISTClassifier xtrkghla 73292627-8bef-4dac-80d9-551c04e6d531 -- POST / 200 127.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,626 mnist_classifier_MNISTClassifier xtrkghla e51159b7-6ee3-4ba6-ac38-b850d11f3a78 -- POST / 200 123.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,626 mnist_classifier_MNISTClassifier xtrkghla 2fbe9017-4c20-43c8-8ac6-d7a4582d7af4 -- POST / 200 121.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,627 mnist_classifier_MNISTClassifier xtrkghla be70b728-14ca-4f19-86a7-2458a51ce7c0 -- POST / 200 123.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,627 mnist_classifier_MNISTClassifier xtrkghla 8e4f46f1-01f6-4f33-a52f-08635ae268ab -- POST / 200 121.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,628 mnist_classifier_MNISTClassifier xtrkghla 413f6085-6e9b-463f-8e9d-d8f828939553 -- POST / 200 123.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,628 mnist_classifier_MNISTClassifier xtrkghla 07c47379-f83e-43b0-aed5-4450c3d3e53e -- POST / 200 123.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,628 mnist_classifier_MNISTClassifier xtrkghla a387e81d-5f9f-433f-8b3e-b995222061ba -- POST / 200 122.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,629 mnist_classifier_MNISTClassifier xtrkghla 53b24671-d4ab-408b-ab5f-74742683c126 -- POST / 200 122.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,630 mnist_classifier_MNISTClassifier xtrkghla 639469a0-2e8e-4682-90cd-16d7f13fc1d2 -- POST / 200 118.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,630 mnist_classifier_MNISTClassifier xtrkghla dbdc84d2-53b7-4e10-8465-78b75f3c67f2 -- POST / 200 116.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,631 mnist_classifier_MNISTClassifier xtrkghla 7d18d022-8818-4dfd-8c9b-c241c7e06b7f -- POST / 200 94.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,631 mnist_classifier_MNISTClassifier xtrkghla 90339017-2287-412f-b547-641918ca53e9 -- POST / 200 96.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,632 mnist_classifier_MNISTClassifier xtrkghla 1297e2e6-ed34-486e-b002-941c70c47524 -- POST / 200 93.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,632 mnist_classifier_MNISTClassifier xtrkghla 1b14198f-136c-41e7-9c8e-476e3206aeaa -- POST / 200 94.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,633 mnist_classifier_MNISTClassifier xtrkghla 5c9e5faa-f9de-4795-b0b4-4fd7e0d122f6 -- POST / 200 91.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,633 mnist_classifier_MNISTClassifier xtrkghla e6acaf1e-2070-429e-b02b-b9f8e573da8d -- POST / 200 88.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5045) INFO 2026-09-30 22:26:50,634 mnist_classifier_MNISTClassifier xtrkghla 17c5e581-c378-4a1d-b12a-efb162606a19 -- POST / 200 88.9ms
Processed 1000 requests in 5.23 seconds
Throughput: 191.06 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.