Rate this Page

★ ★ ★ ★ ★

beginner/serving_tutorial

Run in Google Colab

Note

Go to the end to download the full example code.

Serve PyTorch models at scale with Ray Serve#

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs
How to configure an HTTP endpoint for the deployment using FastAPI
Enable dynamic request batching for higher throughput
Configure autoscaling and per-replica CPU/GPU resource allocation
Load test the service with concurrent requests and monitor it with the Ray dashboard
How Ray Serve deployments can self-heal from failures
Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

PyTorch v2.9+ and torchvision
Ray Serve (ray[serve]) v2.52.1+
A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup#

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model#

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment#

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation#

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests#

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-01 23:13:31,140 WARNING services.py:2137 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-01 23:13:31,345 INFO worker.py:2014 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2062: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4522) INFO 2026-04-01 23:13:33,812 proxy 172.17.0.2 -- Proxy starting on node 3479695eec93b774b850cab7f3b2d17ce8fd8da79d57280f3d8197b0 (HTTP port: 8000).
INFO 2026-04-01 23:13:33,881 serve 3836 -- Started Serve in namespace "serve".
(ServeController pid=4531) INFO 2026-04-01 23:13:33,894 controller 4531 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4531) INFO 2026-04-01 23:13:33,895 controller 4531 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4522) INFO 2026-04-01 23:13:33,877 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ProxyActor pid=4522) INFO 2026-04-01 23:13:33,898 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4522) INFO 2026-04-01 23:13:33,904 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f0b4c100d00>.
(ServeController pid=4531) INFO 2026-04-01 23:13:33,998 controller 4531 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4522) INFO 2026-04-01 23:13:37,817 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
INFO 2026-04-01 23:13:38,001 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,176 mnist_classifier_MNISTClassifier fww1veub 2dc40adf-33ef-4823-8cf9-0d067c49e06c -- POST / 200 534.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,177 mnist_classifier_MNISTClassifier fww1veub 27bcb17c-9cf7-4777-a026-f1c8fd9a5bc5 -- POST / 200 516.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,177 mnist_classifier_MNISTClassifier fww1veub 2e2afac3-18a1-422c-80a3-01d3ec88c05f -- POST / 200 516.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,179 mnist_classifier_MNISTClassifier fww1veub 3d651869-3336-4963-9a1d-809a8363a0d4 -- POST / 200 509.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,182 mnist_classifier_MNISTClassifier fww1veub 3052386c-ff7f-4c50-ac29-b56fa8f5db75 -- POST / 200 511.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,182 mnist_classifier_MNISTClassifier fww1veub 67a67c30-b407-4ea2-9492-de5df540654d -- POST / 200 510.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,186 mnist_classifier_MNISTClassifier fww1veub 77689ee0-0213-47a5-ae04-120d1fdd7cba -- POST / 200 514.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,189 mnist_classifier_MNISTClassifier fww1veub b2d9e9f0-5a3a-4bee-833a-7a26b8a8b21b -- POST / 200 513.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,189 mnist_classifier_MNISTClassifier fww1veub 5485f58a-c431-4349-8bfc-0e5cf24d11ff -- POST / 200 510.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,192 mnist_classifier_MNISTClassifier fww1veub 00c3ff57-b1fd-4424-b161-d03eb51d3648 -- POST / 200 512.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,195 mnist_classifier_MNISTClassifier fww1veub f3804f04-7cec-4999-8f2f-8497dffabbbd -- POST / 200 513.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,195 mnist_classifier_MNISTClassifier fww1veub 0bcc47a1-78d0-4c68-87fd-6475c311edb8 -- POST / 200 515.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,196 mnist_classifier_MNISTClassifier fww1veub 4bd978a0-6d3f-44a1-91eb-2954fdcb5fcc -- POST / 200 514.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,197 mnist_classifier_MNISTClassifier fww1veub 261af4a0-254c-4c24-b66c-413ea63bdc88 -- POST / 200 515.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,198 mnist_classifier_MNISTClassifier fww1veub 214839a7-0a23-432e-a75b-e7c600a6aa49 -- POST / 200 513.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,200 mnist_classifier_MNISTClassifier fww1veub 4b1ecda0-fd78-467e-a220-64f4d6cad82b -- POST / 200 513.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,202 mnist_classifier_MNISTClassifier fww1veub 4bbdd3ab-b565-4a1d-9a68-6152c73322d7 -- POST / 200 515.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,203 mnist_classifier_MNISTClassifier fww1veub ed02ece8-4c9e-487a-9ae1-a4d53ad61597 -- POST / 200 512.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,203 mnist_classifier_MNISTClassifier fww1veub b648a7af-bbc5-4405-99e0-58b4caf75f25 -- POST / 200 512.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,204 mnist_classifier_MNISTClassifier fww1veub b6b421fd-0aed-421b-9753-b05cf47e00a4 -- POST / 200 511.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,204 mnist_classifier_MNISTClassifier fww1veub 8a8c2df8-395c-4506-985c-109cda90eb45 -- POST / 200 511.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,206 mnist_classifier_MNISTClassifier fww1veub 5dd5b3a1-8a85-433c-9a6c-f84768535fbf -- POST / 200 512.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,207 mnist_classifier_MNISTClassifier fww1veub 200e3e76-4740-46e6-a3c6-72df26eded17 -- POST / 200 512.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,332 mnist_classifier_MNISTClassifier fww1veub 12930046-e4d8-4af4-bf41-a312e4edd14a -- POST / 200 637.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,332 mnist_classifier_MNISTClassifier fww1veub 55442a6e-183c-4ff4-8dca-8ab5b04efb9e -- POST / 200 637.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,333 mnist_classifier_MNISTClassifier fww1veub cdb2bbed-16f8-4748-b7cb-54506bf6052e -- POST / 200 637.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,333 mnist_classifier_MNISTClassifier fww1veub 0524fb8b-2094-4604-a503-01151a484f43 -- POST / 200 638.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,334 mnist_classifier_MNISTClassifier fww1veub 5113f452-cbee-41d8-a518-654a319e6901 -- POST / 200 635.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,335 mnist_classifier_MNISTClassifier fww1veub 18f813a2-5f2f-4c4d-9564-029c95ba88a7 -- POST / 200 635.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,335 mnist_classifier_MNISTClassifier fww1veub 9e3c73e1-c1de-471a-9455-d9a5740427f4 -- POST / 200 634.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,336 mnist_classifier_MNISTClassifier fww1veub b6df7192-d0e8-4174-b68b-bb010e2df41f -- POST / 200 634.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,337 mnist_classifier_MNISTClassifier fww1veub 29c83c25-a17c-41c4-a933-e6d03bd06e2f -- POST / 200 634.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,337 mnist_classifier_MNISTClassifier fww1veub f619faa1-4834-49e9-b22f-81522beb32c6 -- POST / 200 634.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,338 mnist_classifier_MNISTClassifier fww1veub a6f87c75-3c63-4392-a93e-cde40ca353f7 -- POST / 200 634.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,338 mnist_classifier_MNISTClassifier fww1veub 9ce40fb6-3eb0-4b19-adc5-37f03f9b84c7 -- POST / 200 634.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,340 mnist_classifier_MNISTClassifier fww1veub 4f90e661-c2b5-4001-852c-d20478675bfa -- POST / 200 633.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,340 mnist_classifier_MNISTClassifier fww1veub 6389888d-cd4f-43f7-8732-a8b0cd700c93 -- POST / 200 634.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,341 mnist_classifier_MNISTClassifier fww1veub c7e052ad-f206-4fd2-bcd7-71086b43f317 -- POST / 200 632.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,342 mnist_classifier_MNISTClassifier fww1veub e02c8709-96e3-4ae0-bb48-90daa7055c17 -- POST / 200 633.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,342 mnist_classifier_MNISTClassifier fww1veub a81d4655-62f7-46c2-8992-6787cb424f6d -- POST / 200 633.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,343 mnist_classifier_MNISTClassifier fww1veub 17b1788a-a684-4495-867c-43f3fdffcc7b -- POST / 200 633.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,344 mnist_classifier_MNISTClassifier fww1veub a5a3ed75-223c-481a-ad01-5e5b620c64a4 -- POST / 200 633.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,344 mnist_classifier_MNISTClassifier fww1veub 20cde85b-382e-4d5f-b8ba-f4983843537e -- POST / 200 632.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,344 mnist_classifier_MNISTClassifier fww1veub 88bc087a-de5b-4dad-8d73-c76230772a42 -- POST / 200 631.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,347 mnist_classifier_MNISTClassifier fww1veub ce009b9d-79b0-4dee-b36b-2871ae409b0b -- POST / 200 631.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,348 mnist_classifier_MNISTClassifier fww1veub 5012e11e-d3eb-4e9a-b29e-f0902352e802 -- POST / 200 631.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,348 mnist_classifier_MNISTClassifier fww1veub 314613c2-d804-4fe8-94af-3fdff978d078 -- POST / 200 631.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,349 mnist_classifier_MNISTClassifier fww1veub cb638c8e-f2c3-4c60-a652-cc29124c41c5 -- POST / 200 627.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,349 mnist_classifier_MNISTClassifier fww1veub 1c2fcae5-addf-436b-b1f5-9d93e354266d -- POST / 200 627.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,350 mnist_classifier_MNISTClassifier fww1veub 86e8805d-937e-4cc8-9d19-1f6b2c0c7739 -- POST / 200 626.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,350 mnist_classifier_MNISTClassifier fww1veub 384caddb-8a23-43f1-887f-bae77ab4f75d -- POST / 200 619.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,350 mnist_classifier_MNISTClassifier fww1veub ebb00f30-272e-44b5-9f32-3dc3192957c7 -- POST / 200 625.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,350 mnist_classifier_MNISTClassifier fww1veub a1539105-0de6-4f6e-bf20-89716ddbc3da -- POST / 200 625.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,350 mnist_classifier_MNISTClassifier fww1veub 24e44679-d8c2-4241-8fda-53c0ccd5bf87 -- POST / 200 625.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,351 mnist_classifier_MNISTClassifier fww1veub 724f5e00-8d10-4735-9acf-163ae0469026 -- POST / 200 625.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,353 mnist_classifier_MNISTClassifier fww1veub aa3f9e3a-4b79-47d3-b291-09d8eaf80a35 -- POST / 200 626.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,353 mnist_classifier_MNISTClassifier fww1veub e31894f4-d764-4ffe-88d3-6395185c274b -- POST / 200 625.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,356 mnist_classifier_MNISTClassifier fww1veub 9e19fb2a-e6b8-4620-98aa-d59d80a6a4ea -- POST / 200 625.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,356 mnist_classifier_MNISTClassifier fww1veub f13493fd-ea59-44d7-b4c6-489a4307c3d3 -- POST / 200 626.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,356 mnist_classifier_MNISTClassifier fww1veub 7beaeb67-c5dd-4ff1-9f84-395f86d25a34 -- POST / 200 624.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,357 mnist_classifier_MNISTClassifier fww1veub 821cca1e-fb42-4fec-ad28-34fda5f71a0f -- POST / 200 624.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,358 mnist_classifier_MNISTClassifier fww1veub 4e5a329d-dae2-42a4-97d9-c2f3be1ef9eb -- POST / 200 624.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,359 mnist_classifier_MNISTClassifier fww1veub d1304de1-b60a-4db5-9978-e29f1f45dfcf -- POST / 200 625.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,361 mnist_classifier_MNISTClassifier fww1veub 1f758b4a-4be2-47cb-8864-82667db17649 -- POST / 200 624.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,362 mnist_classifier_MNISTClassifier fww1veub ba939d72-15c7-41d4-926b-8752d6ebcb5d -- POST / 200 624.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,362 mnist_classifier_MNISTClassifier fww1veub d084546e-d457-4b8e-85a6-1d98b02f9fcc -- POST / 200 623.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,363 mnist_classifier_MNISTClassifier fww1veub 6658a711-66ba-4d17-90f7-7fc527c9aef8 -- POST / 200 624.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,364 mnist_classifier_MNISTClassifier fww1veub fc7dd97e-fc95-4581-868c-9e050bc867cd -- POST / 200 624.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,364 mnist_classifier_MNISTClassifier fww1veub d6c8c230-a6c0-46fd-85ad-712f2bfdd654 -- POST / 200 622.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,365 mnist_classifier_MNISTClassifier fww1veub 8b100845-54bf-46d0-9fc8-e62aab30147e -- POST / 200 622.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,366 mnist_classifier_MNISTClassifier fww1veub 5c44cb4f-617c-4bb7-991a-a2c371340215 -- POST / 200 498.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,367 mnist_classifier_MNISTClassifier fww1veub a93ddcd2-d1bb-4132-8311-f6ffefe82eec -- POST / 200 495.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,434 mnist_classifier_MNISTClassifier fww1veub 881c6749-a5e8-4359-aa67-14f00359f6eb -- POST / 200 561.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,436 mnist_classifier_MNISTClassifier fww1veub b9ca75ef-d3b5-4c27-a8ed-d6cc9ba939eb -- POST / 200 562.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,441 mnist_classifier_MNISTClassifier fww1veub 32259b4b-6494-4132-8cbe-0dbb2465d984 -- POST / 200 566.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,443 mnist_classifier_MNISTClassifier fww1veub d78a6131-b2e2-487d-b47d-90f49be8b0da -- POST / 200 568.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,443 mnist_classifier_MNISTClassifier fww1veub f9c8f3e8-c486-4538-a4fc-ec1dc5acc40c -- POST / 200 568.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,445 mnist_classifier_MNISTClassifier fww1veub 7b0e5bab-8ff9-45b9-a04f-464c07669562 -- POST / 200 569.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,445 mnist_classifier_MNISTClassifier fww1veub 53d535d7-5bde-465f-b52f-bda8b8aa8de3 -- POST / 200 566.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,448 mnist_classifier_MNISTClassifier fww1veub 805289ad-81ae-41b6-97a3-ccf121f9570a -- POST / 200 572.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,448 mnist_classifier_MNISTClassifier fww1veub e1376186-0369-4a77-bd76-67ebe2c319e3 -- POST / 200 568.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,449 mnist_classifier_MNISTClassifier fww1veub 46cde147-6a98-4d5c-b404-96e7558917eb -- POST / 200 570.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,449 mnist_classifier_MNISTClassifier fww1veub a45c4fb1-a281-493c-9e62-3c9c72311e12 -- POST / 200 568.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,450 mnist_classifier_MNISTClassifier fww1veub d2f161c2-0301-4b01-a7b8-c98be3092eeb -- POST / 200 567.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,450 mnist_classifier_MNISTClassifier fww1veub 91207ad5-82f8-4394-bb19-2f6c02b8f2e3 -- POST / 200 566.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,450 mnist_classifier_MNISTClassifier fww1veub aebb5f20-d83f-43b8-92e6-2537fbe80178 -- POST / 200 567.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,453 mnist_classifier_MNISTClassifier fww1veub 808510f6-5c83-4713-b328-2bb2067e3b4c -- POST / 200 568.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,454 mnist_classifier_MNISTClassifier fww1veub 2fa0dc61-0493-4f38-9ecd-a809a2c70dc2 -- POST / 200 568.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,454 mnist_classifier_MNISTClassifier fww1veub 2fac0785-bc3e-4074-bc05-779c9e4f9580 -- POST / 200 568.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,454 mnist_classifier_MNISTClassifier fww1veub 41b99e9c-298e-48e1-a1bd-2d90f34e0a6f -- POST / 200 568.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,455 mnist_classifier_MNISTClassifier fww1veub b2598bad-c732-4c93-9ea3-da6344f751e4 -- POST / 200 569.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,458 mnist_classifier_MNISTClassifier fww1veub 032cc519-a78a-4a6b-bcca-06550e052e69 -- POST / 200 571.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,459 mnist_classifier_MNISTClassifier fww1veub 8b7f3f9f-5060-4382-935b-1be46feb5f94 -- POST / 200 571.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,460 mnist_classifier_MNISTClassifier fww1veub 2884aa45-e9e2-4fb7-87ea-4efb8c8fd491 -- POST / 200 572.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,461 mnist_classifier_MNISTClassifier fww1veub b67eae30-fd28-40bf-b394-0aaa4db9b6c2 -- POST / 200 573.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,461 mnist_classifier_MNISTClassifier fww1veub 4f316b7b-04d4-4396-925b-1e41fc224e84 -- POST / 200 572.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,462 mnist_classifier_MNISTClassifier fww1veub 5e66ff95-2bb1-45e8-8a7e-1b8745664c83 -- POST / 200 572.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,463 mnist_classifier_MNISTClassifier fww1veub 75737bcb-8c4f-495e-aaff-5e97536c38a7 -- POST / 200 573.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,464 mnist_classifier_MNISTClassifier fww1veub 21c19a40-a47e-40f0-8b5e-f9b111411e0f -- POST / 200 573.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,465 mnist_classifier_MNISTClassifier fww1veub 1c6e30ae-7eaa-4949-84b5-0d54c042fff1 -- POST / 200 574.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,466 mnist_classifier_MNISTClassifier fww1veub 0e87cad4-07d4-41a5-8eba-126de3011ce0 -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,467 mnist_classifier_MNISTClassifier fww1veub 5b054b4a-4ce8-4da3-b229-a68d68aa58dc -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,468 mnist_classifier_MNISTClassifier fww1veub 2f47eb01-4825-4b24-b491-72e8c67400d6 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,470 mnist_classifier_MNISTClassifier fww1veub 9f815cb0-bcde-4f9f-b798-66810c010c03 -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,471 mnist_classifier_MNISTClassifier fww1veub 6cb4e33b-1793-40d5-9cda-8374ef06fbfe -- POST / 200 282.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,476 mnist_classifier_MNISTClassifier fww1veub c5d3189e-c44c-4329-8c77-117b14227832 -- POST / 200 285.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,478 mnist_classifier_MNISTClassifier fww1veub ce4b35fd-9844-4716-96b8-7deb7056840d -- POST / 200 286.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,479 mnist_classifier_MNISTClassifier fww1veub dff595be-21d7-434e-81a7-2bc7561e89b9 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,479 mnist_classifier_MNISTClassifier fww1veub d669d8ad-b5b8-4483-a7a0-7dbd3ac491bb -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,479 mnist_classifier_MNISTClassifier fww1veub 65214066-c838-437d-bc68-b47b0f2f2590 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,480 mnist_classifier_MNISTClassifier fww1veub 7d1c637f-9862-4cb7-a5a7-adb7ad1309b5 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,480 mnist_classifier_MNISTClassifier fww1veub d0265233-b6b5-449b-a621-4ee33b426e81 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,480 mnist_classifier_MNISTClassifier fww1veub b5e9cfa8-f23b-4af0-b61c-6e045a6e8432 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,481 mnist_classifier_MNISTClassifier fww1veub db8ebaa9-69fc-4b26-b3a5-491ee65900cf -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,481 mnist_classifier_MNISTClassifier fww1veub ae72bb50-214a-4e68-b388-b603025fc615 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,482 mnist_classifier_MNISTClassifier fww1veub 75766407-d3c5-4d36-9f85-0cbf026cabc1 -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,483 mnist_classifier_MNISTClassifier fww1veub a1129f73-0adc-4223-8b65-e2bccd1c1c39 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,487 mnist_classifier_MNISTClassifier fww1veub 9e21d4a1-a055-42e5-aae2-f519bbe92415 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,488 mnist_classifier_MNISTClassifier fww1veub 5e87237a-0e7c-49fc-9d03-7eb554f7c8b6 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,488 mnist_classifier_MNISTClassifier fww1veub d6e9818c-0b75-4d0f-a00c-56a940d1d854 -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,488 mnist_classifier_MNISTClassifier fww1veub d849d3ea-de32-437a-b57d-897b326d00c6 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,488 mnist_classifier_MNISTClassifier fww1veub 179ec8c6-e9f5-495c-ba33-e9be64f182e7 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,489 mnist_classifier_MNISTClassifier fww1veub 1ea5f192-6f8c-456e-ae3c-080e655c8b61 -- POST / 200 237.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,569 mnist_classifier_MNISTClassifier fww1veub 5c781509-acae-4b96-a0cf-557f52daade0 -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,587 mnist_classifier_MNISTClassifier fww1veub 56db6e4b-931c-43ae-8408-9a14895fe680 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,589 mnist_classifier_MNISTClassifier fww1veub 4e3c5dd0-0b89-448d-acdf-04415d0f4f0a -- POST / 200 249.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,590 mnist_classifier_MNISTClassifier fww1veub d6819af8-b2c0-4134-8928-6b368067acf6 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,594 mnist_classifier_MNISTClassifier fww1veub bf2c511a-444a-49de-889b-60481cb13c86 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,595 mnist_classifier_MNISTClassifier fww1veub 50a137a6-98cb-47ca-82a4-33f65d4ba5a0 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,597 mnist_classifier_MNISTClassifier fww1veub 99aed792-b4ec-4671-8831-e52611776649 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,597 mnist_classifier_MNISTClassifier fww1veub a3000953-4c21-4789-9abc-8240180036c2 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,597 mnist_classifier_MNISTClassifier fww1veub a9499b38-5fcd-457f-ad11-f71e51f02235 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,598 mnist_classifier_MNISTClassifier fww1veub fdae7134-293b-4981-abc6-7f2e022a6f03 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,598 mnist_classifier_MNISTClassifier fww1veub 73fc52af-4c87-4b7d-a7d9-c8187ae48d74 -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,598 mnist_classifier_MNISTClassifier fww1veub 8ccb78ce-b74b-4e73-81ff-a9c2c6f79df3 -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,599 mnist_classifier_MNISTClassifier fww1veub e7e75499-bad7-484b-9b3b-140f2564e855 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,600 mnist_classifier_MNISTClassifier fww1veub 2968e375-b0a1-4cd0-b8bd-a53bc593f9ba -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,600 mnist_classifier_MNISTClassifier fww1veub 9620bf23-cbd9-4439-9d93-bdc9b89b15f2 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub 53477c84-875a-4996-bba6-f49630f07f94 -- POST / 200 227.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub 9b8255b8-5947-4f08-abd7-35fc6e439e72 -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub b478e515-66e1-4359-ab59-694571677131 -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub a98485ec-d29a-400b-b119-48d91b4b28a9 -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub f14d53fb-892d-4dda-b66f-cf35404b53bc -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub efbdb895-70ab-4f9c-8ea2-4edd3941039b -- POST / 200 210.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,601 mnist_classifier_MNISTClassifier fww1veub b03a3f34-12fe-4773-9761-866d56adae96 -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,602 mnist_classifier_MNISTClassifier fww1veub ca2d0927-76ca-4bed-9d26-9d6fb1b74ded -- POST / 200 208.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,602 mnist_classifier_MNISTClassifier fww1veub 02ed9977-c06b-4634-a4be-0f0fdfc0ecd0 -- POST / 200 208.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,602 mnist_classifier_MNISTClassifier fww1veub d9dd6998-3b5f-4c62-a1ed-ec036fa962db -- POST / 200 203.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,602 mnist_classifier_MNISTClassifier fww1veub 10be4238-9fd7-4f31-abf4-64a18a2aaed7 -- POST / 200 204.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,602 mnist_classifier_MNISTClassifier fww1veub 40bdf518-3d69-4968-88e7-89d82b314d84 -- POST / 200 203.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,602 mnist_classifier_MNISTClassifier fww1veub 4060bae9-cfe1-4901-8e5c-df5991a2dcb9 -- POST / 200 203.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,603 mnist_classifier_MNISTClassifier fww1veub a53b1869-113a-4eb6-844f-cb9af0cfc2e2 -- POST / 200 200.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,603 mnist_classifier_MNISTClassifier fww1veub bf00e40b-f968-4572-a8ba-e31f4998cabd -- POST / 200 199.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,603 mnist_classifier_MNISTClassifier fww1veub e9a64157-3c62-4cbd-b2cf-9206364c3aae -- POST / 200 197.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,603 mnist_classifier_MNISTClassifier fww1veub eb7a16d3-6e08-4f80-88c6-f691cd1776cf -- POST / 200 195.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,603 mnist_classifier_MNISTClassifier fww1veub 477a4083-4a7a-4fba-8547-51eee7bec1fe -- POST / 200 195.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,717 mnist_classifier_MNISTClassifier fww1veub 912a34ee-3fae-4618-93ca-61c788bfa27e -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,718 mnist_classifier_MNISTClassifier fww1veub b5922128-113e-4699-841c-aa065e80adde -- POST / 200 284.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,719 mnist_classifier_MNISTClassifier fww1veub b4cb08d4-88ab-4d12-8289-d3c15442e8a2 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,719 mnist_classifier_MNISTClassifier fww1veub b4e8855b-0890-4f7f-aba6-3c9da24cc683 -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,721 mnist_classifier_MNISTClassifier fww1veub 68ebfcf2-1394-432e-adba-a9f034a32460 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,721 mnist_classifier_MNISTClassifier fww1veub d0e43c74-730c-462f-b4bc-f8b0c3b1ca22 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,723 mnist_classifier_MNISTClassifier fww1veub 0a5b60b6-bc67-4fec-9901-8c0bc51a4c25 -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,726 mnist_classifier_MNISTClassifier fww1veub 4ae4f2f4-5c59-4b9c-afb1-07918c7635fb -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,727 mnist_classifier_MNISTClassifier fww1veub 8732ce16-537f-4bd8-928f-78c0b65eb06a -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,732 mnist_classifier_MNISTClassifier fww1veub 04ef8629-3bd8-4fb5-97d3-0d1a570b0bdc -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,733 mnist_classifier_MNISTClassifier fww1veub 105d2c0f-4b28-4cb3-ac34-d436996caa8e -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,733 mnist_classifier_MNISTClassifier fww1veub 653e13f8-9a46-41b2-90cc-edf29fecb2b8 -- POST / 200 268.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,736 mnist_classifier_MNISTClassifier fww1veub 278c18d2-7bec-44dc-8c59-d76df9132bda -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,737 mnist_classifier_MNISTClassifier fww1veub 53255cb6-e76b-4012-b5fa-aee1cb2c41a5 -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,738 mnist_classifier_MNISTClassifier fww1veub 4bce437e-4da4-48a3-8442-aa5b8e9286fb -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,739 mnist_classifier_MNISTClassifier fww1veub 01c93818-e937-4b8c-8d82-7b68a1d4d0a8 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,739 mnist_classifier_MNISTClassifier fww1veub 5c9723ff-ae1e-4e8d-b08c-b80ad5ae1075 -- POST / 200 273.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,739 mnist_classifier_MNISTClassifier fww1veub f042898a-34a3-4c58-a193-c1dde626f2ba -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,740 mnist_classifier_MNISTClassifier fww1veub 6bae46bf-981b-4184-8fa6-27e78154d1d1 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,741 mnist_classifier_MNISTClassifier fww1veub 1bbd3013-5cb4-43c7-a1e0-9c761a681f0c -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,748 mnist_classifier_MNISTClassifier fww1veub 71bcf4dc-fff9-4ac2-9c2f-ac95e674898f -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,749 mnist_classifier_MNISTClassifier fww1veub b3b469b7-ebd2-4480-92f8-a324d61d5514 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,761 mnist_classifier_MNISTClassifier fww1veub 822adb47-4974-4575-ab33-ab0e0acf382e -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,761 mnist_classifier_MNISTClassifier fww1veub 6abf6593-13d5-4e41-8280-4b5ea42b35ba -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,761 mnist_classifier_MNISTClassifier fww1veub 19001422-e855-4f5f-beb3-e271a7645ccb -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,762 mnist_classifier_MNISTClassifier fww1veub 48a64aaf-9709-4bd9-9978-4e44063ff84d -- POST / 200 255.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,763 mnist_classifier_MNISTClassifier fww1veub 65f060d1-125a-4680-afe8-960f0673517e -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,763 mnist_classifier_MNISTClassifier fww1veub e2224f25-70a2-410f-a38f-479fc26ae986 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,764 mnist_classifier_MNISTClassifier fww1veub 16876a18-58fd-4ac5-b5fa-b3be19ce2dba -- POST / 200 253.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,764 mnist_classifier_MNISTClassifier fww1veub 43b48682-ad63-4af3-9e0c-8843d33b0101 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,766 mnist_classifier_MNISTClassifier fww1veub e7e85958-20ee-4ef8-9b13-78ae852261e3 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,769 mnist_classifier_MNISTClassifier fww1veub dad7feab-1f21-4296-b344-f784dcf0af15 -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,853 mnist_classifier_MNISTClassifier fww1veub f24b618d-177a-4885-a116-536c9acb0d74 -- POST / 200 330.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,870 mnist_classifier_MNISTClassifier fww1veub 65643d13-48aa-4d9e-b6e0-0769c7506c4c -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,871 mnist_classifier_MNISTClassifier fww1veub 8f0f9056-7f37-4bab-a0cb-0c46dbc0514a -- POST / 200 354.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,872 mnist_classifier_MNISTClassifier fww1veub bb3edad5-e604-4f22-8419-d0d111990e36 -- POST / 200 354.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,872 mnist_classifier_MNISTClassifier fww1veub 9215e094-2d3f-4831-a4fa-a278665a3224 -- POST / 200 354.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,873 mnist_classifier_MNISTClassifier fww1veub 2be5d37b-321a-4549-b717-99a73d08630e -- POST / 200 343.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,874 mnist_classifier_MNISTClassifier fww1veub 5974d94c-37e4-4c85-ba84-178b91f7c8a9 -- POST / 200 343.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,875 mnist_classifier_MNISTClassifier fww1veub 0fc60f5c-e5b5-4994-a4c8-39c5ed525013 -- POST / 200 339.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,875 mnist_classifier_MNISTClassifier fww1veub 029ec1ab-a8a9-4a8a-a340-d5736e1dd1c8 -- POST / 200 344.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,875 mnist_classifier_MNISTClassifier fww1veub 73669e0c-37ca-41d4-be3e-fa586aa6f75b -- POST / 200 345.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,876 mnist_classifier_MNISTClassifier fww1veub de0e2c0f-e7a4-4a46-a44d-53df8ca1bd36 -- POST / 200 343.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,876 mnist_classifier_MNISTClassifier fww1veub 0cf38a77-9bd2-45a2-8b87-ab215eb40f54 -- POST / 200 343.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,877 mnist_classifier_MNISTClassifier fww1veub 71c9129c-e44b-45dd-aeaa-6ae24f7ccbfa -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,877 mnist_classifier_MNISTClassifier fww1veub c9bdafe1-bf9a-4beb-bd4e-d42e85f65972 -- POST / 200 343.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,877 mnist_classifier_MNISTClassifier fww1veub 71dfee5c-7ccd-479b-9861-33757312a888 -- POST / 200 343.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,877 mnist_classifier_MNISTClassifier fww1veub 2d016994-4b1a-4da1-935a-99d6b47cf68b -- POST / 200 342.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,878 mnist_classifier_MNISTClassifier fww1veub 3bc9e87c-9646-4358-9515-ffa8b32cc343 -- POST / 200 318.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,879 mnist_classifier_MNISTClassifier fww1veub 58ecb06b-92c0-497c-809d-d2fb72b74a8b -- POST / 200 273.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,879 mnist_classifier_MNISTClassifier fww1veub d4cfaa3f-0731-4ca4-931c-71830e8a33f7 -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,880 mnist_classifier_MNISTClassifier fww1veub b00c04de-7fc4-45a4-a632-3a28e15690b7 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,881 mnist_classifier_MNISTClassifier fww1veub 928fff49-1f9d-4b40-a367-4384703bf5bf -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,883 mnist_classifier_MNISTClassifier fww1veub 9484e1bd-dd68-450a-b726-6739ec94e2d4 -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,884 mnist_classifier_MNISTClassifier fww1veub 0821cc2d-7184-47eb-a169-e91019c8f5d4 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,885 mnist_classifier_MNISTClassifier fww1veub 20cdd906-c71a-4a60-acb7-19ab1f5d0442 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,886 mnist_classifier_MNISTClassifier fww1veub d0466243-7b98-4da0-9487-6c5b39f5799e -- POST / 200 273.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,888 mnist_classifier_MNISTClassifier fww1veub 0d3874d6-92c5-4a95-a34d-68ad6e371fc5 -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,888 mnist_classifier_MNISTClassifier fww1veub 0438bce8-8fa3-4d64-ac57-ba537923ab3d -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,889 mnist_classifier_MNISTClassifier fww1veub fbc24c84-5c09-4534-9358-ac7b5a4186fb -- POST / 200 275.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,904 mnist_classifier_MNISTClassifier fww1veub 80f84715-2de9-404d-999a-0613f1a102a8 -- POST / 200 290.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,905 mnist_classifier_MNISTClassifier fww1veub 01bec819-438b-4b78-9bb0-fecad0c6a131 -- POST / 200 290.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,906 mnist_classifier_MNISTClassifier fww1veub 483548b2-3292-4535-95d1-a0d54ca76310 -- POST / 200 290.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,907 mnist_classifier_MNISTClassifier fww1veub a336500e-4dc5-4584-9018-ea490773eacd -- POST / 200 291.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,908 mnist_classifier_MNISTClassifier fww1veub 02604c63-598b-40f8-b036-a90815450e7f -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,909 mnist_classifier_MNISTClassifier fww1veub 60b1689a-5c84-4349-86db-5e4546b87ca9 -- POST / 200 294.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,909 mnist_classifier_MNISTClassifier fww1veub 420b437b-70b6-4fe7-9475-193856028937 -- POST / 200 293.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,910 mnist_classifier_MNISTClassifier fww1veub 66e73f6b-4b27-47a2-b217-34d09b6f49bd -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,910 mnist_classifier_MNISTClassifier fww1veub b1624abc-2f86-4192-be98-f6cdd77e0cdf -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,911 mnist_classifier_MNISTClassifier fww1veub 4fb0e310-1e4b-4ed9-8af9-8248485192fe -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:39,911 mnist_classifier_MNISTClassifier fww1veub 12d580d9-545d-4015-a099-8514f07fb6bc -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,118 mnist_classifier_MNISTClassifier fww1veub 5edca8ae-8b88-4673-8a77-2808f9c59c6e -- POST / 200 461.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,120 mnist_classifier_MNISTClassifier fww1veub 7ee8dd9a-20dc-4ed3-adb7-4ba887f8ce68 -- POST / 200 461.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,120 mnist_classifier_MNISTClassifier fww1veub 42d212b2-6fdf-4e36-92dd-357c6266db83 -- POST / 200 461.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,121 mnist_classifier_MNISTClassifier fww1veub 791810d3-ae9d-4ed3-993b-bc642b1b82c3 -- POST / 200 460.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,122 mnist_classifier_MNISTClassifier fww1veub 11536ed4-4a46-4ffd-9ec2-524161d91f39 -- POST / 200 460.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,123 mnist_classifier_MNISTClassifier fww1veub 599787fc-b789-4001-9276-647c75db9185 -- POST / 200 460.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,123 mnist_classifier_MNISTClassifier fww1veub 8d97d111-d6bf-480b-831e-db3c5ac70ccf -- POST / 200 459.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,125 mnist_classifier_MNISTClassifier fww1veub ca9e3883-aa0d-4356-a1cd-7898ca999c18 -- POST / 200 456.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,126 mnist_classifier_MNISTClassifier fww1veub 37c42bd3-94b3-4ba0-89bb-472701a927b8 -- POST / 200 454.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,129 mnist_classifier_MNISTClassifier fww1veub 3125491d-ca72-4953-86bc-862b35acb83d -- POST / 200 456.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,131 mnist_classifier_MNISTClassifier fww1veub 67f8c49a-8902-4c6d-a4b7-5bcde287c6cd -- POST / 200 457.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,132 mnist_classifier_MNISTClassifier fww1veub 6c44dd5c-4856-4834-8d44-cd6d0399966b -- POST / 200 458.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,133 mnist_classifier_MNISTClassifier fww1veub d1106ecb-b221-44bf-a63d-caf7b90ea248 -- POST / 200 458.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,134 mnist_classifier_MNISTClassifier fww1veub 56226e1c-86a8-4d4a-ab89-500743576957 -- POST / 200 458.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,134 mnist_classifier_MNISTClassifier fww1veub 38cf4f1f-6cd1-432c-bf57-6d6752d6c25f -- POST / 200 457.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,134 mnist_classifier_MNISTClassifier fww1veub 22e5883b-b4a1-43be-9485-39f23f85a641 -- POST / 200 456.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,137 mnist_classifier_MNISTClassifier fww1veub d22fb69b-e859-4620-8052-67adacd721a4 -- POST / 200 458.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,139 mnist_classifier_MNISTClassifier fww1veub a236104c-3c1d-44e0-8491-049500867883 -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,140 mnist_classifier_MNISTClassifier fww1veub 261087a5-04a9-4244-bdb9-20a3d6cf1963 -- POST / 200 459.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,144 mnist_classifier_MNISTClassifier fww1veub e965a726-53c4-44eb-8201-2119a5c67ec1 -- POST / 200 460.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,145 mnist_classifier_MNISTClassifier fww1veub a9248091-1c99-4b2b-82ce-7bd14ed61ca8 -- POST / 200 463.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,145 mnist_classifier_MNISTClassifier fww1veub 80d01e2e-0689-48ed-b314-ab88f45eecef -- POST / 200 462.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,146 mnist_classifier_MNISTClassifier fww1veub 1b07c4ac-002f-4746-819b-2861177225fa -- POST / 200 463.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,146 mnist_classifier_MNISTClassifier fww1veub 9c455e85-0274-4ff3-b375-d47190fc5e16 -- POST / 200 462.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,153 mnist_classifier_MNISTClassifier fww1veub 3dcebf4f-57bd-45d3-a44d-a3fc1864ba1d -- POST / 200 468.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,154 mnist_classifier_MNISTClassifier fww1veub c3ea0f56-91a7-4dc5-aca9-928988d3e682 -- POST / 200 466.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,158 mnist_classifier_MNISTClassifier fww1veub 3f46115b-5d84-4c50-b5e0-2261a26359f2 -- POST / 200 469.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,160 mnist_classifier_MNISTClassifier fww1veub 26ecd2a2-d1ee-4c8e-90c6-e0de685067c3 -- POST / 200 470.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,160 mnist_classifier_MNISTClassifier fww1veub 11d3aa92-02f8-4092-8075-4331c74923f8 -- POST / 200 470.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,162 mnist_classifier_MNISTClassifier fww1veub a917f38e-350a-4360-b25c-39d29fe6b5bb -- POST / 200 445.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,168 mnist_classifier_MNISTClassifier fww1veub 41302ab8-cdda-4a85-84e0-f684a755dfbf -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,171 mnist_classifier_MNISTClassifier fww1veub aa75ef3d-110e-476b-b34d-89236275029c -- POST / 200 410.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,175 mnist_classifier_MNISTClassifier fww1veub 1427e445-a87e-4b2c-af42-18c12cb28cf1 -- POST / 200 409.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,176 mnist_classifier_MNISTClassifier fww1veub 08a4c2ee-c934-4bc5-8816-4190641d4bfd -- POST / 200 404.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,176 mnist_classifier_MNISTClassifier fww1veub d48b185e-02a1-44d8-b2f8-444afd303286 -- POST / 200 403.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,176 mnist_classifier_MNISTClassifier fww1veub bf05e9dd-de3e-4a26-8865-74377e74f5ed -- POST / 200 402.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,177 mnist_classifier_MNISTClassifier fww1veub 487204ae-6cb7-4624-81c1-4048b9647d78 -- POST / 200 401.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,177 mnist_classifier_MNISTClassifier fww1veub 708853cc-4b26-49bc-8f06-20b05cc4b330 -- POST / 200 401.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,177 mnist_classifier_MNISTClassifier fww1veub 3d0a9a03-9e69-45dd-bc33-86859782841b -- POST / 200 400.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,178 mnist_classifier_MNISTClassifier fww1veub bfd44e5f-0ce5-4e70-90a6-1e840d7f51a5 -- POST / 200 400.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,178 mnist_classifier_MNISTClassifier fww1veub b8d90c8e-a7fe-48bd-aa95-ab6b1ec80958 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,181 mnist_classifier_MNISTClassifier fww1veub 52a4b4fd-89f7-4dfe-b32d-a4b30ac0017d -- POST / 200 402.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,181 mnist_classifier_MNISTClassifier fww1veub 06479f83-e0ca-411a-a298-1e2b44af5699 -- POST / 200 402.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,184 mnist_classifier_MNISTClassifier fww1veub 48e655c3-319f-40e8-9807-3e1b60374382 -- POST / 200 403.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,184 mnist_classifier_MNISTClassifier fww1veub 87066b06-b033-4cda-af81-467cb57906d3 -- POST / 200 403.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,184 mnist_classifier_MNISTClassifier fww1veub 318e5e1d-9ea5-4128-8261-9836de4375a8 -- POST / 200 401.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,184 mnist_classifier_MNISTClassifier fww1veub 153b5386-b3a5-4c48-bfb5-8fd768392ce2 -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,185 mnist_classifier_MNISTClassifier fww1veub f8ca1ad0-90b6-42c1-8bb5-6979aacd778b -- POST / 200 399.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,185 mnist_classifier_MNISTClassifier fww1veub 9d55acdf-a485-44bd-9b10-4b2c6f1bdbe4 -- POST / 200 397.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,185 mnist_classifier_MNISTClassifier fww1veub fd04e4f8-2d30-47b9-b03d-44176c191e9b -- POST / 200 399.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,186 mnist_classifier_MNISTClassifier fww1veub 7f98a6d1-091a-4ba2-9b64-28ec38ebe699 -- POST / 200 398.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,187 mnist_classifier_MNISTClassifier fww1veub e6cbc824-cbca-49e0-b04e-73d5223b9abf -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,187 mnist_classifier_MNISTClassifier fww1veub c0cc86b4-61d2-405f-a0a6-69270a32ed5d -- POST / 200 399.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,189 mnist_classifier_MNISTClassifier fww1veub f6fad13c-eecd-4482-883c-97bc75c74a54 -- POST / 200 400.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,190 mnist_classifier_MNISTClassifier fww1veub 1451132c-131a-49d3-875d-bb4d319ca614 -- POST / 200 400.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,193 mnist_classifier_MNISTClassifier fww1veub 08cb2277-9b6f-4921-9cff-4fb9d4b41208 -- POST / 200 402.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,195 mnist_classifier_MNISTClassifier fww1veub ed3a2551-b91f-47a8-9628-f161d2f35c33 -- POST / 200 400.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,195 mnist_classifier_MNISTClassifier fww1veub 0c05b46d-9469-483b-a3a7-929e5ec23e34 -- POST / 200 400.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,196 mnist_classifier_MNISTClassifier fww1veub e63c8c90-a46f-4791-aa8a-30ee300d72ea -- POST / 200 400.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,201 mnist_classifier_MNISTClassifier fww1veub 1fbc0497-47bf-45aa-91ac-78083becb661 -- POST / 200 405.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,203 mnist_classifier_MNISTClassifier fww1veub bb2b095b-51bf-4c45-818c-456c0b8fe1c9 -- POST / 200 406.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,203 mnist_classifier_MNISTClassifier fww1veub 25d87133-b6b9-46ba-990a-d6bb1065047e -- POST / 200 351.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,255 mnist_classifier_MNISTClassifier fww1veub ee498e47-0933-4d95-b5ff-8c6abcdad6c6 -- POST / 200 407.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,275 mnist_classifier_MNISTClassifier fww1veub 16521086-2c3a-4390-8d52-0a143eef0c26 -- POST / 200 425.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,276 mnist_classifier_MNISTClassifier fww1veub 7efbe421-cbe1-4e8e-8529-05df3fae18ae -- POST / 200 426.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,276 mnist_classifier_MNISTClassifier fww1veub e664fddf-8c10-445b-b7a3-d346aad86ec4 -- POST / 200 390.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,276 mnist_classifier_MNISTClassifier fww1veub d1e661a6-6dd7-4d04-a6af-e57e710fb5f1 -- POST / 200 362.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub 7393ea65-9c1b-49d8-a21c-b3dd329e6043 -- POST / 200 362.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub c47d2871-c3b2-49b8-b544-e338d8906c4c -- POST / 200 362.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub cab3b108-2ab6-4680-91c0-476a30214b0a -- POST / 200 356.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub 27566adf-efde-4636-a725-638995fa4cbc -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub 7851f9b1-7f4c-4a7d-83b0-b54a908e0888 -- POST / 200 354.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub 9fd96806-8e3e-4777-9aac-eb094a42954a -- POST / 200 350.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,277 mnist_classifier_MNISTClassifier fww1veub 9250123e-99ba-4b78-93d1-587715e9400e -- POST / 200 350.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,278 mnist_classifier_MNISTClassifier fww1veub 1e08d14d-91cd-4e3e-b5b5-3eb01dd02953 -- POST / 200 350.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,279 mnist_classifier_MNISTClassifier fww1veub f6b91609-db82-4af3-8e11-937324385ea6 -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,280 mnist_classifier_MNISTClassifier fww1veub 6fa8b621-11cb-4568-93ad-58d348b02bdb -- POST / 200 217.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,280 mnist_classifier_MNISTClassifier fww1veub 0a26cd85-e0dc-4adb-8bee-208057d1b624 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,281 mnist_classifier_MNISTClassifier fww1veub 0e727844-09a2-4dff-9502-9641b84575ee -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,283 mnist_classifier_MNISTClassifier fww1veub d9ae4008-ca2e-40aa-9f5a-c1667dc593e2 -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,283 mnist_classifier_MNISTClassifier fww1veub f0f148e6-6742-4da6-909b-8f3b7449e08d -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,283 mnist_classifier_MNISTClassifier fww1veub aeb1d6be-d9e9-40c8-86fa-aece37356357 -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,283 mnist_classifier_MNISTClassifier fww1veub 3c9cec3b-f5d2-457c-91a4-34cad3ac3007 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,284 mnist_classifier_MNISTClassifier fww1veub 8b15e3f4-d916-46f6-b364-6084496a3682 -- POST / 200 214.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,284 mnist_classifier_MNISTClassifier fww1veub 8c51391f-ae31-496f-80af-4d949ae8c76f -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,284 mnist_classifier_MNISTClassifier fww1veub 9570e660-2d6f-486b-b29a-eb497475da01 -- POST / 200 212.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,284 mnist_classifier_MNISTClassifier fww1veub 7064ac4c-e0c0-42a7-b4dc-81c322c35195 -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,285 mnist_classifier_MNISTClassifier fww1veub abdbf902-4e82-4ca6-b83f-6bd692661fa9 -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,286 mnist_classifier_MNISTClassifier fww1veub 26d99301-28fc-449e-87e3-ad40efdb2287 -- POST / 200 208.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,287 mnist_classifier_MNISTClassifier fww1veub 8da01a26-2430-48d2-a617-e4ff1024462b -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,287 mnist_classifier_MNISTClassifier fww1veub 4eaa42b6-66cf-4b9f-8af5-a36c5b555955 -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,287 mnist_classifier_MNISTClassifier fww1veub 84bc1a38-4907-42b5-8eeb-c3663246f7e6 -- POST / 200 209.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,288 mnist_classifier_MNISTClassifier fww1veub dc5b286a-ea8c-4fcb-a0ee-9a49f525a6b3 -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,289 mnist_classifier_MNISTClassifier fww1veub 639e34bb-b30d-4954-b825-49bb5bf72dbc -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,289 mnist_classifier_MNISTClassifier fww1veub 3e080824-0620-4bce-895f-d23a79155012 -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,291 mnist_classifier_MNISTClassifier fww1veub f39793a2-3d9b-4e0a-b440-fb89582bbe63 -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,292 mnist_classifier_MNISTClassifier fww1veub e3e9298e-7aac-4d2b-9e66-eed05656e588 -- POST / 200 213.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,293 mnist_classifier_MNISTClassifier fww1veub bc50fffa-3c51-4d71-98fd-44dfdfd477ae -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,295 mnist_classifier_MNISTClassifier fww1veub 30f40da0-0a28-4e03-bea0-7d43cc0247fb -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,296 mnist_classifier_MNISTClassifier fww1veub a01a7ef4-7b81-4976-a3bd-b4bc7e3d0c2b -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,398 mnist_classifier_MNISTClassifier fww1veub 1aba3c4d-8bca-4118-a0b6-dd29f63abc32 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,402 mnist_classifier_MNISTClassifier fww1veub fbc5d1a4-fc84-4a8f-8557-26049626dae8 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,402 mnist_classifier_MNISTClassifier fww1veub 258eba24-9d4d-4766-9026-0c21f4db118d -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,402 mnist_classifier_MNISTClassifier fww1veub 4b5aba2e-2747-4041-b318-eb69a5d658f2 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,403 mnist_classifier_MNISTClassifier fww1veub faee6c16-a3b0-4ef0-bbd7-dfd68fe00c82 -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,408 mnist_classifier_MNISTClassifier fww1veub 7e84b2c8-5319-4fc2-85ee-bff21b218f3c -- POST / 200 232.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,409 mnist_classifier_MNISTClassifier fww1veub 29ee0a58-897d-4b8d-9793-0f1700ac6bcf -- POST / 200 225.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,409 mnist_classifier_MNISTClassifier fww1veub 33894f12-2765-4fe3-90c6-7fdcd6f1fdfd -- POST / 200 225.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,409 mnist_classifier_MNISTClassifier fww1veub 7cf62c51-a97f-4b60-83e7-f709d729b701 -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,411 mnist_classifier_MNISTClassifier fww1veub fb1464eb-6ce6-4680-8eb5-7031f47e4fb1 -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,415 mnist_classifier_MNISTClassifier fww1veub 7bda3ef8-6f2f-4873-8aab-d22e4423bac4 -- POST / 200 209.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,416 mnist_classifier_MNISTClassifier fww1veub f12c8901-567e-4af3-ad22-dc401c3420f4 -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,417 mnist_classifier_MNISTClassifier fww1veub 50d04dd3-7dc5-4a50-bfd6-227b809bfc18 -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,417 mnist_classifier_MNISTClassifier fww1veub bb6be4d9-2d71-4a6b-b291-a603efba1fc9 -- POST / 200 212.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,418 mnist_classifier_MNISTClassifier fww1veub f296a6a0-3707-42dd-96c0-7c51b7e297a1 -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,420 mnist_classifier_MNISTClassifier fww1veub ef260274-3925-42b6-bf01-5ed688d53d6b -- POST / 200 211.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,423 mnist_classifier_MNISTClassifier fww1veub 47e1187f-f27a-4568-99dd-950f02288ef7 -- POST / 200 210.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,424 mnist_classifier_MNISTClassifier fww1veub a35d9c08-8829-4ed1-a391-57775898f981 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,424 mnist_classifier_MNISTClassifier fww1veub a87ed8b8-a9f3-40e6-b168-63a4eb548f75 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,426 mnist_classifier_MNISTClassifier fww1veub 1896bdbb-bc86-4fb9-9f53-e2b9529639fa -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,427 mnist_classifier_MNISTClassifier fww1veub 09836f21-e111-4ad8-827e-2c72bb8d2ce3 -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,427 mnist_classifier_MNISTClassifier fww1veub f3119146-1787-49aa-8c36-11ed2890232b -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,429 mnist_classifier_MNISTClassifier fww1veub 04600859-82b9-4e8a-b09c-08d2be9ad761 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,429 mnist_classifier_MNISTClassifier fww1veub 461afb61-dc72-4a39-b3ba-461061ed74c0 -- POST / 200 214.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,429 mnist_classifier_MNISTClassifier fww1veub af6f2281-365e-4447-9123-d76378d69c2d -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,430 mnist_classifier_MNISTClassifier fww1veub 9ac54e6c-c0b5-40d9-be91-26f50d2f0e18 -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,430 mnist_classifier_MNISTClassifier fww1veub 5b82d8da-c141-4624-98d9-ef9ba114b07b -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,430 mnist_classifier_MNISTClassifier fww1veub 7afd2845-4ac6-42b9-a14b-78768c5632db -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,431 mnist_classifier_MNISTClassifier fww1veub 9c5ecd7f-a340-47b1-98cf-de36751dc4bc -- POST / 200 208.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,431 mnist_classifier_MNISTClassifier fww1veub 3856d440-3ef5-4bbb-ba10-7a0a268aff37 -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,431 mnist_classifier_MNISTClassifier fww1veub 21bad404-a86e-4295-b425-df5c543ef488 -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,432 mnist_classifier_MNISTClassifier fww1veub 1785fc07-41cf-4dd8-a928-9e0eee3deafc -- POST / 200 203.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,432 mnist_classifier_MNISTClassifier fww1veub bf50fd9e-c8f0-42b0-a780-2da4f6f306b8 -- POST / 200 201.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,433 mnist_classifier_MNISTClassifier fww1veub 525f3ce6-d713-4702-9aa7-15667dc2952c -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,433 mnist_classifier_MNISTClassifier fww1veub 745636fb-30fc-46bf-8cfd-fd90b0469e1a -- POST / 200 217.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,433 mnist_classifier_MNISTClassifier fww1veub 0225bc0d-5d39-4e5b-b4f6-93c1e3ff1d00 -- POST / 200 197.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,553 mnist_classifier_MNISTClassifier fww1veub 09972ee4-b2c2-4641-bb52-03eb73661f3a -- POST / 200 319.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,555 mnist_classifier_MNISTClassifier fww1veub b9b0c261-105b-4337-8c5e-c5f3e8b995b6 -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,556 mnist_classifier_MNISTClassifier fww1veub 9765a39a-ff80-43c7-8c70-b8a99f5f2da0 -- POST / 200 320.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,557 mnist_classifier_MNISTClassifier fww1veub c4334003-c1c6-4397-8a5e-b0bf296adff3 -- POST / 200 320.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,557 mnist_classifier_MNISTClassifier fww1veub e2ef4ebf-329f-4ee5-b526-57795e714500 -- POST / 200 319.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,559 mnist_classifier_MNISTClassifier fww1veub 5f59cb1f-5d47-4bf2-882b-05ab71275cfa -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,559 mnist_classifier_MNISTClassifier fww1veub d0b75c69-32b1-4b1d-bc29-d2d940f3e758 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,560 mnist_classifier_MNISTClassifier fww1veub 601e1827-4e45-46e3-b216-2295526870e3 -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,561 mnist_classifier_MNISTClassifier fww1veub 62100192-9ba9-4a5b-a835-283cd0c4852e -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,561 mnist_classifier_MNISTClassifier fww1veub fc586a01-0705-4aab-8f9e-175309ee8780 -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,562 mnist_classifier_MNISTClassifier fww1veub 4fc2c2e2-b57f-4aa7-97aa-769e8cf4a819 -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,562 mnist_classifier_MNISTClassifier fww1veub 77bccc05-d557-42a3-be1d-6222454e52a8 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,564 mnist_classifier_MNISTClassifier fww1veub ad41c5f9-3c92-41b7-9e5a-7cfbb9e36ce2 -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,564 mnist_classifier_MNISTClassifier fww1veub 21400a82-477b-4d7e-95d0-639b4c898c30 -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,565 mnist_classifier_MNISTClassifier fww1veub 5ec9db44-ddab-49b3-be0c-40a5edfbff29 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,570 mnist_classifier_MNISTClassifier fww1veub d7de6ae4-e83f-4e10-8d5f-d39450ec43e1 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,571 mnist_classifier_MNISTClassifier fww1veub dd3c49fb-24a4-4323-b57e-b434ae9b5f06 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,579 mnist_classifier_MNISTClassifier fww1veub 71b9c84f-b842-434e-88c9-f1a1ab7e2ffa -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,597 mnist_classifier_MNISTClassifier fww1veub 5cb0ea40-9360-4648-8099-1a91c73b4a8f -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,600 mnist_classifier_MNISTClassifier fww1veub f259b9e4-2907-4f90-bee8-a0a3587460f4 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,600 mnist_classifier_MNISTClassifier fww1veub 048b0c47-cadd-4ee8-9efe-d121f9617a3f -- POST / 200 268.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,600 mnist_classifier_MNISTClassifier fww1veub 800ae0ee-c61a-48aa-ae38-c7da7bb0ec99 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,600 mnist_classifier_MNISTClassifier fww1veub 1d38b54b-6103-4f39-af96-2cd964c33be7 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,601 mnist_classifier_MNISTClassifier fww1veub 7c51982e-a54c-4fd1-967a-0776a43c39ce -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,601 mnist_classifier_MNISTClassifier fww1veub 9ececea9-d5f1-4a33-8446-8289d11f0954 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,601 mnist_classifier_MNISTClassifier fww1veub e47288ac-73fc-4e3e-8734-748718dc377f -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,711 mnist_classifier_MNISTClassifier fww1veub 39487126-aa74-4e56-bd06-a592dd73647c -- POST / 200 370.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,711 mnist_classifier_MNISTClassifier fww1veub ed4917cb-ce44-44e1-8a47-a3be935726d6 -- POST / 200 367.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,712 mnist_classifier_MNISTClassifier fww1veub e9b6a8dc-e0a6-47c2-8986-72ed88383a36 -- POST / 200 365.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,712 mnist_classifier_MNISTClassifier fww1veub fae4ede5-70af-4122-bf23-479abcaaf0fc -- POST / 200 366.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,712 mnist_classifier_MNISTClassifier fww1veub 3ba31a7d-3f88-4b34-b1fc-c3133d0009bc -- POST / 200 362.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,712 mnist_classifier_MNISTClassifier fww1veub 7c334695-b42c-4911-88ba-abb0cf37954e -- POST / 200 360.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,713 mnist_classifier_MNISTClassifier fww1veub 0fa22cdf-c7ff-4e79-b174-3a0b63ae5654 -- POST / 200 366.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,713 mnist_classifier_MNISTClassifier fww1veub 50b1a668-4581-4e2c-bde4-d06755e4969c -- POST / 200 361.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,713 mnist_classifier_MNISTClassifier fww1veub e096b34e-7dda-4112-a680-6bc7b7bdb9ee -- POST / 200 359.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,713 mnist_classifier_MNISTClassifier fww1veub ae72cc19-e1ef-4cd8-a948-73b5115bac5d -- POST / 200 361.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,714 mnist_classifier_MNISTClassifier fww1veub bd2d3cf1-c086-41f6-9fe9-fc88338e7f90 -- POST / 200 345.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,714 mnist_classifier_MNISTClassifier fww1veub 158cdecf-f4f4-4e36-9e05-81b822a22b28 -- POST / 200 360.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,714 mnist_classifier_MNISTClassifier fww1veub 29f8233b-ae41-46bc-94a6-71df0a13d466 -- POST / 200 359.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,714 mnist_classifier_MNISTClassifier fww1veub 9650cb18-f08e-488d-9631-1320635fcfa3 -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,715 mnist_classifier_MNISTClassifier fww1veub 0673f459-f32c-4830-8e26-6429081eaf6d -- POST / 200 353.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,715 mnist_classifier_MNISTClassifier fww1veub 8d2d0e6d-4933-441e-a266-87c10ee0d853 -- POST / 200 352.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,715 mnist_classifier_MNISTClassifier fww1veub 065c2799-f2c8-4507-a572-8d7a314fb7ca -- POST / 200 352.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,715 mnist_classifier_MNISTClassifier fww1veub d37fc822-9689-4641-87f1-8535ca0187ac -- POST / 200 351.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,715 mnist_classifier_MNISTClassifier fww1veub 74c8782f-ec75-446a-8903-a94e6ace41c2 -- POST / 200 344.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,716 mnist_classifier_MNISTClassifier fww1veub ea792b44-6f7f-4f9f-a87d-4106d7a460ac -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,716 mnist_classifier_MNISTClassifier fww1veub bcc7df77-3f08-41ad-a968-eaf423ab287e -- POST / 200 344.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,716 mnist_classifier_MNISTClassifier fww1veub 9b9768e9-a378-4926-9890-fbfd2bcaffef -- POST / 200 343.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,717 mnist_classifier_MNISTClassifier fww1veub c1026800-7b96-40cc-8d13-74d21b012df0 -- POST / 200 338.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,717 mnist_classifier_MNISTClassifier fww1veub f339b4e1-c481-4b79-b7d2-a01aa2383c06 -- POST / 200 336.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,718 mnist_classifier_MNISTClassifier fww1veub 62a8dc2d-6161-42d9-a56e-b300f88b31ec -- POST / 200 336.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,718 mnist_classifier_MNISTClassifier fww1veub 1abd280a-ef4b-4fd9-8385-197e9baf1456 -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,719 mnist_classifier_MNISTClassifier fww1veub 12fa42e6-19fd-4480-8073-aee8d18ba345 -- POST / 200 332.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,720 mnist_classifier_MNISTClassifier fww1veub 26bb0272-d790-44f4-92f1-430da98ff452 -- POST / 200 333.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,720 mnist_classifier_MNISTClassifier fww1veub 8edee36a-5d0d-4468-94a1-21ede8811ed7 -- POST / 200 336.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,721 mnist_classifier_MNISTClassifier fww1veub 834f5099-4aa1-4088-b305-addbc3c0b899 -- POST / 200 332.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,721 mnist_classifier_MNISTClassifier fww1veub c40254fa-f6c2-4c50-97d8-4c9abff2998e -- POST / 200 332.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,721 mnist_classifier_MNISTClassifier fww1veub c2790420-4591-4c5a-8e6b-8c43a5327d37 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,722 mnist_classifier_MNISTClassifier fww1veub 77f53144-4b97-4d53-b41f-ed22a7973290 -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,722 mnist_classifier_MNISTClassifier fww1veub 8fdccc92-09f5-4947-b7a1-9e396ac9e4ba -- POST / 200 315.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,722 mnist_classifier_MNISTClassifier fww1veub 1d1b058d-c67f-479c-8502-45b1df8f8f03 -- POST / 200 315.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,723 mnist_classifier_MNISTClassifier fww1veub 67eb6e0d-8652-4e48-9cf3-94e20f45125c -- POST / 200 315.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,723 mnist_classifier_MNISTClassifier fww1veub 621e9821-1b7d-40a8-ac75-5915b5d63a13 -- POST / 200 315.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,723 mnist_classifier_MNISTClassifier fww1veub 161383fe-2b77-449c-8b5d-488c8051623f -- POST / 200 308.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,723 mnist_classifier_MNISTClassifier fww1veub fa99bcd0-17df-47dc-a474-df1c62c5a0d5 -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,724 mnist_classifier_MNISTClassifier fww1veub c42eacaf-4e26-4947-8216-9134a0450e49 -- POST / 200 287.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,725 mnist_classifier_MNISTClassifier fww1veub 5253a459-2283-49b7-bdba-0396085478ac -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,725 mnist_classifier_MNISTClassifier fww1veub 44c493fd-d681-4b8e-8174-b42fa514bc89 -- POST / 200 285.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,726 mnist_classifier_MNISTClassifier fww1veub 1209613e-5b20-44df-883b-8703b1d82cf6 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,727 mnist_classifier_MNISTClassifier fww1veub c129bf2f-0f50-4344-bcd5-efbbce21dfae -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,728 mnist_classifier_MNISTClassifier fww1veub b661624d-9468-410a-b153-64a03a67922e -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,728 mnist_classifier_MNISTClassifier fww1veub 628773f1-bbb8-4d48-a2e4-25c5c1df8f70 -- POST / 200 272.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,729 mnist_classifier_MNISTClassifier fww1veub 7178c1e7-8862-4d0c-9647-aaddf0c691f0 -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,729 mnist_classifier_MNISTClassifier fww1veub 89b763d0-3f54-4c97-bed3-c81856da0eb7 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,729 mnist_classifier_MNISTClassifier fww1veub dd674f26-de72-455f-a90e-6082a08cfa7b -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,729 mnist_classifier_MNISTClassifier fww1veub 3a81ad13-3899-4b32-afd2-dd671ab5f6ef -- POST / 200 254.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,730 mnist_classifier_MNISTClassifier fww1veub 9bca5af7-14c4-4624-93fd-73659b3f4a24 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,731 mnist_classifier_MNISTClassifier fww1veub d39fefd2-6dbf-4309-858c-8dd8ba6148e8 -- POST / 200 231.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,732 mnist_classifier_MNISTClassifier fww1veub 92e51e9d-3130-451c-8e7d-11540f9e4db2 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,735 mnist_classifier_MNISTClassifier fww1veub 9fc84f9d-074e-483e-a950-b5e1d5fcd486 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,738 mnist_classifier_MNISTClassifier fww1veub 7e4cd1af-2816-4737-9e39-811f618f4095 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,738 mnist_classifier_MNISTClassifier fww1veub 67ec5a01-c28a-44e7-8210-d7501ff22867 -- POST / 200 236.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,738 mnist_classifier_MNISTClassifier fww1veub 1d74b14b-2ccc-4596-9adc-32bdef04148a -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,739 mnist_classifier_MNISTClassifier fww1veub 685fdd89-cf80-4edb-b111-5ab09b88db2c -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,739 mnist_classifier_MNISTClassifier fww1veub 4c819892-7caa-49ce-97bd-1aba7816b43d -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,742 mnist_classifier_MNISTClassifier fww1veub 1d217aad-f5f8-4c16-9678-29dc2c624512 -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,742 mnist_classifier_MNISTClassifier fww1veub c9738c9c-427d-42c7-9fa4-31f71cf3eb2f -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,744 mnist_classifier_MNISTClassifier fww1veub 79b969c6-edd9-4981-b450-f9cd36325d89 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,744 mnist_classifier_MNISTClassifier fww1veub dde72710-d886-4912-8dc9-f83f21b15700 -- POST / 200 235.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,745 mnist_classifier_MNISTClassifier fww1veub eb9e162d-08e2-47d1-8168-ed2bd444222e -- POST / 200 235.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,749 mnist_classifier_MNISTClassifier fww1veub 934fe08a-e67d-4f45-835e-e32b43967637 -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,752 mnist_classifier_MNISTClassifier fww1veub eaff6a15-9b7b-4716-b403-3a35b30cb6e0 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,753 mnist_classifier_MNISTClassifier fww1veub 847abcf8-efe9-4ec7-9ab2-89bf529bd1b3 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,753 mnist_classifier_MNISTClassifier fww1veub b64654ea-174f-4efc-8b34-f78b2b0f834c -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,754 mnist_classifier_MNISTClassifier fww1veub da7ad9c5-049d-4b6a-a1e6-6cdab3b9fc17 -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,755 mnist_classifier_MNISTClassifier fww1veub e1944409-1825-45f1-b400-eaae7230cff8 -- POST / 200 240.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,755 mnist_classifier_MNISTClassifier fww1veub bb5a48a2-f924-4d29-bbca-3dcfeaf75a03 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,755 mnist_classifier_MNISTClassifier fww1veub 14c25115-9be9-486c-b613-e73fbe2414f7 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,821 mnist_classifier_MNISTClassifier fww1veub 69329a4b-ea49-4ce4-b14e-b8b74b418ab5 -- POST / 200 303.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,827 mnist_classifier_MNISTClassifier fww1veub 1bc6f5d6-160d-4f85-8489-11a7687e24d8 -- POST / 200 309.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,828 mnist_classifier_MNISTClassifier fww1veub 6778c7f8-5582-4aba-9ba8-95c08ff03fb4 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,829 mnist_classifier_MNISTClassifier fww1veub f4eb1fe5-9e94-4303-b793-bb286e2a022b -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,829 mnist_classifier_MNISTClassifier fww1veub c722bff6-b2f0-4e4c-b009-cd1001740338 -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,829 mnist_classifier_MNISTClassifier fww1veub 7cefca1d-4f01-4ead-a8aa-76bd6411bdf8 -- POST / 200 227.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,831 mnist_classifier_MNISTClassifier fww1veub 9ee4bffd-fa39-4513-9c72-77409eb3bb7a -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,831 mnist_classifier_MNISTClassifier fww1veub f26a9362-ee7c-4a26-be00-f5a598222855 -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,832 mnist_classifier_MNISTClassifier fww1veub 19a76d2f-3920-4f9b-bb46-25a7c812bcf1 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,832 mnist_classifier_MNISTClassifier fww1veub 451a5890-2274-4708-8e04-f2179d7fcd72 -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,833 mnist_classifier_MNISTClassifier fww1veub 6f051011-fa4c-46ae-89d2-a8979624cfe5 -- POST / 200 219.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,836 mnist_classifier_MNISTClassifier fww1veub 8e5bed0c-4ca5-48eb-b699-8ba0269878f0 -- POST / 200 221.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,837 mnist_classifier_MNISTClassifier fww1veub cf661518-f8ab-4617-842b-b7dfb9ba87e6 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,837 mnist_classifier_MNISTClassifier fww1veub baceef21-3a3a-4f6a-8a81-1818e401d053 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,839 mnist_classifier_MNISTClassifier fww1veub a340aa2d-5021-41a7-b384-117b4625e76a -- POST / 200 222.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,839 mnist_classifier_MNISTClassifier fww1veub 57cccf7a-034d-43ad-ae37-c518623e5f53 -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,839 mnist_classifier_MNISTClassifier fww1veub 99ed049b-14f9-45e2-8f00-4163da4e7f9b -- POST / 200 220.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,840 mnist_classifier_MNISTClassifier fww1veub 86ee8eb3-58e3-4bb9-bae0-e3f7fdfc5d9b -- POST / 200 220.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,840 mnist_classifier_MNISTClassifier fww1veub 148b0cb1-33ae-4a14-b7fa-def768206ba3 -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,841 mnist_classifier_MNISTClassifier fww1veub b7df2113-10c5-4ae2-9c0c-156537e40872 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,848 mnist_classifier_MNISTClassifier fww1veub 266e3c9b-dff0-40e0-ad95-c6174dd30c6e -- POST / 200 225.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,851 mnist_classifier_MNISTClassifier fww1veub eb69e5e9-da1e-4f6a-b17c-2b68616c848e -- POST / 200 227.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,854 mnist_classifier_MNISTClassifier fww1veub 5f758da0-5947-4269-a559-7b2f53fc1b16 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,855 mnist_classifier_MNISTClassifier fww1veub c5da4eca-e3c2-4f0d-8ff5-bf0a994f5c65 -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,855 mnist_classifier_MNISTClassifier fww1veub 5b666b08-a515-462b-9785-25432728724c -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,856 mnist_classifier_MNISTClassifier fww1veub a9f12914-54ef-45fe-aa46-5786fcc2a846 -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,857 mnist_classifier_MNISTClassifier fww1veub c87bb1b1-0467-43a6-82f5-4ddad4e33a58 -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:40,858 mnist_classifier_MNISTClassifier fww1veub d5d6a408-ee5a-4221-849f-4e1d4fb4c949 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,109 mnist_classifier_MNISTClassifier fww1veub 8942277b-1c6c-48b2-8a48-3a26ba4a4926 -- POST / 200 424.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,110 mnist_classifier_MNISTClassifier fww1veub 2e6096dd-0517-4006-9a23-59805845bf29 -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,111 mnist_classifier_MNISTClassifier fww1veub 81c9bc09-10e5-429d-b556-cbb04372f2fa -- POST / 200 421.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,111 mnist_classifier_MNISTClassifier fww1veub 7d0f423c-2606-4e3d-a090-6dd6a7b418c2 -- POST / 200 416.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,111 mnist_classifier_MNISTClassifier fww1veub 33144554-aef4-44e4-b07b-fe7f8f72975e -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,112 mnist_classifier_MNISTClassifier fww1veub 80c04740-6a90-43be-aacd-8172ddaabea2 -- POST / 200 365.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,112 mnist_classifier_MNISTClassifier fww1veub 3cc8beab-444a-4d7c-8c5e-42e3cb13301c -- POST / 200 365.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,112 mnist_classifier_MNISTClassifier fww1veub ba103c25-807d-467c-b57b-6e1e7a194dd9 -- POST / 200 365.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,113 mnist_classifier_MNISTClassifier fww1veub 62a34b07-b2e4-45d1-a915-d337cce806ea -- POST / 200 366.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,121 mnist_classifier_MNISTClassifier fww1veub 5155e6c0-e234-4f35-b326-0f73ec226f1b -- POST / 200 374.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,133 mnist_classifier_MNISTClassifier fww1veub d758ac54-31ba-4ac8-97b2-1ac918f98200 -- POST / 200 385.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,141 mnist_classifier_MNISTClassifier fww1veub e04068c8-4756-4b42-bb6e-d4b79796517b -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,143 mnist_classifier_MNISTClassifier fww1veub e80e8394-1a2c-4949-9d48-414636860f7a -- POST / 200 382.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,143 mnist_classifier_MNISTClassifier fww1veub 9ffcce0e-8362-4a50-85f1-930dca5cfe71 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,145 mnist_classifier_MNISTClassifier fww1veub 8ec5ab45-1b52-4e29-b29a-1ab4e8d637cf -- POST / 200 385.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,145 mnist_classifier_MNISTClassifier fww1veub 7ada21a3-9179-4f11-84ac-0f32eedec436 -- POST / 200 386.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,145 mnist_classifier_MNISTClassifier fww1veub c2af60aa-ae6f-4cfa-bedc-df6e4ee95a6c -- POST / 200 386.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,146 mnist_classifier_MNISTClassifier fww1veub 64708937-e308-4ca2-b888-ece0d194ae9f -- POST / 200 385.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,146 mnist_classifier_MNISTClassifier fww1veub bf7c9972-511c-4e12-9603-5b63ddddd613 -- POST / 200 386.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,148 mnist_classifier_MNISTClassifier fww1veub cd559158-b7be-4e58-9f30-28e2d296810f -- POST / 200 387.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,281 mnist_classifier_MNISTClassifier fww1veub 54a493d9-ef21-40ff-9ebc-b449e3b618a6 -- POST / 200 518.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,282 mnist_classifier_MNISTClassifier fww1veub f2b631f5-7058-4ae3-9bba-41c238a31803 -- POST / 200 498.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,282 mnist_classifier_MNISTClassifier fww1veub e02f53fb-4a05-48c8-b2ac-928d60dca0ac -- POST / 200 512.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,282 mnist_classifier_MNISTClassifier fww1veub 2898b1c7-ad46-44fc-b4ae-3714784efd99 -- POST / 200 509.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,283 mnist_classifier_MNISTClassifier fww1veub fd343e0e-53b0-4501-8176-09c3ec138bda -- POST / 200 508.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,283 mnist_classifier_MNISTClassifier fww1veub ceefd9b6-1285-413e-ba61-5f60feaa12bb -- POST / 200 508.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,284 mnist_classifier_MNISTClassifier fww1veub 3a4021b5-5cf7-41b1-a2ed-dc2c10d64501 -- POST / 200 506.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,287 mnist_classifier_MNISTClassifier fww1veub ce083e1b-4588-40a6-9036-0493d00b6bb1 -- POST / 200 509.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,288 mnist_classifier_MNISTClassifier fww1veub 96430252-b150-4c63-9d1f-8a8fe347c1c8 -- POST / 200 509.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,288 mnist_classifier_MNISTClassifier fww1veub 45e39fe9-3d18-4623-a337-890829e143e9 -- POST / 200 510.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,288 mnist_classifier_MNISTClassifier fww1veub 35e84f0d-3e4b-4a44-8e32-3146418f3bd9 -- POST / 200 509.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,289 mnist_classifier_MNISTClassifier fww1veub 08b553f6-b3f4-4727-bac1-c6d590f38870 -- POST / 200 509.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,289 mnist_classifier_MNISTClassifier fww1veub b062a0a0-15e3-41c3-9aa2-d5a5baafa98a -- POST / 200 508.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,289 mnist_classifier_MNISTClassifier fww1veub cc4aca2d-773e-4244-b905-fc3718bb811b -- POST / 200 508.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,290 mnist_classifier_MNISTClassifier fww1veub ea225912-bee6-4339-806c-1f20a08fadfd -- POST / 200 506.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,290 mnist_classifier_MNISTClassifier fww1veub b143eaa8-41a7-4975-a9a8-3843a9210e47 -- POST / 200 508.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,290 mnist_classifier_MNISTClassifier fww1veub b3be9594-137f-4500-a5ad-66219d4ae3ee -- POST / 200 507.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,291 mnist_classifier_MNISTClassifier fww1veub 09e492dd-02cc-43e8-a0b4-e713853606cc -- POST / 200 496.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,291 mnist_classifier_MNISTClassifier fww1veub 626b09f5-71e3-4d6b-a1e5-373a83595058 -- POST / 200 507.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,291 mnist_classifier_MNISTClassifier fww1veub 0b464f6d-04ff-4ca7-9c57-9bce96b70ef7 -- POST / 200 506.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,291 mnist_classifier_MNISTClassifier fww1veub f5d91c48-470b-41f3-a967-36ba8502d104 -- POST / 200 506.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,292 mnist_classifier_MNISTClassifier fww1veub b8cdc8bc-4e86-4f80-8a10-74a13ab068f9 -- POST / 200 506.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,293 mnist_classifier_MNISTClassifier fww1veub e69d6dab-651c-4138-9618-90e8c4780477 -- POST / 200 504.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,293 mnist_classifier_MNISTClassifier fww1veub c1cddf5d-2b5a-4285-ad5c-366379d1a0de -- POST / 200 503.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,294 mnist_classifier_MNISTClassifier fww1veub e3c0595e-6ef6-4018-a2ef-eb6d329d8151 -- POST / 200 503.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,294 mnist_classifier_MNISTClassifier fww1veub c6ad34ba-a3d1-413e-a30c-bf23f18fd22f -- POST / 200 500.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,295 mnist_classifier_MNISTClassifier fww1veub 879b44ed-5a45-4f4c-b36d-2c661eb5ed5f -- POST / 200 483.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,295 mnist_classifier_MNISTClassifier fww1veub 6377845b-0e71-4941-9ede-242330e2fe9b -- POST / 200 474.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,296 mnist_classifier_MNISTClassifier fww1veub 13538b88-50a3-436f-a8ce-ce96c5a5db2b -- POST / 200 461.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,297 mnist_classifier_MNISTClassifier fww1veub 8642210d-b0ae-40fb-865f-d0b7e03e1f03 -- POST / 200 461.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,297 mnist_classifier_MNISTClassifier fww1veub 70bd1afe-2c5b-4b32-950b-0f969dfab987 -- POST / 200 461.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,297 mnist_classifier_MNISTClassifier fww1veub 0f57209b-5ce9-4b12-8745-68c50d8b6a93 -- POST / 200 462.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,298 mnist_classifier_MNISTClassifier fww1veub 2e39a6f0-2160-49d0-a2a3-69b6197a6333 -- POST / 200 457.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,298 mnist_classifier_MNISTClassifier fww1veub 2649864d-4d75-4c5a-8ee5-9bcea85a5d82 -- POST / 200 452.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,299 mnist_classifier_MNISTClassifier fww1veub fbd6491e-7659-44ee-bdee-53ff69f5b2cc -- POST / 200 452.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,300 mnist_classifier_MNISTClassifier fww1veub b9d032a1-87b0-4f6b-a483-69f7dff41c07 -- POST / 200 453.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,302 mnist_classifier_MNISTClassifier fww1veub 96d521f6-441b-4d4e-ad6c-4ec851a039bf -- POST / 200 455.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,303 mnist_classifier_MNISTClassifier fww1veub 001d30c1-17c3-4046-bf5e-9de8cd7fe555 -- POST / 200 456.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,304 mnist_classifier_MNISTClassifier fww1veub 50116044-d867-4e9f-bb9c-3b2c839a07a6 -- POST / 200 444.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,304 mnist_classifier_MNISTClassifier fww1veub c0a83646-47e8-47b8-aac3-3593bab994cf -- POST / 200 443.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,305 mnist_classifier_MNISTClassifier fww1veub 57618886-6269-4410-ab3e-a76fb42e6ecc -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,305 mnist_classifier_MNISTClassifier fww1veub 86ba45ca-8302-407c-a38a-19ab1c8199b4 -- POST / 200 438.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,305 mnist_classifier_MNISTClassifier fww1veub 6aa62c1e-068e-4b25-9046-e2bfbf7628d2 -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,306 mnist_classifier_MNISTClassifier fww1veub 39089b0f-fa7f-4b59-a421-a2eb31b90180 -- POST / 200 436.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,306 mnist_classifier_MNISTClassifier fww1veub caa91717-750a-40d7-bd91-a3ff6de5ef0f -- POST / 200 435.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,306 mnist_classifier_MNISTClassifier fww1veub a0addab7-32a4-4fc3-ad8b-7eb542f352a8 -- POST / 200 434.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,307 mnist_classifier_MNISTClassifier fww1veub 324251e4-1f2c-4e27-9dc5-07a731b0fa08 -- POST / 200 434.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,307 mnist_classifier_MNISTClassifier fww1veub 01e1e06c-f173-4c5f-a546-e54f059b7003 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,307 mnist_classifier_MNISTClassifier fww1veub ebb37ee8-d8b1-41ba-9117-2e855c20c824 -- POST / 200 432.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,308 mnist_classifier_MNISTClassifier fww1veub bbc55aa1-1507-4d31-8a30-9401eab40713 -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,308 mnist_classifier_MNISTClassifier fww1veub 7ce0de31-ef03-4ec9-90d4-4ebdac3d495b -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,309 mnist_classifier_MNISTClassifier fww1veub fd651bdc-e0b6-4c20-a423-0dd402aeb1ab -- POST / 200 407.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,313 mnist_classifier_MNISTClassifier fww1veub 24ce97c8-15e7-459b-8d4d-15f93c8a9eea -- POST / 200 434.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,315 mnist_classifier_MNISTClassifier fww1veub 66b10cb3-1ac2-4b70-b5db-663ebe24283e -- POST / 200 412.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,316 mnist_classifier_MNISTClassifier fww1veub 949e970c-a612-4b82-bb90-2b04a492522d -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,326 mnist_classifier_MNISTClassifier fww1veub 156eb8df-36a2-4475-b1ed-d495786e16a7 -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,327 mnist_classifier_MNISTClassifier fww1veub 2b1ad969-ef26-4522-b421-c62d56db094f -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,327 mnist_classifier_MNISTClassifier fww1veub 46b93219-9544-414a-9afc-e7077cfbb71a -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,327 mnist_classifier_MNISTClassifier fww1veub 2356a314-d14d-4d10-a3e3-0d9604b608eb -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,327 mnist_classifier_MNISTClassifier fww1veub a69b4182-73e2-4921-aa0b-c7a33432475b -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub 52fae940-a19d-4670-a805-8601731fdcf3 -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub 28a4fea9-b08d-483f-9b52-703ac047fec5 -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub 3153aaea-abd9-41e1-b858-fa7fa40c029b -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub 97729c44-0936-4662-b295-fe1aceda6351 -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub f743138f-d4f3-444b-8767-f1b631fb995a -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub a5cb0d59-774c-483c-ab83-b1cd6dc1b9c9 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,328 mnist_classifier_MNISTClassifier fww1veub 41e90e95-aa4c-44cc-afb7-237ce651c2d5 -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,329 mnist_classifier_MNISTClassifier fww1veub 31b3c097-9f13-4f26-b1b2-e1be9d7beb53 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,329 mnist_classifier_MNISTClassifier fww1veub 63d716b0-e4e2-48c6-8a85-5d97621a6af6 -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,329 mnist_classifier_MNISTClassifier fww1veub 26d43bd5-813d-4d01-bd56-6a1ada9b7e1d -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,329 mnist_classifier_MNISTClassifier fww1veub 6c3a8100-802e-4758-af55-78b663a4750d -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,329 mnist_classifier_MNISTClassifier fww1veub da5747e2-3719-426e-81e6-f99c39c42499 -- POST / 200 177.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,329 mnist_classifier_MNISTClassifier fww1veub d40e245e-2dfd-46a5-a268-cc48ad17c9c2 -- POST / 200 158.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,332 mnist_classifier_MNISTClassifier fww1veub a092de1f-a7b9-4a1f-9171-033a2b275f75 -- POST / 200 160.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,333 mnist_classifier_MNISTClassifier fww1veub 9b792b5f-8efc-4366-b234-5175974c7727 -- POST / 200 161.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,333 mnist_classifier_MNISTClassifier fww1veub 05db75de-3353-47f1-86e1-6ab9623ec7c8 -- POST / 200 160.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,337 mnist_classifier_MNISTClassifier fww1veub a18be4eb-55a5-49e0-babd-03db2e1e1d49 -- POST / 200 163.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,338 mnist_classifier_MNISTClassifier fww1veub 57f364ca-6c0a-497e-b6d2-edeece167341 -- POST / 200 162.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,340 mnist_classifier_MNISTClassifier fww1veub fa9e05cc-d7fd-4ab1-a1ef-d4c61d1e08b6 -- POST / 200 163.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,340 mnist_classifier_MNISTClassifier fww1veub 259ea605-71b7-40b5-a877-62d6e84ed1cb -- POST / 200 163.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,341 mnist_classifier_MNISTClassifier fww1veub 6c3eaec3-2470-4072-9e5c-2173354b0eaa -- POST / 200 161.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,347 mnist_classifier_MNISTClassifier fww1veub f85a49a3-6c75-4fca-bc13-abbe268b70f4 -- POST / 200 167.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,348 mnist_classifier_MNISTClassifier fww1veub 06e11659-189a-498a-a7bd-1b123fd579f2 -- POST / 200 167.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,350 mnist_classifier_MNISTClassifier fww1veub 8dc003c9-701c-4ba7-8001-4cf8dffd36ec -- POST / 200 169.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,351 mnist_classifier_MNISTClassifier fww1veub 36430542-d8f7-4ac4-9d8d-36df9a42a911 -- POST / 200 169.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,352 mnist_classifier_MNISTClassifier fww1veub bd52042d-c572-4ce1-b3f4-20d2f5ff1fdc -- POST / 200 170.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,352 mnist_classifier_MNISTClassifier fww1veub 26e04615-263b-4499-a0f1-4d86eee2c72f -- POST / 200 168.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,359 mnist_classifier_MNISTClassifier fww1veub 526caa36-a415-4c11-89b1-4dee21b39c37 -- POST / 200 174.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,364 mnist_classifier_MNISTClassifier fww1veub dcd318dd-07d9-46ff-9602-dde45ab35e11 -- POST / 200 461.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,364 mnist_classifier_MNISTClassifier fww1veub 612269d2-551a-49c1-9ce8-4a919e322387 -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,365 mnist_classifier_MNISTClassifier fww1veub 7d25c530-d9bb-44fa-80f1-ea2ac57f8f06 -- POST / 200 453.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,365 mnist_classifier_MNISTClassifier fww1veub 8e31c719-8d06-41f4-9db4-3f7e32c994dd -- POST / 200 315.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,365 mnist_classifier_MNISTClassifier fww1veub 0fd5572b-a38f-4a38-b72a-3a45d8905b33 -- POST / 200 315.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,366 mnist_classifier_MNISTClassifier fww1veub 76ea2d25-575a-4f2b-932d-ddfa8277f6b9 -- POST / 200 315.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,366 mnist_classifier_MNISTClassifier fww1veub c68550d6-55bf-4520-848b-bb2af0c83295 -- POST / 200 313.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,367 mnist_classifier_MNISTClassifier fww1veub b8fa41cb-577e-435e-a96b-69279dc98ef5 -- POST / 200 315.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,367 mnist_classifier_MNISTClassifier fww1veub 507423c2-5c2d-48e4-926e-803b0d409903 -- POST / 200 313.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,368 mnist_classifier_MNISTClassifier fww1veub eaff53f9-c07d-4e0e-bdc3-5c7e5b3fd43a -- POST / 200 316.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,368 mnist_classifier_MNISTClassifier fww1veub 571f328e-d013-46e8-8ba3-4d094d017b5f -- POST / 200 313.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,369 mnist_classifier_MNISTClassifier fww1veub 69112800-c22c-48f1-97c6-7fcd6770051c -- POST / 200 312.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,626 mnist_classifier_MNISTClassifier fww1veub 9b97bb15-8fd1-403c-9bcc-62d4579bfd1d -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,627 mnist_classifier_MNISTClassifier fww1veub 96efa55d-c2d7-45ab-a89f-5a984b29694b -- POST / 200 324.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,627 mnist_classifier_MNISTClassifier fww1veub eae9c307-a11b-44ce-a686-80c40dfc0f86 -- POST / 200 325.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,628 mnist_classifier_MNISTClassifier fww1veub 73ca8d6c-c3e8-4245-a8e4-03a0beaf8b60 -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,628 mnist_classifier_MNISTClassifier fww1veub 7a1056d5-7e7d-478c-9cdf-5eebb426fa37 -- POST / 200 311.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,630 mnist_classifier_MNISTClassifier fww1veub 1e97c68d-3f5e-4e34-95f6-d5d65be99395 -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,630 mnist_classifier_MNISTClassifier fww1veub d913a7b4-ac7c-42da-ab1b-43ca4facf66e -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,631 mnist_classifier_MNISTClassifier fww1veub a383825d-f467-4409-9c7f-1f460ae5456c -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,631 mnist_classifier_MNISTClassifier fww1veub b6f42694-e292-4d9b-bd69-9258240776c5 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,631 mnist_classifier_MNISTClassifier fww1veub acf6d75a-a6c7-4ecd-9ffc-d77f2499fc3c -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,632 mnist_classifier_MNISTClassifier fww1veub 79960244-9fa2-4eca-8e33-2ed08a93bd31 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,632 mnist_classifier_MNISTClassifier fww1veub fddfbaf7-d159-488a-a2af-21362090f2dd -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,633 mnist_classifier_MNISTClassifier fww1veub 56587a7b-9089-442c-8c8c-7cd2532d8062 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,633 mnist_classifier_MNISTClassifier fww1veub 6baad807-12eb-4936-af5f-3383c87f502c -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,634 mnist_classifier_MNISTClassifier fww1veub 5983777d-830d-4fa6-bb24-8f0f8d417db1 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,634 mnist_classifier_MNISTClassifier fww1veub 55823289-d8f4-4793-8d65-b73a313dc43a -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,634 mnist_classifier_MNISTClassifier fww1veub 511fe0e3-9c04-4c55-a771-b6a2c5f47f1e -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,635 mnist_classifier_MNISTClassifier fww1veub b69a43d6-a74d-42a7-a6f7-90f6bbb2f0a2 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,635 mnist_classifier_MNISTClassifier fww1veub 15110b94-17c2-4d05-91b1-53da969fdec5 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,635 mnist_classifier_MNISTClassifier fww1veub d342e6ad-7ad7-48af-a758-cf87f45a9dc7 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,636 mnist_classifier_MNISTClassifier fww1veub 4e4b6b11-49e2-4fe3-8360-8df9bf818dec -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,636 mnist_classifier_MNISTClassifier fww1veub 726b3e8e-ee1c-4f8d-a9af-7f560c9d9b80 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,641 mnist_classifier_MNISTClassifier fww1veub bfbcb8b3-ac8c-47a4-befc-0922f52f9071 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,641 mnist_classifier_MNISTClassifier fww1veub a3de7b90-424b-46af-819a-fe975b8867da -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,645 mnist_classifier_MNISTClassifier fww1veub 58ce6156-5df8-4e67-b151-276da7d00343 -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,646 mnist_classifier_MNISTClassifier fww1veub 6688620b-f234-4687-b556-ba66d189309f -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,647 mnist_classifier_MNISTClassifier fww1veub 289773ee-e500-4c47-96d3-a453289299b9 -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,647 mnist_classifier_MNISTClassifier fww1veub 43bf4cde-a59c-4acc-a0d8-0233982ce2a5 -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,648 mnist_classifier_MNISTClassifier fww1veub 29fa097a-0c50-4805-9cae-806efbee5c7b -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,648 mnist_classifier_MNISTClassifier fww1veub ffca6c20-3ef7-4b95-9cd7-17a7db443bb6 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,648 mnist_classifier_MNISTClassifier fww1veub b7a25470-c81b-4ed8-bb31-540d9e705a7b -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,648 mnist_classifier_MNISTClassifier fww1veub 49ef8f86-aafb-499c-bff7-793a29b3756d -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,649 mnist_classifier_MNISTClassifier fww1veub 7d77b441-834a-4ffe-9e1f-1e1297ff8bca -- POST / 200 249.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,649 mnist_classifier_MNISTClassifier fww1veub 92c441c1-03da-4657-b32c-bdbb73d0a0b6 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,649 mnist_classifier_MNISTClassifier fww1veub 25f5ac27-bdcd-4c57-b2ff-5249a08214b1 -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,649 mnist_classifier_MNISTClassifier fww1veub 46686d67-b7c4-4151-9ff9-72337a635687 -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,649 mnist_classifier_MNISTClassifier fww1veub 262ba780-911e-426a-b8af-f9165f40519d -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,649 mnist_classifier_MNISTClassifier fww1veub 6e2d4af2-c147-469e-929f-fda3e5ce6d88 -- POST / 200 246.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub 06e9d080-8ce6-491e-b04b-35409de68e6a -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub 69f59da2-cf4a-4d76-b25a-ceccbf00db6a -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub c0c2cf4b-2c90-4f95-9ea0-b194f6df9a35 -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub b824e939-2fc4-4afe-baa0-ff2e6973a352 -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub a58c15b3-7210-42fa-a092-7a9a0a0f4e77 -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub 5c58dc2c-4fbf-48ad-a1eb-51244934ed86 -- POST / 200 242.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,650 mnist_classifier_MNISTClassifier fww1veub 0400ddeb-f6d1-42d1-b39b-4ba903ffada9 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,651 mnist_classifier_MNISTClassifier fww1veub 050b36b4-7f9c-413f-8425-60593834ee4c -- POST / 200 241.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,651 mnist_classifier_MNISTClassifier fww1veub 7742d335-5571-4b83-8901-9383dff516d3 -- POST / 200 241.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,651 mnist_classifier_MNISTClassifier fww1veub 09d848ad-f51b-4583-a123-790de16e2ef7 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,651 mnist_classifier_MNISTClassifier fww1veub abb23708-0e98-4582-8871-e834cd9563a7 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,651 mnist_classifier_MNISTClassifier fww1veub ff4d24b6-06d3-4f20-b0c2-6928142d5e2a -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,651 mnist_classifier_MNISTClassifier fww1veub 4c5ec578-46e7-430e-86a1-2ccb26ad76b4 -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,652 mnist_classifier_MNISTClassifier fww1veub c3d6f5a6-ee8e-4bec-b1ff-d83f60e0fd98 -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,652 mnist_classifier_MNISTClassifier fww1veub 624096b5-ac5e-417a-b8fb-1fe2ba299823 -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,652 mnist_classifier_MNISTClassifier fww1veub 22550628-aed0-4313-85f5-baa3b48abe5d -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,652 mnist_classifier_MNISTClassifier fww1veub 4443649d-64cf-44b5-b25b-a11931614522 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,652 mnist_classifier_MNISTClassifier fww1veub 7b54121f-1d22-4f42-a2c0-fb4ab389deda -- POST / 200 218.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,652 mnist_classifier_MNISTClassifier fww1veub a145a4d5-b5ff-4527-ad62-382fabc24a84 -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,654 mnist_classifier_MNISTClassifier fww1veub 65dd0ee1-8441-4b59-87bb-345f97e3599a -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,657 mnist_classifier_MNISTClassifier fww1veub 2fd51694-5872-4582-93d5-29f52a60c16a -- POST / 200 193.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,659 mnist_classifier_MNISTClassifier fww1veub 68339994-2623-4c04-92ef-3d986e6e433a -- POST / 200 192.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,659 mnist_classifier_MNISTClassifier fww1veub df1c30b1-4f0a-49a0-b32d-ab99aff3bb36 -- POST / 200 192.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,659 mnist_classifier_MNISTClassifier fww1veub 48892dbd-bc56-4dbe-8f3c-7e57144aea00 -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,659 mnist_classifier_MNISTClassifier fww1veub 527c290f-d0cd-456f-a34d-97c10246a3a5 -- POST / 200 191.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,660 mnist_classifier_MNISTClassifier fww1veub b870114b-a4b6-4e6f-9b08-7045acb2127b -- POST / 200 191.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,660 mnist_classifier_MNISTClassifier fww1veub b90b4261-4188-4db0-b30f-97bb6012e2cb -- POST / 200 189.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,661 mnist_classifier_MNISTClassifier fww1veub 7ace7239-a190-4eae-a0b2-cea8bc61da1b -- POST / 200 190.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,661 mnist_classifier_MNISTClassifier fww1veub a5ce34de-b8d7-4d20-bc09-55139c0979b8 -- POST / 200 190.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,661 mnist_classifier_MNISTClassifier fww1veub f59f2160-fe81-4923-a0cc-6323417950c4 -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,662 mnist_classifier_MNISTClassifier fww1veub 1a506216-79e6-42e1-ae2c-ab4bb24ffac0 -- POST / 200 180.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,662 mnist_classifier_MNISTClassifier fww1veub 3484a9c4-e981-49f1-8bf3-c29159e17f9f -- POST / 200 180.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,662 mnist_classifier_MNISTClassifier fww1veub 2a3d0945-6620-422a-a0a4-ca81ba573699 -- POST / 200 178.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,665 mnist_classifier_MNISTClassifier fww1veub be76fd2e-a0a8-476e-82fd-5dad63cb2efc -- POST / 200 181.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,665 mnist_classifier_MNISTClassifier fww1veub 66eb99bf-315c-4f73-b1f5-c984b99082e7 -- POST / 200 180.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,665 mnist_classifier_MNISTClassifier fww1veub 067b1fed-daa3-4c5c-a21f-3fcb1a1f5cce -- POST / 200 179.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,666 mnist_classifier_MNISTClassifier fww1veub cfe6dd34-c6fc-4c4b-b98d-fd9db0c26f14 -- POST / 200 175.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,666 mnist_classifier_MNISTClassifier fww1veub be81502d-491a-42ee-8828-055b824f58f7 -- POST / 200 175.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,667 mnist_classifier_MNISTClassifier fww1veub 8c6cce48-a3c9-4296-83e4-aa76362f2b9c -- POST / 200 175.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,669 mnist_classifier_MNISTClassifier fww1veub 4c2108e5-ef9a-4f47-bb53-d3a55508f08d -- POST / 200 176.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,670 mnist_classifier_MNISTClassifier fww1veub ef4841ff-f111-436c-b123-b610b3541c98 -- POST / 200 177.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,671 mnist_classifier_MNISTClassifier fww1veub 47c2b770-c064-441d-bf22-cd0d35d6dad1 -- POST / 200 177.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,671 mnist_classifier_MNISTClassifier fww1veub fc0cc152-5dfe-439b-8e78-07744e5c37c7 -- POST / 200 177.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,676 mnist_classifier_MNISTClassifier fww1veub 7034fd3b-e956-4e86-a62c-c3aca855303e -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,676 mnist_classifier_MNISTClassifier fww1veub b2feaa9e-ec3f-42c5-a24c-a4ca518e7f53 -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,677 mnist_classifier_MNISTClassifier fww1veub 8c47dc97-46df-467c-b975-4bd047faecbf -- POST / 200 227.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,677 mnist_classifier_MNISTClassifier fww1veub bf32726d-4c2e-4b1a-9579-d85ada19a5b9 -- POST / 200 225.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,678 mnist_classifier_MNISTClassifier fww1veub e086dc63-1e48-405a-b27a-5f3ae6089aa2 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,678 mnist_classifier_MNISTClassifier fww1veub 26deba73-99bc-4124-a0a6-658bb8a70e7f -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,678 mnist_classifier_MNISTClassifier fww1veub 2afecff5-e3cd-41f7-8bda-3b4facb3fa38 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,678 mnist_classifier_MNISTClassifier fww1veub 11358ece-2a2b-4a66-bf54-588f463bd3eb -- POST / 200 220.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,679 mnist_classifier_MNISTClassifier fww1veub a65ad346-528d-4487-83e8-3a795f7c6380 -- POST / 200 220.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,679 mnist_classifier_MNISTClassifier fww1veub 9a6ffbba-6266-4c65-af3a-f278267cde98 -- POST / 200 220.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,680 mnist_classifier_MNISTClassifier fww1veub 3ecb09ef-aac6-4e31-b0f9-7159fb0f557f -- POST / 200 218.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,733 mnist_classifier_MNISTClassifier fww1veub e51387ab-68e6-4391-96ea-cc3b1651541e -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,767 mnist_classifier_MNISTClassifier fww1veub 2f741bde-b003-47ae-8c36-99c2b6886410 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,767 mnist_classifier_MNISTClassifier fww1veub 38171167-76b1-434c-aa08-ee6341cf2a69 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,767 mnist_classifier_MNISTClassifier fww1veub aab9f522-3326-4450-b1a2-d06070ddae49 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,768 mnist_classifier_MNISTClassifier fww1veub 56e944d0-a9a2-4c93-9352-467ecb754693 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,768 mnist_classifier_MNISTClassifier fww1veub a66e760d-1f08-42af-a53b-59cd1cb368f7 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,768 mnist_classifier_MNISTClassifier fww1veub 1e8f954a-4072-439f-85e5-1f3e3c2fd1ab -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:41,768 mnist_classifier_MNISTClassifier fww1veub 33f511c5-ad3f-4b07-a10e-7ed171d9522a -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,036 mnist_classifier_MNISTClassifier fww1veub aca2be88-d94e-467d-9e75-241d2f24b671 -- POST / 200 378.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,042 mnist_classifier_MNISTClassifier fww1veub a1566563-ce65-44a5-9641-89ac51321017 -- POST / 200 385.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,043 mnist_classifier_MNISTClassifier fww1veub 8060a03e-da0a-4956-bb5c-9430c507aee7 -- POST / 200 361.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,043 mnist_classifier_MNISTClassifier fww1veub d4e0d8be-127a-4ff9-9cbd-c30738775dc6 -- POST / 200 357.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,044 mnist_classifier_MNISTClassifier fww1veub 2467ed44-4bc6-4815-9d15-7efa8c0f6a18 -- POST / 200 344.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,044 mnist_classifier_MNISTClassifier fww1veub fb91f9b4-d52b-455b-a54e-6fee8dc5826e -- POST / 200 357.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,045 mnist_classifier_MNISTClassifier fww1veub 60c3f96c-287f-4193-86b2-214c1c47d7d3 -- POST / 200 357.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,045 mnist_classifier_MNISTClassifier fww1veub b8ce3e34-8c02-4739-a41e-7c65e8609bf0 -- POST / 200 356.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,143 mnist_classifier_MNISTClassifier fww1veub c2bd718a-4bf7-4b3e-8a5d-a17be4cdf88d -- POST / 200 452.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,146 mnist_classifier_MNISTClassifier fww1veub 0b23bb0f-91d9-4f10-baf0-5b5ef6f3207c -- POST / 200 455.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,146 mnist_classifier_MNISTClassifier fww1veub be66da22-b064-4c2d-8bb2-08776034c446 -- POST / 200 453.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,147 mnist_classifier_MNISTClassifier fww1veub 72eac775-7c7e-4c87-adb9-c361bafca235 -- POST / 200 453.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,149 mnist_classifier_MNISTClassifier fww1veub 9dee04d6-25b9-4249-81f4-68a86d95714d -- POST / 200 455.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,153 mnist_classifier_MNISTClassifier fww1veub 9e2035d6-1552-45cb-9404-bbae665bb3be -- POST / 200 457.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,153 mnist_classifier_MNISTClassifier fww1veub d8aff3ca-ea45-48a0-a39e-47976295ee7e -- POST / 200 456.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,154 mnist_classifier_MNISTClassifier fww1veub 56e11891-c74f-4321-9894-757ac1749848 -- POST / 200 455.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,155 mnist_classifier_MNISTClassifier fww1veub 64d466bd-efa5-4f6a-8493-ce1f17eb9f4a -- POST / 200 455.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,155 mnist_classifier_MNISTClassifier fww1veub d0828a5d-463d-4794-948d-690de8187864 -- POST / 200 455.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,157 mnist_classifier_MNISTClassifier fww1veub d5a8d373-b869-4910-88e6-66ed2d26fd66 -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,158 mnist_classifier_MNISTClassifier fww1veub 7c1fb95d-0dfd-45b2-aa86-abe5eba4f81e -- POST / 200 455.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,159 mnist_classifier_MNISTClassifier fww1veub 1e2ac732-37a0-4c80-ab80-9787e7005882 -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,160 mnist_classifier_MNISTClassifier fww1veub 080c4e34-693e-4837-bc33-41d4e48ac81c -- POST / 200 385.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,160 mnist_classifier_MNISTClassifier fww1veub 3d657991-cc50-4e86-b52b-20523fdc96f3 -- POST / 200 456.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,160 mnist_classifier_MNISTClassifier fww1veub 18f3875f-e123-4292-9111-0f89edf3d197 -- POST / 200 455.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,160 mnist_classifier_MNISTClassifier fww1veub 2eca38b3-4129-4a92-a780-835a7a478d52 -- POST / 200 455.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,161 mnist_classifier_MNISTClassifier fww1veub f7639f04-738e-4519-84dd-881ff5068490 -- POST / 200 455.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,161 mnist_classifier_MNISTClassifier fww1veub 9ded92e8-904c-4c43-b250-18007a8eb8ce -- POST / 200 453.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,162 mnist_classifier_MNISTClassifier fww1veub 66ca6466-06d2-4c9c-ab04-265ed2300479 -- POST / 200 443.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,162 mnist_classifier_MNISTClassifier fww1veub 11b6463c-e438-4c10-81a5-b2780193e56a -- POST / 200 443.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,162 mnist_classifier_MNISTClassifier fww1veub 2aec8904-ca43-4df6-bcc4-db60c40922ff -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,162 mnist_classifier_MNISTClassifier fww1veub f2237852-f771-4108-937d-effe3f130488 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,163 mnist_classifier_MNISTClassifier fww1veub 9d1f9de6-f06c-48e6-bcdb-b89636d57f74 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,163 mnist_classifier_MNISTClassifier fww1veub 8b8ac486-8625-438e-b761-0f4ca2b57a81 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,163 mnist_classifier_MNISTClassifier fww1veub 23b18325-c350-4456-825c-5c7a965be063 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,163 mnist_classifier_MNISTClassifier fww1veub 6f32e8fe-d867-4c93-a668-4a8f7baf802d -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,164 mnist_classifier_MNISTClassifier fww1veub 1ac30b7e-c6b6-4cd4-9818-baf6e284bced -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,164 mnist_classifier_MNISTClassifier fww1veub 2002b169-ce6b-4b0f-b1c8-d8039dd32d74 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,164 mnist_classifier_MNISTClassifier fww1veub c039ed9e-b041-41aa-8c6e-f56499d096c9 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,164 mnist_classifier_MNISTClassifier fww1veub ccf570a8-251a-4132-b0dd-356945c3190a -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,165 mnist_classifier_MNISTClassifier fww1veub 774aad93-f645-406c-a276-65fb148747e2 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,165 mnist_classifier_MNISTClassifier fww1veub 177823fa-bcea-4409-8493-d98b07f46e15 -- POST / 200 379.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,165 mnist_classifier_MNISTClassifier fww1veub 21022f73-7a06-4be9-8f27-cf8fbce4fb66 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,166 mnist_classifier_MNISTClassifier fww1veub 0db08c25-ae79-4d58-a3b1-4c08a27015fd -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,167 mnist_classifier_MNISTClassifier fww1veub 5b9854a5-f439-47f1-939a-2e08b40dc6a1 -- POST / 200 391.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,167 mnist_classifier_MNISTClassifier fww1veub eafb13d9-ffe5-448e-8c64-174c45595a1f -- POST / 200 392.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,168 mnist_classifier_MNISTClassifier fww1veub 40c38da5-50eb-4996-84e4-380608f0cfa3 -- POST / 200 387.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,168 mnist_classifier_MNISTClassifier fww1veub fcc9ce9c-6c0d-417d-986f-1422dec88129 -- POST / 200 387.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,169 mnist_classifier_MNISTClassifier fww1veub dc9ae51f-4d0e-41d6-8258-d27e32769e8c -- POST / 200 382.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,170 mnist_classifier_MNISTClassifier fww1veub 125cfe96-5b78-4a02-b7b1-42477831fdc5 -- POST / 200 386.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,170 mnist_classifier_MNISTClassifier fww1veub 5dae7313-2ee1-4c72-8943-ca75536bce33 -- POST / 200 383.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,170 mnist_classifier_MNISTClassifier fww1veub 5eaa7a56-6d22-4dfd-961d-99699aec7d33 -- POST / 200 379.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,170 mnist_classifier_MNISTClassifier fww1veub 601eb756-0aaf-4ea7-8cbe-3a88127a2c03 -- POST / 200 379.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,171 mnist_classifier_MNISTClassifier fww1veub f2e54e95-a401-416d-8ee3-4394e669c854 -- POST / 200 378.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,171 mnist_classifier_MNISTClassifier fww1veub 8c7429bf-c871-4211-b48b-8126ad2808e7 -- POST / 200 377.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,171 mnist_classifier_MNISTClassifier fww1veub 126c7b27-f443-4c81-8392-f2521f2de7dd -- POST / 200 376.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,172 mnist_classifier_MNISTClassifier fww1veub fd53aa7e-55ad-4542-beeb-50cad36e541a -- POST / 200 372.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,172 mnist_classifier_MNISTClassifier fww1veub 4e9b8e42-4ef1-450f-9f8e-9f447eb297e5 -- POST / 200 371.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,173 mnist_classifier_MNISTClassifier fww1veub 7a644cb9-a1e3-438d-a57f-eca5dfb83193 -- POST / 200 370.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,173 mnist_classifier_MNISTClassifier fww1veub ba108b12-2ce3-46da-91ca-d3da7f2dd054 -- POST / 200 370.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,174 mnist_classifier_MNISTClassifier fww1veub 9e0fd6ed-b6d8-4590-a5b1-ba4a175d1ffe -- POST / 200 371.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,174 mnist_classifier_MNISTClassifier fww1veub c9c7f5bd-1ea7-4d05-9899-7bf3d6b3ba26 -- POST / 200 370.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,175 mnist_classifier_MNISTClassifier fww1veub ee4b72ce-738a-4c72-a9c8-05012f0eae7c -- POST / 200 370.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,175 mnist_classifier_MNISTClassifier fww1veub 11de3eb7-9ba7-45a9-9c08-684dbdc90161 -- POST / 200 369.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,175 mnist_classifier_MNISTClassifier fww1veub c3405032-445e-4d6f-bd2f-79b747dad205 -- POST / 200 368.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,176 mnist_classifier_MNISTClassifier fww1veub 98813ef3-64f8-41b5-9de5-a8942dad8294 -- POST / 200 367.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,176 mnist_classifier_MNISTClassifier fww1veub 90680155-d03f-4532-8ea5-67b8bfee87ea -- POST / 200 368.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,176 mnist_classifier_MNISTClassifier fww1veub 76cd8024-1e15-4ab8-894e-09a42e07b0f4 -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,177 mnist_classifier_MNISTClassifier fww1veub 536b0c1e-563b-4cbc-b61d-4a2d93843957 -- POST / 200 367.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,177 mnist_classifier_MNISTClassifier fww1veub ee85be79-a6d5-4457-8384-3f0a06757930 -- POST / 200 366.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,178 mnist_classifier_MNISTClassifier fww1veub c5558a4a-6eb6-4e51-a10f-c15c3f322247 -- POST / 200 365.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,178 mnist_classifier_MNISTClassifier fww1veub b32609ff-cc3a-4f4e-818d-fdb796190eea -- POST / 200 364.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,178 mnist_classifier_MNISTClassifier fww1veub cab28888-45f2-41de-a667-c5fa5b2fc19b -- POST / 200 364.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,179 mnist_classifier_MNISTClassifier fww1veub c19d7008-b3d6-4309-9147-8d02984516c5 -- POST / 200 364.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,179 mnist_classifier_MNISTClassifier fww1veub 13c49ef8-2aa0-47a1-b940-3ecc02d4cb7d -- POST / 200 362.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,180 mnist_classifier_MNISTClassifier fww1veub 4b61f250-2e1a-4735-98c8-12d5b2e3e402 -- POST / 200 363.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,180 mnist_classifier_MNISTClassifier fww1veub 55f56673-95f0-4279-a69f-134ff0be7c46 -- POST / 200 362.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,181 mnist_classifier_MNISTClassifier fww1veub 9ee08441-31b4-48b8-a10e-d375c653206e -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,184 mnist_classifier_MNISTClassifier fww1veub dcbf1ef0-65c1-4461-9869-87158056a95d -- POST / 200 359.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,185 mnist_classifier_MNISTClassifier fww1veub 1f2ec893-16f2-4e3f-923d-7357e54e6122 -- POST / 200 366.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,186 mnist_classifier_MNISTClassifier fww1veub 64074de7-9a08-43ad-a0d3-29ca605e3508 -- POST / 200 363.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,186 mnist_classifier_MNISTClassifier fww1veub 8b7c4dc8-90ce-4138-85ad-b15f18e3fc60 -- POST / 200 361.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,187 mnist_classifier_MNISTClassifier fww1veub 133c1221-ee2d-43d3-b35d-2c506fae4d74 -- POST / 200 360.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,187 mnist_classifier_MNISTClassifier fww1veub 2c3042ba-e4f6-4215-8af7-46c3aee79176 -- POST / 200 360.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,187 mnist_classifier_MNISTClassifier fww1veub 3d1df8f0-0ee9-452b-a8b4-9ba171ac3f27 -- POST / 200 357.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,188 mnist_classifier_MNISTClassifier fww1veub 5c5a50a4-d6ee-4146-b507-7388a3e221dd -- POST / 200 357.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,188 mnist_classifier_MNISTClassifier fww1veub c900705b-4c9d-4cb4-9607-95af6fdf0bd4 -- POST / 200 357.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,196 mnist_classifier_MNISTClassifier fww1veub 89bed802-22f7-479a-a77e-22d2a451d3a9 -- POST / 200 225.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,197 mnist_classifier_MNISTClassifier fww1veub 8cfbe727-aeb5-4228-b946-954b9a3dd944 -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,199 mnist_classifier_MNISTClassifier fww1veub 95300016-4f90-43e1-a912-dca185406e1f -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,200 mnist_classifier_MNISTClassifier fww1veub dd7f385b-9efe-4c30-904a-ea63d78b28a0 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,200 mnist_classifier_MNISTClassifier fww1veub 13129aef-a398-412b-b394-4b3cd7df8625 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,201 mnist_classifier_MNISTClassifier fww1veub d39cf33e-cda7-40ed-9291-93b22b3daf85 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,201 mnist_classifier_MNISTClassifier fww1veub 06af7e99-84eb-42b2-a983-3dbc9d3652f3 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,202 mnist_classifier_MNISTClassifier fww1veub 71df87ec-e13d-494e-868c-ff00b291ce2b -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,202 mnist_classifier_MNISTClassifier fww1veub e70ed066-3153-464e-8ea4-c85fabda9d80 -- POST / 200 222.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,204 mnist_classifier_MNISTClassifier fww1veub 89b629c4-b76e-456e-a255-0f42f8c1a9e1 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,204 mnist_classifier_MNISTClassifier fww1veub 7569f607-874d-46b5-aa36-72a00e2f04a5 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,204 mnist_classifier_MNISTClassifier fww1veub a0b5c405-8910-4d01-a7ff-d34dd0d57c7c -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,204 mnist_classifier_MNISTClassifier fww1veub a072aff0-b0d9-4356-bbc0-1eac260af5e3 -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,205 mnist_classifier_MNISTClassifier fww1veub dd9735bb-6df8-40ff-8b50-a85ba6fa9436 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,205 mnist_classifier_MNISTClassifier fww1veub c46f4a7a-9382-4a92-b662-09754e0f49ba -- POST / 200 190.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,208 mnist_classifier_MNISTClassifier fww1veub 8dc57c03-5482-48c3-8c43-7e9feae4f507 -- POST / 200 184.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,210 mnist_classifier_MNISTClassifier fww1veub 81bc16be-3187-4d70-a625-71452e9b09f4 -- POST / 200 183.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,263 mnist_classifier_MNISTClassifier fww1veub 2b685a3a-e696-432f-afa8-8ef51a7fd114 -- POST / 200 157.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,303 mnist_classifier_MNISTClassifier fww1veub 45770e2d-51a9-4d76-bed2-5bd501fc0c05 -- POST / 200 196.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,305 mnist_classifier_MNISTClassifier fww1veub fc3b65a9-a324-442f-90c6-4cf58e3f9245 -- POST / 200 198.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,305 mnist_classifier_MNISTClassifier fww1veub 3f3aa872-2f3a-4173-b379-35b880346ad0 -- POST / 200 198.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,305 mnist_classifier_MNISTClassifier fww1veub e9216a57-47de-4111-988b-6bb902130439 -- POST / 200 197.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,407 mnist_classifier_MNISTClassifier fww1veub 315f27e2-7f92-446e-b79d-3ae198d35601 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,408 mnist_classifier_MNISTClassifier fww1veub f956b910-f0c2-444e-ad86-c34a5bf290cc -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,411 mnist_classifier_MNISTClassifier fww1veub 908fc5a5-f314-446b-a536-26464a55949e -- POST / 200 226.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,411 mnist_classifier_MNISTClassifier fww1veub dbae4d7b-134d-4de8-a475-5b1d573a4d5d -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,412 mnist_classifier_MNISTClassifier fww1veub bf657693-b4ad-4e54-8c78-0637decf758e -- POST / 200 204.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,412 mnist_classifier_MNISTClassifier fww1veub 67d95045-95e3-410b-bc94-4bf736c8944d -- POST / 200 198.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,413 mnist_classifier_MNISTClassifier fww1veub e83eeb44-da4b-4bfe-9d3c-df6a29b2ff32 -- POST / 200 197.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,413 mnist_classifier_MNISTClassifier fww1veub d2496510-7654-464d-9983-ec96e3775a0b -- POST / 200 196.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,413 mnist_classifier_MNISTClassifier fww1veub 903e49b3-520b-4004-8335-3472fd394e1b -- POST / 200 197.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,414 mnist_classifier_MNISTClassifier fww1veub f22f179c-bf31-40c4-be16-3fb77201d7fe -- POST / 200 195.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,415 mnist_classifier_MNISTClassifier fww1veub 372375db-faed-4ffc-b809-279b6ca0bc44 -- POST / 200 197.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,421 mnist_classifier_MNISTClassifier fww1veub 2ef2d2b4-21ed-49c2-85de-f9625a39277c -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,423 mnist_classifier_MNISTClassifier fww1veub 1d36e6cb-6fac-4955-8916-c5d198d820d6 -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,424 mnist_classifier_MNISTClassifier fww1veub d9e8ec2d-82db-40d1-a4b5-44b22644a2f4 -- POST / 200 200.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,425 mnist_classifier_MNISTClassifier fww1veub 92c724d1-73f3-42b4-81be-d0d7e4be2121 -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,433 mnist_classifier_MNISTClassifier fww1veub 8ebcf85e-12f9-4b70-9b75-a35453569e68 -- POST / 200 211.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,434 mnist_classifier_MNISTClassifier fww1veub e7cbafcf-7b8e-452f-8294-aa118c03450e -- POST / 200 211.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,434 mnist_classifier_MNISTClassifier fww1veub 8344ef60-0e8e-4721-a6ae-69688914d117 -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,552 mnist_classifier_MNISTClassifier fww1veub 3a413559-047d-4f67-a201-d706e881a516 -- POST / 200 325.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,553 mnist_classifier_MNISTClassifier fww1veub 87d6ee5d-cd41-4077-bd5a-ed297fec8b02 -- POST / 200 327.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,553 mnist_classifier_MNISTClassifier fww1veub f187f0bf-45d0-4bbb-bedc-e49037345e3e -- POST / 200 324.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,553 mnist_classifier_MNISTClassifier fww1veub a6972385-7c51-4bc2-a814-686d6af4bf53 -- POST / 200 323.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,554 mnist_classifier_MNISTClassifier fww1veub 6b27ff42-fdee-4f19-9628-e9af455ecf8f -- POST / 200 325.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,555 mnist_classifier_MNISTClassifier fww1veub a337afbc-f970-4789-bd5f-7ef4bb91e982 -- POST / 200 325.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,559 mnist_classifier_MNISTClassifier fww1veub 382c5318-fe8b-4fb0-bfc7-0aaecc3f94be -- POST / 200 328.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,560 mnist_classifier_MNISTClassifier fww1veub f4add161-0f55-420d-bc8f-b183678d5e8f -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,560 mnist_classifier_MNISTClassifier fww1veub 83aefc55-9798-4a56-b2ff-0094cdb61f04 -- POST / 200 312.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,560 mnist_classifier_MNISTClassifier fww1veub 3c7f1e36-acd9-485e-ba72-efd12f4ec4c0 -- POST / 200 324.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,561 mnist_classifier_MNISTClassifier fww1veub 39b0030f-3583-4fbf-bf0d-485bc7a6aa7c -- POST / 200 317.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,561 mnist_classifier_MNISTClassifier fww1veub dceea251-e90d-4a3c-802b-721a8c32096a -- POST / 200 317.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,561 mnist_classifier_MNISTClassifier fww1veub 16405412-a243-4663-9c7f-61a69ce3a92f -- POST / 200 307.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,561 mnist_classifier_MNISTClassifier fww1veub 6eb8ef8b-d213-42b8-84f8-2028aa79ba1b -- POST / 200 304.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,562 mnist_classifier_MNISTClassifier fww1veub b78c70b3-b077-4521-a8c3-0f8d538ebabc -- POST / 200 304.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,562 mnist_classifier_MNISTClassifier fww1veub 8e985899-6e7b-451a-ad54-bc71793976b8 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,562 mnist_classifier_MNISTClassifier fww1veub b5b2921c-1895-4783-a4d6-cfa293ef64d8 -- POST / 200 299.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,563 mnist_classifier_MNISTClassifier fww1veub 80bc6600-0b2d-48d7-84ce-728f796d5aa2 -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,563 mnist_classifier_MNISTClassifier fww1veub cecd7a7c-cb1f-4cba-8ce5-b92e8a81eaa3 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,563 mnist_classifier_MNISTClassifier fww1veub 5b298d0a-93b0-4865-83b3-6491ade4a622 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,563 mnist_classifier_MNISTClassifier fww1veub ba038180-acbb-445c-876b-b04930b3e948 -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,564 mnist_classifier_MNISTClassifier fww1veub 5862f07b-d2b0-4463-82f3-dbe128abac6a -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,564 mnist_classifier_MNISTClassifier fww1veub 0ca5e42a-a7b1-4a29-a179-475e7ea2b3bc -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,564 mnist_classifier_MNISTClassifier fww1veub 122c0e13-f319-465b-a844-e7f0a2d38e85 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,564 mnist_classifier_MNISTClassifier fww1veub 04cf026f-571d-42b8-9859-a356c20a2224 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,565 mnist_classifier_MNISTClassifier fww1veub d2952eee-23a3-4474-9642-d19581125316 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,565 mnist_classifier_MNISTClassifier fww1veub bfd45d5c-97af-4e56-8237-fd592c1b3dc3 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,565 mnist_classifier_MNISTClassifier fww1veub a2628b93-0e6b-4d24-875d-02d0009890a7 -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,565 mnist_classifier_MNISTClassifier fww1veub fefce39b-b00d-41c5-b21c-57d2e73c3b67 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,566 mnist_classifier_MNISTClassifier fww1veub f1870dbe-0b03-4fa3-ad57-0012e2d61fb6 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,566 mnist_classifier_MNISTClassifier fww1veub 93dde0f7-bcab-4b13-99c4-976653047e47 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,566 mnist_classifier_MNISTClassifier fww1veub bd530c22-0d92-48aa-b9bc-0f84c799e33c -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,567 mnist_classifier_MNISTClassifier fww1veub fcc91965-251d-486a-be88-b739aff7ffaa -- POST / 200 242.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,567 mnist_classifier_MNISTClassifier fww1veub 7cfca20f-5df8-4371-962c-8c7351ac8152 -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,567 mnist_classifier_MNISTClassifier fww1veub 3e8379f5-9dd0-45ac-8779-fbea6afd8635 -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,567 mnist_classifier_MNISTClassifier fww1veub e7b585c1-5f9c-49fb-b140-f2fb57f20228 -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,568 mnist_classifier_MNISTClassifier fww1veub 5318306e-89f4-4466-b7dc-6c1b67b832ee -- POST / 200 240.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,568 mnist_classifier_MNISTClassifier fww1veub b94f912a-f354-4a75-8374-9b41a1a68bd8 -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,569 mnist_classifier_MNISTClassifier fww1veub f005c05f-941c-47ba-a70c-c9c2cedfd3db -- POST / 200 239.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,569 mnist_classifier_MNISTClassifier fww1veub 8ad8bd80-e4ae-44f6-bfce-a4db276c79a6 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,570 mnist_classifier_MNISTClassifier fww1veub efb8533d-eb31-4f60-b925-1a5e26a33ca5 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,570 mnist_classifier_MNISTClassifier fww1veub 972befc7-f388-4f05-aaf7-49d5bfbfd10f -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,570 mnist_classifier_MNISTClassifier fww1veub e3f80910-54a4-4dd3-aba2-8c59bcdad563 -- POST / 200 235.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,570 mnist_classifier_MNISTClassifier fww1veub d1659ae8-2d3c-46dc-a804-b64eb4b5fd98 -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,571 mnist_classifier_MNISTClassifier fww1veub 5ad97f30-7576-4fd5-a345-2aa231f50009 -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,571 mnist_classifier_MNISTClassifier fww1veub da3f536a-5694-4a12-b14e-e579583d07d6 -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,571 mnist_classifier_MNISTClassifier fww1veub df4de442-300a-449b-9388-1f881801338d -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,572 mnist_classifier_MNISTClassifier fww1veub 7da9a4c2-1a46-48e0-b1a5-7756e3e2de42 -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,572 mnist_classifier_MNISTClassifier fww1veub 0349ea1a-b143-4b7b-bb8a-cc58198b98f9 -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,572 mnist_classifier_MNISTClassifier fww1veub cff85d21-f953-46fc-9bbe-760de542d950 -- POST / 200 231.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,573 mnist_classifier_MNISTClassifier fww1veub 9224b208-5233-42a9-b3e1-d72a632b5240 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,574 mnist_classifier_MNISTClassifier fww1veub a09272fd-dcc8-4586-bae9-5dd30e73f55f -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,574 mnist_classifier_MNISTClassifier fww1veub eb722f67-d29b-4967-945d-42dc242827eb -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,575 mnist_classifier_MNISTClassifier fww1veub 570b7cfd-7e13-40c3-be8a-e126da027bc2 -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,576 mnist_classifier_MNISTClassifier fww1veub 09b5793d-1fd0-415e-8dc1-78d3a8b7e403 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,576 mnist_classifier_MNISTClassifier fww1veub 6ff8092f-a066-4c4e-b2b6-e9af7c056298 -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,577 mnist_classifier_MNISTClassifier fww1veub 976f170f-d161-4e71-b660-5a5c65dff10b -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,578 mnist_classifier_MNISTClassifier fww1veub 7f5572f3-7018-41a2-b772-22646d9c71b8 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,578 mnist_classifier_MNISTClassifier fww1veub f7e678d1-2275-49a1-921f-ff9fe63c7941 -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,579 mnist_classifier_MNISTClassifier fww1veub e288590a-1cdf-47a0-afbb-93729e4cb33e -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,580 mnist_classifier_MNISTClassifier fww1veub fc205b4a-913b-4c1b-b4c9-5bf984ef60b3 -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,582 mnist_classifier_MNISTClassifier fww1veub 048389ae-0496-4627-9f9c-7994c6adee8d -- POST / 200 228.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,582 mnist_classifier_MNISTClassifier fww1veub 9ddb70f4-4162-429b-a111-a16f53f61e1b -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,583 mnist_classifier_MNISTClassifier fww1veub 0ab2b768-e1e8-4321-b08b-76c99c211683 -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,583 mnist_classifier_MNISTClassifier fww1veub 1e52a1d6-497f-4b3a-96b7-6973e200238e -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,584 mnist_classifier_MNISTClassifier fww1veub 31857bb0-317b-47aa-841c-6e07c3831c1d -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,585 mnist_classifier_MNISTClassifier fww1veub 76059ce7-db6b-4299-a865-9409daf62ae8 -- POST / 200 226.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,586 mnist_classifier_MNISTClassifier fww1veub 2ee85db7-0761-41e8-a1a4-d97829a182d1 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,586 mnist_classifier_MNISTClassifier fww1veub 8370d350-27ec-4a29-be17-542f3752c69c -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,592 mnist_classifier_MNISTClassifier fww1veub 0c6288ba-e25e-4410-8649-077a0a240571 -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,592 mnist_classifier_MNISTClassifier fww1veub 0f89dc60-9dc6-4b1f-8c0a-9da3ca4d5684 -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,595 mnist_classifier_MNISTClassifier fww1veub c140c16b-318a-4401-b2c6-fe991cd6c7c8 -- POST / 200 231.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,595 mnist_classifier_MNISTClassifier fww1veub ee9756ed-9b2d-4a05-8ad0-81dcb81cd70f -- POST / 200 230.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,595 mnist_classifier_MNISTClassifier fww1veub 21278f58-67b3-4ada-86be-6d7c275fcf5b -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,596 mnist_classifier_MNISTClassifier fww1veub 83e53c38-fc05-4f25-b2aa-bae315a7230a -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,597 mnist_classifier_MNISTClassifier fww1veub 25d6a07e-3836-4205-a834-41a487dd1fc9 -- POST / 200 231.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,599 mnist_classifier_MNISTClassifier fww1veub 3f07056b-d143-433e-835d-650d426daeaa -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,600 mnist_classifier_MNISTClassifier fww1veub 13329ff1-d051-49f7-a5a5-8b56549a48a3 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,600 mnist_classifier_MNISTClassifier fww1veub 4a33e503-797e-4b90-badd-6a763c1e9172 -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,601 mnist_classifier_MNISTClassifier fww1veub 54d2d07a-484c-4215-b3a8-01c3e3d8c1d9 -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,603 mnist_classifier_MNISTClassifier fww1veub eef690eb-013f-48c7-af40-d3e3454cfa0e -- POST / 200 215.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,603 mnist_classifier_MNISTClassifier fww1veub 051d5c2b-5c7b-4441-900b-334abfb52501 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,603 mnist_classifier_MNISTClassifier fww1veub 84671aff-0853-4c7f-babb-1c12769e8fc4 -- POST / 200 167.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,604 mnist_classifier_MNISTClassifier fww1veub b1b4b697-6ede-4695-bb29-54b890d3ec8f -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,604 mnist_classifier_MNISTClassifier fww1veub c1d9b012-6c1f-49fb-8211-e29c17c25647 -- POST / 200 164.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,604 mnist_classifier_MNISTClassifier fww1veub cc09c447-6f7c-4ea7-b351-f2f18fee387a -- POST / 200 162.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,605 mnist_classifier_MNISTClassifier fww1veub 7c706c3d-c028-4160-8b48-e0a06dd0d4d8 -- POST / 200 161.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,605 mnist_classifier_MNISTClassifier fww1veub 83d1e834-43f0-43f2-a093-0c365d6b1493 -- POST / 200 159.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,606 mnist_classifier_MNISTClassifier fww1veub ca21ef3d-c1c4-46b0-9a37-0ac9cb760575 -- POST / 200 159.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,606 mnist_classifier_MNISTClassifier fww1veub ec66a215-42d4-4fb4-84ac-6438abd791b0 -- POST / 200 159.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,606 mnist_classifier_MNISTClassifier fww1veub 568cc31e-84e9-49e1-8e16-2539c50e4e7a -- POST / 200 158.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,606 mnist_classifier_MNISTClassifier fww1veub 1cc2b483-d9bb-46f9-bcbf-6bdd633acc8c -- POST / 200 157.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub 517e3716-960a-417a-9d33-e207e9070f2e -- POST / 200 157.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub c3c13218-1775-4dc4-8792-bc636611b81b -- POST / 200 155.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub 9283fbf5-adb2-4dd5-8993-79f5a98947b0 -- POST / 200 152.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub 12d02cdb-c969-4472-84bf-a3830992c72d -- POST / 200 150.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub 581507ed-55b5-40a1-b221-9ff37914b5a3 -- POST / 200 147.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub 68ccf165-c0e9-46a8-8c49-5ac1b6b47bb7 -- POST / 200 147.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,607 mnist_classifier_MNISTClassifier fww1veub 00fd014b-48ba-4f4f-a005-042a99671dc1 -- POST / 200 146.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,608 mnist_classifier_MNISTClassifier fww1veub c20a09c2-6b24-4584-a6f2-811206e4e00b -- POST / 200 146.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,899 mnist_classifier_MNISTClassifier fww1veub a87bef07-2bfc-4a1b-931b-e9d98eb15967 -- POST / 200 282.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,907 mnist_classifier_MNISTClassifier fww1veub 8dfb3a56-18ce-4da5-a4d4-6c527da8b26c -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,907 mnist_classifier_MNISTClassifier fww1veub 1361e9a8-ff2a-4ad2-86ff-f00367a1f2ab -- POST / 200 290.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,907 mnist_classifier_MNISTClassifier fww1veub b03af66f-dda1-4924-aa76-df0685deee3c -- POST / 200 289.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,908 mnist_classifier_MNISTClassifier fww1veub cf4b99f4-4280-46b5-a832-491354308183 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,908 mnist_classifier_MNISTClassifier fww1veub f96511b6-8fd8-47df-9d7c-89913abb38ea -- POST / 200 288.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,908 mnist_classifier_MNISTClassifier fww1veub 532076c5-ce3c-4072-be0f-73f74f10e568 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,908 mnist_classifier_MNISTClassifier fww1veub e745c550-8bee-4433-acc6-7e2511432ae7 -- POST / 200 286.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,908 mnist_classifier_MNISTClassifier fww1veub 76da936f-a3ec-4ea0-9899-22ca560a6b71 -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,908 mnist_classifier_MNISTClassifier fww1veub e6947954-2cf0-479d-9e09-2417a9d032c0 -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub c416a331-ec95-4edd-ba16-f0bfbad87bac -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub 6cd62b9f-6d1b-40b3-8cfa-114548747886 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub 527153a7-5ce0-4c17-a976-7b59390b4917 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub 573ad8b7-ab0e-4a07-ba8f-721a0979e729 -- POST / 200 295.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub 015f1645-4e28-40be-a89a-9d38f0d17e86 -- POST / 200 282.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub 97914650-3326-4d0e-a9d6-613e49231c8c -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,909 mnist_classifier_MNISTClassifier fww1veub f8f9daca-df07-44b4-89dc-e61c176dfec3 -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,910 mnist_classifier_MNISTClassifier fww1veub 25592716-708d-4d8a-97f6-5edd815ba46d -- POST / 200 280.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,990 mnist_classifier_MNISTClassifier fww1veub 4e69bc47-4d47-4b8a-9dce-0e1ae1a08de0 -- POST / 200 360.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,991 mnist_classifier_MNISTClassifier fww1veub dcea4b01-72f7-449a-848f-49ce94d5894b -- POST / 200 345.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,992 mnist_classifier_MNISTClassifier fww1veub 3084c643-a3ab-43d3-90ff-a5c939615d6a -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,992 mnist_classifier_MNISTClassifier fww1veub a48ce566-8e0f-4cb8-b79a-17384140c0e9 -- POST / 200 352.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,993 mnist_classifier_MNISTClassifier fww1veub 0485c689-f521-4dc2-816c-711d73e7adf6 -- POST / 200 361.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,993 mnist_classifier_MNISTClassifier fww1veub a400000d-763e-4d31-8fde-c5f42c366ca6 -- POST / 200 361.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,993 mnist_classifier_MNISTClassifier fww1veub 2b12d099-87b5-46bf-aa5c-386149848929 -- POST / 200 359.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,994 mnist_classifier_MNISTClassifier fww1veub f02a5fc2-02ef-4cc7-8a1c-3cd225407831 -- POST / 200 358.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,994 mnist_classifier_MNISTClassifier fww1veub 7e31ed0c-5b77-4f26-9c2f-a55d2fc62182 -- POST / 200 358.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,995 mnist_classifier_MNISTClassifier fww1veub 669ea6e1-aedd-472a-b707-5727f1410962 -- POST / 200 358.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,996 mnist_classifier_MNISTClassifier fww1veub 321434d8-b408-4136-931e-9839b465963a -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,996 mnist_classifier_MNISTClassifier fww1veub 9ee0281b-75f7-47b9-8d63-cfb4d45b7d06 -- POST / 200 354.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,997 mnist_classifier_MNISTClassifier fww1veub fa6a9740-21cf-4967-9687-99b4bb45af46 -- POST / 200 338.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,997 mnist_classifier_MNISTClassifier fww1veub ae960b14-9feb-4112-a201-cd108428f9bf -- POST / 200 335.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,998 mnist_classifier_MNISTClassifier fww1veub fdf2f7f9-84b3-4bad-80ab-c5a785c61b81 -- POST / 200 334.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,998 mnist_classifier_MNISTClassifier fww1veub d2a181a1-ae9e-4486-a9fe-07c17caa19c0 -- POST / 200 324.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:42,999 mnist_classifier_MNISTClassifier fww1veub 142b84f8-8108-4fbb-b4d7-e22fe797a98e -- POST / 200 334.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,000 mnist_classifier_MNISTClassifier fww1veub 4ae4a731-1bdf-4d73-9db3-ccd25211ab2c -- POST / 200 334.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,000 mnist_classifier_MNISTClassifier fww1veub 167d37f2-be57-4d06-9fca-39a0664c0417 -- POST / 200 331.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,001 mnist_classifier_MNISTClassifier fww1veub 3088242b-0d34-4225-a453-016a849115ec -- POST / 200 331.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,002 mnist_classifier_MNISTClassifier fww1veub 0d1145f6-11f0-4dbd-a826-e0e88c67318b -- POST / 200 332.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,002 mnist_classifier_MNISTClassifier fww1veub 8bd32c91-7803-4c2d-ba5e-ac7b872ee041 -- POST / 200 331.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,003 mnist_classifier_MNISTClassifier fww1veub ad0a6fdf-140f-485b-ba95-a8db9b5b1f27 -- POST / 200 331.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,004 mnist_classifier_MNISTClassifier fww1veub d4905c4c-5a6a-4889-9895-ff18d981a5f8 -- POST / 200 331.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,005 mnist_classifier_MNISTClassifier fww1veub 7b33f5a3-099c-46db-97e1-36f8b46aabca -- POST / 200 331.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,005 mnist_classifier_MNISTClassifier fww1veub 8d2dd22a-93f3-44d7-90ff-ddf5adabbe04 -- POST / 200 331.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,006 mnist_classifier_MNISTClassifier fww1veub ecfcf354-b077-43cf-b14c-7e758d29c40e -- POST / 200 329.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,006 mnist_classifier_MNISTClassifier fww1veub 65df88b8-e631-4001-962b-a72acf52c2ea -- POST / 200 331.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,007 mnist_classifier_MNISTClassifier fww1veub 77853245-689b-451f-aa25-d592fcaa4e89 -- POST / 200 331.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,008 mnist_classifier_MNISTClassifier fww1veub 20a5f711-afaa-4a35-a19f-b2775cce4eff -- POST / 200 328.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,009 mnist_classifier_MNISTClassifier fww1veub 6a94b153-1a1b-4177-bec7-dd2f9df62b9f -- POST / 200 325.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,009 mnist_classifier_MNISTClassifier fww1veub 774df4f9-2b9c-489b-a61e-61159b03ad06 -- POST / 200 329.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,009 mnist_classifier_MNISTClassifier fww1veub 4cf4888c-f96a-4730-b176-8ef59262c781 -- POST / 200 327.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,010 mnist_classifier_MNISTClassifier fww1veub c0b1de28-9bc9-49c5-826d-7ef73a9cfff0 -- POST / 200 325.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,011 mnist_classifier_MNISTClassifier fww1veub 71372e77-0b61-450e-b9c9-48e5530805aa -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,011 mnist_classifier_MNISTClassifier fww1veub 506b3a9d-cc1f-4107-9e6f-a5c1e31d2bca -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,012 mnist_classifier_MNISTClassifier fww1veub 816d4586-6080-42a5-bbb4-06208f7939b9 -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,012 mnist_classifier_MNISTClassifier fww1veub 973cd1a8-2b30-4de8-8f7a-534872969d4b -- POST / 200 320.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,012 mnist_classifier_MNISTClassifier fww1veub 004ab647-d5c2-42ec-8ceb-6f03468feea0 -- POST / 200 320.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,013 mnist_classifier_MNISTClassifier fww1veub a8e84ef8-a335-4dbf-855d-ed45ceb03df1 -- POST / 200 321.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,015 mnist_classifier_MNISTClassifier fww1veub cd3676a2-5675-4a81-814d-f74427d135a7 -- POST / 200 323.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,016 mnist_classifier_MNISTClassifier fww1veub 3038ad0d-dc91-40b7-8631-268ea8393021 -- POST / 200 324.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,017 mnist_classifier_MNISTClassifier fww1veub 1ef19c9f-3efd-4a59-85bd-c07d375bc08f -- POST / 200 322.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,018 mnist_classifier_MNISTClassifier fww1veub 00d1db7a-9db2-4974-bf79-d1e04071c5c9 -- POST / 200 322.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,018 mnist_classifier_MNISTClassifier fww1veub 0616b2bc-d807-4004-af77-9dec358ecc9b -- POST / 200 322.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,019 mnist_classifier_MNISTClassifier fww1veub c940c839-6aa7-4991-b7ef-285c59d43236 -- POST / 200 316.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4530) INFO 2026-04-01 23:13:43,019 mnist_classifier_MNISTClassifier fww1veub 2010686b-d48c-42ec-be99-d4965d9a22cb -- POST / 200 315.4ms
Processed 1000 requests in 5.04 seconds
Throughput: 198.59 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance#

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment#

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion#

In this tutorial, you:

Deployed a PyTorch model using Ray Serve with production best practices.
Enabled dynamic request batching to optimize performance.
Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.
Tested the service with concurrent asynchronous requests.

Serve PyTorch models at scale with Ray Serve#

Setup#

Define a PyTorch model#

Define the Ray Serve deployment#

Configure autoscaling and resource allocation#

Test the endpoint with concurrent requests#

Fault tolerance#

Monitor the deployment#

Conclusion#

Further reading#

Docs

Tutorials

Resources