In part 1, we chose a text embedding model and saved the model with BentoML. Now, let’s create a BentoML Service which has the serving logic. Create a file service.py.
import bentoml
import torch
from bentoml.io import JSON, NumpyNdarray
from pydantic import BaseModel
from typing import Any,