For benchmark testing
Navigate to
vllm/benchmarks/inside the container.Modify the python files (.py) to perform benchmark testing.
If you have any feedback about Omnia documentation, please reach out at omnia.readme@dell.com.
Navigate to vllm/benchmarks/ inside the container.
Modify the python files (.py) to perform benchmark testing.
If you have any feedback about Omnia documentation, please reach out at omnia.readme@dell.com.