Skip to content

Commit

Permalink
doc: Update README
Browse files Browse the repository at this point in the history
  • Loading branch information
Hugoch committed Nov 12, 2024
1 parent 409df9a commit d4ead4e
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 6 deletions.
10 changes: 4 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Inference Benchmarker 🐢
# Inference Benchmarker
## The best tool for benchmarking inference engines and LLM performance


Expand Down Expand Up @@ -26,7 +26,7 @@ It can be used to benchmark any text generation server that exposes an OpenAI-co
## Table of contents

<!-- TOC -->
* [Inference Benchmarker 🐢](#inference-benchmarker-)
* [Inference Benchmarker](#inference-benchmarker)
* [The best tool for benchmarking inference engines and LLM performance](#the-best-tool-for-benchmarking-inference-engines-and-llm-performance)
* [Features](#features)
* [Table of contents](#table-of-contents)
Expand Down Expand Up @@ -220,12 +220,10 @@ Considering that JSON results are in `/path/to/results/dir`:
$ poetry install
$ cd extra/dashboard
$ poetry run python app.py --from-results-dir /path/to/results/dir




```

![dashboard.png](assets/dashboard.png)

## Development

You need [Rust](https://rustup.rs/) installed to build the benchmarking tool.
Expand Down
Binary file added assets/dashboard.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit d4ead4e

Please sign in to comment.