Skip to content

Commit

Permalink
bumped langchain and openai version (#25)
Browse files Browse the repository at this point in the history
* bumped langchain and openai version

* langchain.openai -> langchain_openai

* remove unused type ignore
  • Loading branch information
ProKil authored Feb 5, 2024
1 parent bfc2554 commit 7ba57e4
Show file tree
Hide file tree
Showing 4 changed files with 1,165 additions and 822 deletions.
2 changes: 1 addition & 1 deletion lmlib/serve/lm_inference.py
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ def get_gpu_memory(max_gpus: Union[int, None] = None) -> list[float]:
with torch.cuda.device(gpu_id):
device = torch.cuda.current_device()
gpu_properties = torch.cuda.get_device_properties(device)
total_memory = gpu_properties.total_memory / (1024**3) # type: ignore
total_memory = gpu_properties.total_memory / (1024**3)
allocated_memory = torch.cuda.memory_allocated() / (1024**3)
available_memory = total_memory - allocated_memory
gpu_memory.append(available_memory)
Expand Down
Loading

0 comments on commit 7ba57e4

Please sign in to comment.