Skip to content

llama-3.1-70b-instruct

Description

llama-3.1-70b-instruct-nim website

The Llama 3.1 70B-Instruct NIM simplifies the deployment of the Llama 3.1 70B instruction tuned model which is optimized for language understanding, reasoning, and text generation use cases, and outperforms many of the available open source chat models on common industry benchmarks. Reference:

Environment Modules

Run module spider llama-3.1-70b-instruct-nim to find out what environment modules are available for this application.

Environment Variables

  • HPC_LLAMA-3.1-70B-INSTRUCT_DIR - installation directory
  • HPC_LLAMA-3.1-70B-INSTRUCT_BIN - executable directory
  • HPC_LLAMA-3.1-70B-INSTRUCT_IMAGE - the llama-3.1-70b-instruct nim container image

Categories

LLMs