NERSC: End-to-End LLM Bootcamp
Tuesday, May 7, 2024
The NERSC End-to-End LLM Bootcamp will be hosted virtually for three days from May 7-9, 2024 and is co-organized by NERSC with support from OpenACC organization and NVIDIA.
The End-to-End LLM (Large Language Model) Bootcamp is designed from a real-world perspective that follows the data processing, development, and deployment pipeline paradigm. Attendees walk through the workflow of preprocessing the SQuAD (Stanford Question Answering Dataset) dataset for Question Answering task, training the dataset using BERT (Bidirectional Encoder Representations from Transformers), and executing prompt learning strategy using NVIDIA® NeMo™ and a transformer-based language model, NVIDIA Megatron. Attendees will also learn to optimize an LLM using NVIDIA TensorRT™, an SDK for high-performance deep learning inference, guardrail prompts and responses from the LLM model using NeMo Guardrails, and deploy the AI pipeline using NVIDIA Triton™ Inference Server, an open-source software that standardizes AI model deployment and execution across every workload.
This virtual bootcamp is a hands-on learning experience where you will be guided through step-by-step instructions with teaching assistants on hand to help throughout.
Eligibility and Prerequisites
This event is open to the general HPC community. However, due to limited capacity, active NERSC, ALCF, and OLCF users will receive priority consideration. Prerequisites:
- Basic experience with Python and PyTorch.
- No GPU programming experience is required.
Agenda
Please visit the NERSC event page for more details.
Application
The application deadline is April 21, 2024. For application and more details, please visit the event page. Please note acceptance is not confirmed until you have received a confirmation email.
