The VSC Research Center, TU Wien, and EuroCC Austria are organizing a two-day course on Large Language Models (LLM) on Supercomputers from 4 to 5 November 2024.
In this intensive two-and-a-half-day course, participants will explore the world of LLMs and their development on supercomputers. From the fundamentals to hands-on implementations, this course offers a comprehensive exploration of LLMs, including cutting-edge techniques and tools such as parameter-efficient fine-tuning (PEFT), quantization, zero redundancy optimizers (ZeRO), fully shared data parallelism (FSDP), DeepSpeed, and Huggingface Accelerate.
By the end of this course, participants will have gained the understanding, knowledge, and practical skills to develop LLMs effectively on supercomputers, empowering them to tackle challenging natural language processing tasks across various domains.
