How SNOW Adopted Automatic Sharding

조회수 115회·2개월 전·길이 미제공

타임라인

아직 이 영상의 타임라인을 분석하지 못했어요.
전체 영상은 YouTube 에서 볼 수 있어요.

영상 설명 원문 보기

Korean version: https://youtu.be/Ab2GMyqwXxo

[Presentation Summary]
This presentation introduces how SNOW adopted Automatic Sharding to reliably operate thousands of AI content items on limited GPU resources through an automated approach.

[Target Audience]
Engineers who operate multiple AI models in GPU environments and are considering operational automation

[Table of Contents]
1. SNOW AI Content Serving Architecture and the Concept of Sharding
2. Limitations of Manual Sharding
3. Problem Definition of Automatic Sharding
4. Design of the Automatic Sharding Algorithm
5. Automatically Applying Automatic Sharding Results to the Production Infrastructure
6. Stable Deployment Strategy
7. Adoption Results