The FSDL App

• Lab Overview - FSDL
• Setup instructions
• Lab Overview - Colab
• The deployed FSDL text recognizer application
• repo for the FSDL text recognizer application
• repo for the labs

Tech Stack:

• Model Serving
  • Ingress as a service
  • Frontend Library - Gradio
  • Model is wrapped in a Docker container
  • Model is deployed serverlessly using AWS Lambda
  • The container image lives in Amazon's Elastic Container Registry
• Monitoring
  • Monitoring Model Performance
• Model Training
  • Lambda Labs GPU
  • The Pytorch Library provides GPU accelerated array math and fucntionality for model training
  • The Pytorch Lightning Library provides the framework for training models using Pytorch.

Tutorials:

• Docker Tutorial
• What is serverless
• Convert Pytorch Models to Pytorch Lightning

Experiment and artefact Tracking

• Weights and Biases stores
• PyTorch lighting checkpoits that can be used to restart model training if interrupted. This enables used of chepaer preemptible cloud instance. These are essentially excess capacity that a cloud provider has which can be utilised, with the caveat that resources can be pre-empted (allocated away at the cloud provider's will)
• deployed model files

Model Handoff to production

• Pytorch lightning models are compiled down to a dialect of Torch called torchscript