Back to rankings

The-AI-Summer/Deep-Learning-In-Production

Jupyter Notebookamzn.to/3oa50Vj

Build, train, deploy, scale and maintain deep learning models. Understand ML infrastructure and MLOps using hands-on examples.

machine-learningproductiondeep-learningaitensorflowneural-networkpythondeploymentcloudtrainingunetsemantic-segmentation
Star Growth
Stars
1.3k
Forks
266
Weekly Growth
Issues
0
5001k
Jun 2020Jun 2022Jul 2024Jul 2026
README

Deep Learning In Production Book

You can know grab a copy of the book from here:

Build, train, deploy, scale and maintain deep learning models. Understand ML infrastructure and MLOps using hands-on examples.

What you will learn?

  • Best practices to write Deep Learning code
  • How to unit test and debug Machine Learning code
  • How to build and deploy efficient data pipelines
  • How to serve Deep Learning models
  • How to deploy and scale your application
  • What is MLOps and how to build end-to-end pipelines

Who is this book for?

  • Software engineers who are starting out with deep learning
  • Machine learning researchers with limited software engineering background
  • Machine learning engineers who seek to strengthen their knowledge
  • Data scientists who want to productionize their models and build customer-facing applications

What tools you will use?

Tensorflow, Flask, uWSGI, Nginx, Docker, Kubernetes, Tensorflow Extended, Google Cloud, Vertex AI

Book description

Deep Learning research is advancing rapidly over the past years. Frameworks and libraries are constantly been developed and updated. However, we still lack standardized solutions on how to serve, deploy and scale Deep Learning models. Deep Learning infrastructure is not very mature yet.

This book accumulates a set of best practices and approaches on how to build robust and scalable machine learning applications. It covers the entire lifecycle from data processing and training to deployment and maintenance. It will help you understand how to transfer methodologies that are generally accepted and applied in the software community, into Deep Learning projects.

It's an excellent choice for researchers with a minimal software background, software engineers with little experience in machine learning, or aspiring machine learning engineers.

More details and a free sample

Visit the book's page

Table of Contents

  1. Designing a machine learning system
  2. Setting up a Deep Learning Workstation
  3. Writing and Structuring Deep Learning Code
  4. Data Processing
  5. Training
  6. Serving
  7. Deploying
  8. Scaling
  9. Building an End-to-End Pipeline

Articles

The books is based on an article series published in our blog "AI Summer" and they were later combined and organized into a single resource. Some were rewritten from scratch; some were modified to fit the book's structure. Plus, we added completely new material!

  1. Laptop set up and system design: https://theaisummer.com/deep-learning-production/
  2. Best practices to write Deep Learning code: Project structure, OOP, Type checking and documentation: https://theaisummer.com/best-practices-deep-learning-code/
  3. How to Unit Test Deep Learning: Tests in TensorFlow, mocking and test coverage: https://theaisummer.com/unit-test-deep-learning/
  4. Logging and Debugging in Machine Learning: https://theaisummer.com/logging-debugging/
  5. Data preprocessing for deep learning: https://theaisummer.com/data-preprocessing/
  6. Data preprocessing for deep learning (part2): https://theaisummer.com/data-processing-optimization/
  7. How to build a custom production-ready Deep Learning Training loop in Tensorflow from scratch: https://theaisummer.com/tensorflow-training-loop/
  8. How to train a deep learning model in the cloud: https://theaisummer.com/training-cloud/
  9. Distributed Deep Learning training: Model and Data Parallelism in Tensorflow: https://theaisummer.com/distributed-training/
  10. Deploy a Deep Learning model as a web application using Flask and Tensorflow: https://theaisummer.com/deploy-flask-tensorflow/
  11. How to use uWSGI and Nginx to serve a Deep Learning model: https://theaisummer.com/uwsgi-nginx/
  12. How to use Docker containers and Docker Compose for Deep Learning applications: https://theaisummer.com/docker/
  13. Scalability in Machine Learning: Grow your model to serve millions of users: https://theaisummer.com/scalability/
  14. Introduction to Kubernetes with Google Cloud: Deploy your Deep Learning model effortlessly: https://theaisummer.com/kubernetes/

Support

If you like our effort, don't forget to star the project :) It matters!

Related repositories
tensorflow/tensorflow

An Open Source Machine Learning Framework for Everyone

C++Apache License 2.0tensorflowmachine-learning
tensorflow.org
196.5k75.7k
f/prompts.chat

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.

HTMLOtherchatgptai
prompts.chat
166.2k21.5k
huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

PythonPyPIApache License 2.0nlpnatural-language-processing
huggingface.co/transformers
162.8k34k
pytorch/pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

PythonPyPIOtherneural-networkautograd
pytorch.org
101.8k28.4k
rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter NotebookOthergptlarge-language-models
amzn.to/4fqvn0D
99.5k15.3k
microsoft/ML-For-Beginners

12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all

Jupyter NotebookMIT Licensemldata-science
88.4k21.6k
Developer-Y/cs-video-courses

List of Computer Science courses with video lectures.

computer-sciencealgorithms
82.6k11.4k
mlabonne/llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Apache License 2.0coursellm
mlabonne.github.io/blog/
81.1k9.5k
netdata/netdata

The fastest path to AI-powered full stack observability, even for lean teams.

GoGo ModulesGNU General Public License v3.0monitoringdocker
netdata.cloud
79.8k6.5k
d2l-ai/d2l-zh

《动手学深度学习》:面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

PythonPyPIApache License 2.0deep-learningbook
zh.d2l.ai
79.1k12.3k
tesseract-ocr/tesseract

Tesseract Open Source OCR Engine (main repository)

C++Apache License 2.0tesseracttesseract-ocr
tesseract-ocr.github.io
75.5k10.7k
binhnguyennus/awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

MIT Licensesystem-designbackend
72.6k7k