\n\n\n\n
Introduction:<\/h1>\n\n\n\n
In the dynamic world of machine learning, the journey from developing a model to putting it into production is often seen as intricate and multifaceted. However, with the advent of tools like Docker, Kubernetes and user-friendly web frameworks such as FastAPI, Streamlit, and Gradio, this journey has become more streamlined than ever. Coupled with the power of GitHub Actions for continuous integration and deployment, we now have an ecosystem that supports rapid, efficient, and scalable machine learning applications. This article provides a concise guide on the essential commands for these tools, aiming to bridge the gap between model development and seamless deployment. Whether you\u2019re a seasoned data scientist looking to venture into the deployment realm or a budding developer eager to integrate machine learning into web applications, this guide offers a foundational understanding to propel your endeavors.<\/p>\n\n\n\n Check Docker documentation installation<\/p>\n\n\n\n <\/a><\/p>\n\n\n\n docs.docker.com<\/a><\/p>\n\n\n\n The Dockerfile defines what goes into your container. Here\u2019s an example Dockerfile for a Python machine learning environment:<\/p>\n\n\n\n Dockerfile Breakdown:<\/strong><\/p>\n\n\n\n Your To create a Docker image from your Dockerfile:<\/p>\n\n\n\n The To initiate a container from your image:<\/p>\n\n\n\n To see a list of all running containers:<\/p>\n\n\n\n For all containers, including those that aren\u2019t running:<\/p>\n\n\n\n To stop a running container:<\/p>\n\n\n\n To remove a stopped container:<\/p>\n\n\n\n You can share your Docker image using Docker Hub, a cloud service for sharing container images. First, log in:<\/p>\n\n\n\n Then, tag your image:<\/p>\n\n\n\n You or others can then pull the image:<\/p>\n\n\n\n And run it:<\/p>\n\n\n\n Check out my article about Docker and Kubernetes if you want to know more :<\/em><\/strong><\/p>\n\n\n\n <\/a><\/p>\n\n\n\n![\"\"\/](\"https:\/\/miro.medium.com\/v2\/resize:fit:2000\/1*GYQsHueza4ZaD0ttckx_Sg.png\")
Contents:<\/h1>\n\n\n\n
\n
![\"\"\/](\"https:\/\/miro.medium.com\/v2\/resize:fit:2000\/1*jg2hvRQIxSLcRhKsPo-jZw.png\")
![\"\"\/](\"https:\/\/miro.medium.com\/v2\/resize:fit:2000\/1*6p1q01YmK56ZWz9Er_bAhQ.png\")
Docker:<\/h1>\n\n\n\n
What is Docker?<\/h2>\n\n\n\n
\n
![\"\"\/](\"https:\/\/miro.medium.com\/v2\/resize:fit:1400\/1*gVXTsssGVjQbqT-fwRkzpg.png\")
Why is Docker Essential for ML Deployment?<\/h2>\n\n\n\n
\n
Docker Installation:<\/h2>\n\n\n\n
Get Docker<\/a><\/h2>\n\n\n\n
Download and install Docker on the platform of your choice, including Mac, Linux, or Windows.<\/a><\/h3>\n\n\n\n
Docker Version:<\/h2>\n\n\n\n
$ docker --version<\/pre>\n\n\n\n
Creating a Dockerfile for Python & Machine Learning<\/h2>\n\n\n\n
# Use an official Python runtime as base image
FROM python:3.8-slim
# Set the working directory inside the container
WORKDIR \/usr\/src\/app
# Install essential libraries and tools
RUN apt-get update && \\
apt-get install -y build-essential
# Copy the requirements.txt into the container
COPY requirements.txt .
# Install Python dependencies
RUN pip install --no-cache-dir -r requirements.txt
# Command to run when the container starts
CMD [\"python\", \"your_script.py\"]<\/pre>\n\n\n\n\n
FROM python:3.8-slim<\/strong><\/code><\/li>\n\n\n\nWORKDIR \/usr\/src\/app<\/strong><\/code><\/li>\n\n\n\n\/usr\/src\/app<\/strong><\/code>. All subsequent commands will be run from this directory.<\/li>\n\n\n\nRUN apt-get update && \\<\/strong><\/code><\/li>\n\n\n\napt-get install -y build-essential<\/strong><\/code><\/li>\n\n\n\nCOPY requirements.txt <\/strong>.<\/code><\/li>\n\n\n\nrequirements.txt<\/strong><\/code> file from your current directory (on your host machine) and copies it to the working directory inside the container (\/usr\/src\/app<\/strong><\/code>).<\/li>\n\n\n\nRUN pip install --no-cache-dir -r requirements.txt<\/strong><\/code><\/li>\n\n\n\nrequirements.txt<\/strong><\/code> file. The --no-cache-dir<\/strong><\/code> option ensures pip won’t store any cache, keeping the container lightweight.<\/li>\n\n\n\nCMD [\"python\", \"your_script.py\"]<\/strong><\/code><\/li>\n\n\n\nyour_script.py<\/strong><\/code>.<\/li>\n<\/ul>\n\n\n\nRequirements File:<\/h2>\n\n\n\n
requirements.txt<\/code> might look something like this for a machine learning project:<\/p>\n\n\n\nnumpy==1.19.5
pandas==1.1.5
tensorflow==2.4.1
scikit-learn==0.24.1<\/pre>\n\n\n\nBuilding a Docker Image<\/h2>\n\n\n\n
$ docker build -t ml-python-image .<\/pre>\n\n\n\n
-t<\/code> flag assigns a tag or name to the image, and the .<\/code> specifies the directory containing your Dockerfile.<\/p>\n\n\n\nRunning a Docker Container<\/h2>\n\n\n\n
$ docker run --name ml-python-container ml-python-image<\/pre>\n\n\n\n
Viewing Running Containers<\/h2>\n\n\n\n
$ docker ps<\/pre>\n\n\n\n
$ docker ps -a<\/pre>\n\n\n\n
Stopping and Removing Containers<\/h2>\n\n\n\n
$ docker stop ml-python-container<\/pre>\n\n\n\n
$ docker rm ml-python-container<\/pre>\n\n\n\n
Sharing your Docker Image<\/h2>\n\n\n\n
$ docker login<\/pre>\n\n\n\n
$ docker tag ml-python-image:latest username\/ml-python-image:latest<\/pre>\n\n\n\n
Finally, push the image:<\/h2>\n\n\n\n
$ docker push username\/ml-python-image:latest<\/pre>\n\n\n\n
Pulling and Running Shared Images<\/h2>\n\n\n\n
$ docker pull username\/ml-python-image:latest<\/pre>\n\n\n\n
$ docker run --name new-ml-python-container username\/ml-python-image:latest<\/pre>\n\n\n\n
MLOps-Dockers and Kubernetes Essentials for a Data Scientist<\/a><\/h2>\n\n\n\n
Introduction<\/a><\/h3>\n\n\n\n
![\"\"\/](\"https:\/\/miro.medium.com\/v2\/resize:fit:1400\/1*ZubgBfZJ6tv0pyAULubp8g.png\")