From source code to Kubernetes, a Continuous Deployment tale

This talk will cover the basics of creating good Docker images for your Go projects using multi-stage builds. Once we have that image ready we will need to run it somewhere, I think that a Kubernetes cluster could be a nice place to start. Of course, we don’t want to repeat those steps by hand everytime we want to do a new deployment so we will probably need to learn how to use a CI/CD tool to automate all the steps. And finally, the icing on the cake would be make this automagically run everytime we push code to our repository.

Transcript

1. From source code to Kubernetes, a Continuous Deployment tale.
2. $ whoami @agonzalezro
3. What’s CI?
4. Push git Generate Validate Build Test git commit ok goimports ok go vet ok sonar? ok ...
5. What’s Continuous Delivery & Continuous Deployment?
6. Merge git Generate Validate Build Test Create artifact Security Checks Deploy Clair Atomic scan Call it X ...
7. Once upon a time...
8. There was a prince, call him Go
9. main.go const message = "Hi Gophercon 2018!"
10. main.go const message = "Hi Gophercon 2018!" func mainHandler(w http.ResponseWriter, req *http.Request) { fmt.Fprintf(w, message) }
11. main.go func mainHandler(w http.ResponseWriter, req *http.Request) { fmt.Fprintf(w, message) } func main() { r := mux.NewRouter() r.HandleFunc("/", mainHandler)
12. main.go func mainHandler(w http.ResponseWriter, req *http.Request) { fmt.Fprintf(w, message) } func main() { r := mux.NewRouter() r.HandleFunc("/", mainHandler) port := ":8081" if v, ok := os.LookupEnv("PORT"); ok { port = ":" + v }
13. main.go func main() { r := mux.NewRouter() r.HandleFunc("/", mainHandler) port := ":8081" if v, ok := os.LookupEnv("PORT"); ok { port = ":" + v } log.Println("Listening on " + port) log.Fatal(http.ListenAndServe(port, r)) }
14. $ go build . $ go test -v .
15. And there was a princess, call her Docker
16. Dockerfile FROM golang:1.10-alpine3.7 as builder
17. Dockerfile FROM golang:1.10-alpine3.7 as builder WORKDIR /go/src/github.com/gophercon RUN apk --no-cache add git RUN go get -u github.com/golang/dep/cmd/dep COPY Gopkg.lock Gopkg.toml ./ RUN dep ensure -vendor-only
18. Dockerfile FROM golang:1.10-alpine3.7 as builder ... COPY Gopkg.lock Gopkg.toml ./ RUN dep ensure -vendor-only COPY . ./
19. Dockerfile FROM golang:1.10-alpine3.7 as builder ... COPY Gopkg.lock Gopkg.toml ./ RUN dep ensure -vendor-only COPY . ./ RUN go build
20. Dockerfile FROM golang:1.10-alpine3.7 as builder ... COPY . ./ RUN go build FROM alpine:3.7
21. Dockerfile FROM golang:1.10-alpine3.7 as builder ... COPY . ./ RUN go build FROM alpine:3.7 COPY --from=builder /go/src/github.com/gophercon ./
22. Dockerfile FROM golang:1.10-alpine3.7 as builder ... COPY . ./ RUN go build FROM alpine:3.7 COPY --from=builder /go/src/github.com/gophercon ./ CMD ["./gophercon"]
23. $ docker build -t gophercon . $ docker run -d gophercon
24. They wanted to live together in a beautiful castle, they called it Kubernetes
25. pod.yaml apiVersion: v1 kind: Pod
26. pod.yaml apiVersion: v1 kind: Pod metadata: name: just-a-pod
27. pod.yaml apiVersion: v1 kind: Pod metadata: name: just-a-pod spec: containers: - name: gophercon image: agonzalezro/gophercon:latest
28. pod.yaml apiVersion: v1 kind: Pod metadata: name: just-a-pod spec: containers: - name: gophercon image: agonzalezro/gophercon:latest
29. $ kubectl apply pod.yaml just-a-pod
30. deployment.yaml apiVersion: apps/v1 kind: Deployment
31. deployment.yaml apiVersion: apps/v1 kind: Deployment metadata: name: gophercon-deployment labels: app: gophercon
32. deployment.yaml ... spec: replicas: 2 selector: matchLabels: app: gophercon template: # pod here
33. deployment.yaml ... template: metadata: labels: app: gophercon spec: containers: - name: gophercon # Don't use latest at home! image: agonzalezro/gophercon:latest
34. $ kubectl apply deployment.yaml gophercon gophercon
35. $ kubectl apply deployment.yaml gophercon gophercon
36. service.yaml apiVersion: v1 kind: Service
37. service.yaml apiVersion: v1 kind: Service metadata: name: gophercon-service
38. service.yaml ... spec: type: LoadBalancer
39. service.yaml ... spec: type: LoadBalancer ports: - name: gophercon port: 80 targetPort: 8081 protocol: TCP selector: app: gophercon
40. $ kubectl apply service.yaml gophercon gophercon
41. And we are going to help them with CI/CD
42. Adventure demo time!
43. github.com/agonzalezro/gophercon
44. # We are hiring! # Thanks! @agonzalezro
45. 1. Only deploy if tested 2. Vulnerability scanner 3. Repo should ping CI, CI should deploy to k8s
46. $ helm install -f hack/values.yaml stable/jenkins NAME: zooming-wildebeest LAST DEPLOYED: Sat Jun 9 22:27:22 2018 NAMESPACE: default STATUS: DEPLOYED RESOURCES: ==> v1/Secret
47. Notes The PR could be deployed in some environment pre-merging it. Secrets and configs