Application Automation and Containerization With Habitat

Habitat builds and manages modern applications following the practices and principles of modern application teams. Build applications of any flavor, from microservices to traditional applications. Deploy applications in any operational environment from bare metal to containers. Habitat provides consistent, repeatable, auditable applications that lower operational complexity and simplify development workflows.

This hands-on workshop is for anyone involved in building, deploying, or managing applications. The workshop will give you experience running and building applications with Habitat and describe the application-first approach that Habitat provides.

Transcript

1. Application Automation & Containerization With Habitat Nathen Harvey | @nathenharvey You will need a laptop with an SSH client. Please sit on the left J
4. We Run Infrastructure To Run Applications That the Business Requires
6. Monolith Application Application Services
7. Monolith Microservices Application Application Services
8. Monolith Serverless Microservices Application Application Services
9. Monolith Serverless Microservices Application Application Services Centralized Highly Distributed
10. Monolith Serverless Microservices Application Application Services Few Large Artifacts Thousands of Small Artifacts
11. Application Services What Developers Need Application Runtimes
12. Application Services What Developers Need Want Application Runtimes
13. https://twitter.com/codinghorror/status/347070841059692545 What Developers Need Want Build
14. Heterogeneity is the #1 stumbling block to velocity. Sprawl of management tools is the biggest challenge facing modern IT teams. Current approaches start upside-down: with the OS and not the app. The core of the problem: application management
15. Lifecycle of any software Build Deploy Run
16. Runtime Concerns •  Application supervision •  Service discovery •  Application configuration •  Topology •  Updates •  Orchestration
17. Habitat is used to build, deploy, and manage applications…
18. …in any environment from traditional datacenters to containerized microservices
19. National Parks •  National Parks Application   Java Application running in Tomcat   MongoDB
21. Modern Applications Source Code Repo
22. Modern Applications Source Code Repo Artifact
23. Modern Applications Source Code Repo Artifact Artifact Repo
24. Modern Applications Source Code Repo Artifact Bare Metal Container Cloud Instance VM Artifact Repo
25. Modern Applications Source Code Repo Artifact Bare Metal Container Cloud Instance VM Artifact Repo
26. Modern Applications
27. Access the Learning Environment Find your workstation’s IP address Login to your workstation Login to your workstation in a second window User: chef Password: devopsdays Port: 443
28. $ Log in to your remote workstation ssh chef@12.34.56.78 -p 443
29. Using PuTTY on Windows 443 Your IP Address Port 443
30. National Parks •  National Parks Application   Java Application running in Tomcat   MongoDB Start the Supervisor first
31. Installs automatically Keeps things running Supervisor runs services
32. $ Start the Supervisor ∵ Missing package for core/hab-sup/0.31.0 » Installing core/hab-sup/0.31.0 ↓ Downloading core/hab-sup/0.31.0/20170907234526 2.17 MB / 2.17 MB - [================================] 100.00 % 37.71 MB/s ☛ Verifying core/hab-sup/0.31.0/20170907234526 ... ✓ Installed core/hab-launcher/4571/20170727193541 ★ Install of core/hab-launcher/4571/20170727193541 complete with 2 new packages installed. hab-sup(MR): Supervisor Member-ID 8246a0e5b93c41418adf55a237b38b93 hab-sup(MR): Starting gossip-listener on 0.0.0.0:9638 hab-sup(MR): Starting http-gateway on 0.0.0.0:9631 sudo hab sup run
33. $ Start Java Application sudo hab sup load learn/national-parks hab-sup(PK): learn/national-parks not found in local package cache, installing from https://willem.habitat.sh/v1/depot » Installing learn/national-parks from channel 'stable' ↓ Downloading learn/national-parks/0.1.5/20170407081316 5.75 MB / 5.75 MB | [================================] 100.00 % 65.96 MB/s ☛ Verifying learn/national-parks/0.1.5/20170407081316 ... ✓ Installed learn/national-parks/0.1.5/20170407081316 ★ Install of learn/national-parks/0.1.5/20170407081316 complete with 16 new packages installed. hab-sup(MN): The learn/national-parks service was successfully loaded
34. $ Meanwhile, in the supervisor output hab-sup(MR): Starting learn/national-parks hab-sup(MR): Unable to start learn/national-parks, hab-sup(SS)[src/manager/ service/spec.rs:208:23]: Missing required bind(s), database
35. Pitfall! Missing required bind(s), database
36. $ Unload Java Application sudo hab sup unload learn/national-parks
37. Load MongoDB Service The Supervisor is designed to supervise one or more services concurrently
38. $ Load MongoDB into the Supervisor sudo hab sup load learn/mongodb hab-sup(MN): The learn/mongodb service was successfully loaded
39. $ Meanwhile, in the supervisor output hab-sup(MR): Starting learn/mongodb mongodb.default(SR): Hooks recompiled default(CF): Updated mongod.conf f9886a510442a32e91d38a79b0baad2a4bb589ba36fed74e2ea3493d517d8bd5 default(CF): Updated mongos.conf 8c3e4cd2f3cdd7cd922ce3b529f93672f3af8274e5f6d462a5f8824c25bbbe18 mongodb.default(SR): Configuration recompiled mongodb.default(SR): Initializing mongodb.default(SV): Starting service as user=hab, group=hab mongodb.default(O): note: noprealloc may hurt performance in many applications
40. This raises a question •  Where are these packages coming from?
41. Modern Applications Source Code Repo Artifact Bare Metal Container Cloud Instance VM Artifact Repo
42. Central location Publicly hosted Lightweight views Stored in a depot
43. https://app.habitat.sh/#/pkgs/learn
44. $ Reload Java Application sudo hab sup load learn/national-parks --bind database:mongodb.default hab-sup(MR): Starting learn/national-parks national-parks.default(SR): Hooks recompiled national-parks.default(SR): Initializing national-parks.default hook[init]:(HK): Seeding Mongo Collection ... national-parks.default hook[init]:(HK): 2017-09-06T16:46:46.494+0000 Failed: error connecting to db server: no reachable servers national-parks.default hook[init]:(HK): 2017-09-06T16:46:46.494+0000 imported 0 documents national-parks.default(HK): Initialization failed! 'init' exited with status code 1
45. Pitfall! Cannot connect to the database Probably a configuration issue with the database
46. What are the tunables? [mongod.net] bind_ip = "127.0.0.1" ipv6 = false ... [mongod.security] authorization = "disabled" cluster_auth_mode = "keyFile" javascript_enabled = true key_file = "" ... $ sudo hab sup config learn/mongodb
47. Create a configuration file $ sudo hab sup config learn/mongodb > mongodb.toml
48. [mongod.net] bind_ip = "127.0.0.1" bind_ip = "0.0.0.0" ipv6 = false ... [mongod.security] authorization = "disabled" cluster_auth_mode = "keyFile" cluster_auth_mode = "" javascript_enabled = true ... Edit the mongodb.toml - + - +
49. [mongod.net] bind_ip = "127.0.0.1" bind_ip = "0.0.0.0" ipv6 = false ... [mongod.security] authorization = "disabled" cluster_auth_mode = "keyFile" cluster_auth_mode = "" javascript_enabled = true ... Edit the mongodb.toml - + - + $ cp new-mongodb-config.toml mongodb.toml If you don’t like manually editing files…
50. Never do this at home! •  We are about disable some MongoDB security
51. Manages configuration Installs automatically Keeps things running Supervisor runs services
52. $ Change the configuration for MongoDB sudo hab config apply --peer 127.0.0.1 mongodb.default \ 1 mongodb.toml
53. Applying Configuration sudo hab config apply --peer 127.0.0.1 mongodb.default 1 mongodb.toml •  peer - hostname or IP address of a running supervisor •  mongodb.default - the service group •  1 - the incarnation of this configuration •  mongodb.toml - the file with the new configuration
54. $ Change the configuration for MongoDB ∵ Missing package for core/hab-butterfly/0.31.0 » Installing core/hab-butterfly/0.31.0 ↓ Downloading core/hab-butterfly/0.31.0/20170907235928 1.18 MB / 1.18 MB \ [===============================] 100.00 % 84.75 MB/s ☛ Verifying core/hab-butterfly/0.31.0/20170907235928 ... ★ Install of core/hab-butterfly/0.31.0/20170907235928 complete with 1 new packages installed. » Applying configuration for mongodb.default incarnation 1 Ω Creating service configuration ✓ Verified this configuration is valid TOML ↑ Applying to peer 127.0.0.1:9638 ★ Applied configuration sudo hab config apply --peer 127.0.0.1 mongodb.default \ 1 mongodb.toml
55. $ Meanwhile, in the supervisor output mongodb.default(CF): Updated mongod.conf 12a29a9de79166f30aa87640bc4ba4a88b6dc4d4641cf0d6ed00e179229d576f mongodb.default(SR): Configuration recompiled
56. $ Meanwhile, in the supervisor output national-parks.default(SR): Initializing national-parks.default hook[init]:(HK): Seeding Mongo Collection national-parks.default hook[init]:(HK): $MONGOIMPORT_OPTS=--host=172.31.26.105 --port=27017 national-parks.default hook[init]:(HK): 2017-09-06T19:27:08.177+0000 connected to: 172.31.26.105:27017 national-parks.default hook[init]:(HK): 2017-09-06T19:27:08.177+0000 dropping: demo.nationalparks national-parks.default hook[init]:(HK): 2017-09-06T19:27:08.199+0000 imported 359 documents national-parks.default(SV): Starting service as user=root, group=root national-parks.default(O): Starting Apache Tomcat
57. $ Meanwhile, in the supervisor output national-parks.default(O): 06-Sep-2017 19:27:23.424 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory /hab/pkgs/core/tomcat8/8.5.9/20170215223900/tc/webapps/ ROOT has finished in 8 ms national-parks.default(O): 06-Sep-2017 19:27:23.428 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler [http- nio-8080] national-parks.default(O): 06-Sep-2017 19:27:23.432 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler [ajp-nio-8009] national-parks.default(O): 06-Sep-2017 19:27:23.433 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 14458 ms
58. http://YOUR_IP:8080/national-parks
59. No network L Use curl <!DOCTYPE html> <html lang="en"> <head> <title>Map of National Parks</title> <link rel="stylesheet" href="https://unpkg.com/leaflet@1.0.3/dist/ leaflet.css"/> ... </script> </body> </html> $ curl -L http://localhost:8080/national-parks
60. Supervisors provide a REST API External Actors Health and Status Supervisor Debugging
61. Supervisors self-organize Service Discovery Service Groups
62. •  http://YOUR_IP:9631/services •  http://YOUR_IP:9631/services/mongodb/default/config •  http://YOUR_IP:9631/services/national-parks/default/config REST API
63. •  http://YOUR_IP:9631/services/mongodb/default/config REST API
64. •  http://YOUR_IP:9631/services/mongodb/default/config REST API With JSONView Chrome Plugin
65. Runtime Concerns •  Application supervision •  Service discovery •  Application configuration •  Topology •  Updates •  Orchestration
67. Unload the services hab-sup(SV): national-parks.default - Shutdown method: Graceful Termination hab-sup(SV): national-parks.default - process 2457 died with exit code 143 hab-sup(SV): national-parks.default - Service exited $ sudo hab sup unload learn/national-parks
68. Unload the services hab-sup(SV): mongodb.default - Shutdown method: Graceful Termination hab-sup(SV): mongodb.default - process 2572 died with exit code 0 hab-sup(SV): mongodb.default - Service exited $ sudo hab sup unload learn/mongodb
69. $ Load mytutorial sudo hab sup load learn/mytutorialapp hab-sup(PK): learn/mytutorialapp not found in local package cache, installing from https://willem.habitat.sh/v1/depot » Installing learn/mytutorialapp from channel 'stable' ↓ Downloading learn/mytutorialapp/0.2.0/20170908131139 122.55 KB / 122.55 KB \ [============================] 100.00 % 43.81 MB/s ☛ Verifying learn/mytutorialapp/0.2.0/20170908131139 ... ✓ Installed learn/mytutorialapp/0.2.0/20170908131139 ★ Install of learn/mytutorialapp/0.2.0/20170908131139 complete with 7 new packages installed. hab-sup(MN): The learn/mytutorialapp service was successfully loaded
70. Create a configuration file $ sudo hab sup config learn/mytutorialapp > tutorial.toml
71. listening_port = 8080 listening_port = 80 message = "Hello, World!" message = "Hello, Raleigh!" Edit the tutorial.md - + - +
72. Applying Configuration sudo hab config apply --peer 127.0.0.1 mytutorialapp.default 1 tutorial.toml •  peer - hostname or IP address of a running supervisor •  mytutorial.default - the service group •  1 - the incarnation of this configuration •  tutorial.toml - the file with the new configuration
74. What’s Next? •  Use a provided Habitat development environment, or install Habitat locally •  Join the Habitat Slack Team - http://slack.habitat.sh/ •  Work through the tutorial at https://www.habitat.sh/tutorials/ •  Explore Habitat packages on the depot - https://app.habitat.sh/ •  Explore the Habitat projects - https://github.com/habitat-sh •  Read Habitat Blog posts - https://www.habitat.sh/blog/