Upgrade to Pro — share decks privately, control downloads, hide ads and more …

The Monorepo - Storing your source code has nev...

The Monorepo - Storing your source code has never been so much fun

Talk from Velocity about using a monorepo to store source code. Focus on usage in smaller organisations and whether monorepos scale down as well as up. Useful list of tools which help support storing all of your code in one place.

Gareth Rushgrove

October 19, 2017
Tweet

More Decks by Gareth Rushgrove

Other Decks in Technology

Transcript

  1. - A recent history of code organisation - The cost

    of a new repo - Monorepo examples - Build tools for monorepos
  2. The point is not that you should have a single

    project, but that one repository can contain multiple distinct projects David R. MacIver
  3. Why

  4. - Single lint, build, test process - Easy to coordinate

    changes - Single place to report issues - Easier to setup dev environment - Integration tests https://github.com/babel/babel/blob/master/doc/design/monorepo.md
  5. You can make atomic refactors across the entire codebase without

    worrying about versioning issues Ben Maurer, Facebook
  6. All of the above benefits of having one repository also

    extend to having fewer repositories David R. MacIver
  7. Juggling a multimodule project over multiple repos is like trying

    to teach a newborn baby how to ride a bike https://github.com/babel/babel/blob/master/doc/design/monorepo.md
  8. If project A depends on library B, you have to

    encode which revision of library B you use. Ben Maurer, Facebook
  9. Worse, if Project A also depends on C and D

    both of which use library B you have to ensure that the version of B that C and D depend on are compatible. Ben Maurer, Facebook
  10. - End-to-end testing - Running whole applications locally - Is

    that repository used? - Implicit dependencies in CI config - High cost of onboarding Roman Heinrich, Monorepos - Why and How
  11. At Puppet we ran a small experiment. 1 team. 6

    people. 7 components. 4 languages.
  12. Most build systems start small and simple, but over time

    grow into hairy monsters that few dare to touch Mokhov, Mitchell, Peyton Jones, Marlow
  13. BUCK file java_binary( name = "hello-buck-java", main_class = "com.facebook.buck.demo.HelloBuckJava", deps

    = [":main"], ) java_library( name = "main", srcs = glob(["*.java"]), )
  14. Pants BUILD file python_library( name = 'pants', sources = globs('*.py'),

    dependencies = [ '3rdparty/python:pantsbuild.pants', ], )
  15. Bazel BUILD file cc_library( name = "hello-greet", srcs = ["hello-greet.cc"],

    hdrs = ["hello-greet.h"], ) cc_binary( name = "hello-world", srcs = ["hello-world.cc"], deps = [ ":hello-greet", ], )
  16. Maintain history from separate repos with tomono $ cat repos.txt

    [email protected]:mycompany/service-one.git one [email protected]:mycompany/service-two.git two [email protected]:mycompany/service-three.git three $ cat repos.txt | tomono.sh
  17. CODEOWNERS.md # Lines starting with '#' are comments. # Each

    line is a file pattern followed by one or more owners. # These owners will be the default owners for everything in the repo. * @garethr # Order is important. The last matching pattern has the most precedence. # So if a pull request only touches javascript files, only these owners # will be requested to review. *.js @octocat @github/js # You can also use email addresses if you prefer. docs/* [email protected]
  18. Explicit build matrix in Travis matrix: include: - go: 1.8

    language: go install: cd consumer script: - make dependencies test - jdk: oraclejdk8 language: clojure services: docker install: cd reporter script: - make ensure-table test - python: 3.6 language: python install: cd data script: - make test - services: docker
  19. I’d argue that we don’t really yet have a good

    handle on how to scale that area that exists at the intersection of engineering and human organization Peter Seibel, Twitter