Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Design patterns

Design patterns

Architecture of large-scale Python applications. A tour of interesting design patterns in Python, showing their uses in a real project.

Marek Stępniowski

November 14, 2011
Tweet

More Decks by Marek Stępniowski

Other Decks in Programming

Transcript

  1. Gamma, et al. Design Patterns Time Hunt, Thomas The Pragmatic

    Programmer Martin Fowler Patterns of Enterprise Application Architecture Cormen, et al. Introduction to Algorithms Kent Beck Test-Driven Development Python Abelson, Sussman Structure and Interpretation of Computer Programs Chris Okasaki Purely Functional Data Structures My first language Stages of a programmer Level 9000 0
  2. Gamma, et al. Design Patterns Hunt, Thomas The Pragmatic Programmer

    Cormen, et al. Introduction to Algorithms thon
  3. Design pattern def. General reusable solution to a commonly occurring

    problem within a given context in software design. A design pattern is a description or template for how to solve a problem that can be used in many different situations.
  4. class Singleton { private static Singleton instance; private Singleton() {};

    public static Singleton getInstance() { if (instance == null) instance = new Singleton(); return instance; } }
  5. class Singleton(object): _instance = None def __new__(cls, *args, **kw): if

    not cls._instance: cls._instance = ( super(Singleton, cls) .__new__(cls, *args, **kw)) return cls._instance
  6. Abstract Factory Factory Method Builder Prototype Singleton Adapter Bridge Composite

    Decorator Facade Flyweight Proxy Chain of Reponsibility Command Interpreter Iterator Mediator Memento Observer State Strategy Template Method Visitor 23 DP
  7. Adapter Bridge Composite Decorator Facade Flyweight Proxy Memento Observer State

    Strategy Template Method Visitor 32 Multiton Object Pool RAII Front Controller Null Object Publish/Subscribe Blackboard Servant Specification CC
  8. 80 Foreign Key Mapping Association Table Mapping Dependent Mapping Embedded

    Value Serialized LOB Single Table Inheritance Class Table Inheritance Concrete Table Inheritance Inheritance Mappers Metadata Mapping Database Session State Gateway Mapper Layer Subtype Separated Interface Registry Value Object Money Special Case Plugin Service Stub Record Set PoEAA
  9. 86 Embedded Value Serialized LOB Single Table Inheritance Class Table

    Inheritance Concrete Table Inheritance Inheritance Mappers Metadata Mapping Separated Interface Registry Value Object Money Special Case Plugin Service Stub Record Set Model Template View Model View Presenter Model View ViewModel Layers KVO KVC inne
  10. Money Model View Controller Prototype Smart Pointers? Procedures? Classes? Value

    Objects? Reference Counting? Closures? Asynchronous communication? Layers?
  11. The first rule of Singletons is: you do not use

    Singletons The second rule of Singletons is: you do not use Singletons
  12. class Singleton(type): def __init__(cls, name, bases, d): super(Singleton, cls).__init__( name,

    bases, d) cls._instance = None def __call__(cls, *args, **kw): if cls._instance is None: cls._instance = ( super(Singleton, cls) .__call__(*args, **kw)) return cls._instance class Settings(object): __metaclass__ = Singleton
  13. # settings.py IM_A_CHARGIN_MAH_LAZER = True IM_A_FIRIN_MAH_LAZER = False tagline =

    '' # main.py import settings settings.tagline = 'Shoop da Whoop'
  14. First-class types: Abstract Factory, Factory Method, Flyweight, State, Proxy, Chain

    of Responsibility First-class functions: Command, Strategy, Template Method, Visitor Decorators: Mediator, Observer Modules: Singleton, Facade +Iterator
  15. class ClassificationEngine(object): pass class SeriesEngine(ClassificationEngine): def match(self, subscription, data, pattern,

    trusted_keys): return SeriesMatcher().match(data) class ManualSeriesEngine(ClassificationEngine): def match(self, subscription, data, pattern, trusted_keys): return ManualSeriesMatcher().match(data, pattern, trusted_keys) class MovieEngine(ClassificationEngine): def match(self, subscription, data, pattern, trusted_keys): return MovieMatcher().match(subscription, data)
  16. class SeriesEngine(ClassificationEngine): def __init__(self): self.matcher = SeriesMatcher() def match(self, subscription,

    data, pattern, trusted_keys): return self.matcher.match(data) class ManualSeriesEngine(ClassificationEngine): def __init__(self): self.matcher = ManualSeriesMatcher() def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(data, pattern, trusted_keys) class MovieEngine(ClassificationEngine): def __init__(self): self.matcher = MovieMatcher() def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(subscription, data)
  17. class ClassificationEngine(object): matcher_class = None def __init__(self, matcher=None): self.matcher =

    (matcher if matcher else self.matcher_class()) class SeriesEngine(ClassificationEngine): matcher_class = SeriesMatcher def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(data) class ManualSeriesEngine(ClassificationEngine): matcher_class = ManualSeriesMatcher def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(data, pattern, trusted_keys) class MovieEngine(object): matcher_class = MovieMatcher def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(subscription, data)
  18. class ClassificationEngine(object): def __init__(self, matcher=None): self.matcher = self.get_matcher() class SeriesEngine(ClassificationEngine):

    def get_matcher(self): return SeriesMatcher() def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(data) class ManualSeriesEngine(ClassificationEngine): def get_matcher(self): return SeriesMatcher(defaults=settings.TRUSTED_KEYS) def match(self, subscription, data, pattern, trusted_keys): return self.matcher.match(data, pattern, trusted_keys) class MovieEngine(object): def get_matcher(self): return MovieMatcher() def match(self, subscription, data): return self.matcher.match(subscription, data)
  19. class ClassificationEngine(object): # ... def classify(self, subscription, subscription_data, data): preprocessed_data

    = self.preprocess(subscription, data) filtered_data = self.filter(subscription, preprocessed_data) matched_data = self.match(subscription, subscription_data, filtered_data)) classified_data = self.merge(subscription, matched_data) postprocessed_data = self.postprocess(subscription, classified_data) return postprocessed_data
  20. class ClassificationEngine(object): # ... def classify(self, subscription, subscription_data, data, timer):

    with timer.label('preprocess'): preprocessed_data = self.preprocess(subscription, data) with timer.label('filter'): filtered_data = self.filter(subscription, preprocessed_data) with timer.label('match'): matched_data = self.match(subscription, subscription_data, filtered_data)) with timer.label('merge'): classified_data = self.merge(subscription, matched_data, extra_priorities) with timer.label('postprocess'): postprocessed_data = self.postprocess(subscription, classified_data) return postprocessed_data
  21. class Timer(object): def __init__(self, identifier=None): self.identifier, register = identifier, {}

    @contextmanager def label(self, label): t0 = time.time() yield t1 = time.time() self.register[label] = t1 - t0 def dump(self): r = dict(self.register) if self.identifier: r['_identifier'] = self.identifier return r class DummyTimer(Timer): def label(self, label): yield def dump(self): return {'_identifier': '<DummyTimer>'}
  22. class ClassificationEngine(object): # ... def classify(self, subscription, subscription_data, data, timer=None):

    if timer is None: timer = DummyTimer() with timer.label('preprocess'): preprocessed_data = self.preprocess(subscription, data) with timer.label('filter'): filtered_data = self.filter(subscription, preprocessed_data) with timer.label('match'): matched_data = self.match(subscription, subscription_data, filtered_data)) with timer.label('merge'): classified_data = self.merge(subscription, matched_data, extra_priorities) with timer.label('postprocess'): postprocessed_data = self.postprocess(subscription, classified_data) return postprocessed_data
  23. def get_class(path): module_path, class_name = path.rsplit('.', 1) package_path = ([module_path.rsplit('.',

    1)[0]] if '.' in module_path else None) module = __import__(module_path, fromlist=package_path) return getattr(module, class_name) # settings.py HARVESTERS = ( 'harvesters.disney_harvester.harvester.DisneyHarvester', 'harvesters.amazon_harvester.harvester.AmazonHarvester', 'harvesters.crackle_harvester.harvester.CrackleHarvester', 'harvesters.netflix_harvester.harvester.NetflixHarvester', 'harvesters.itunes_harvester.harvester.ITunesHarvester' ) Plugin
  24. def check_and_fixup_data(new_data, old_data, fixup_func=fixup_data, flagging_func=flag_data): is_worse, report = flagging_func(old_data, new_data)

    if is_worse: new_data = fixup_func(new_data, old_data) is_worse, report = flagging_func(old_data, new_data) return (is_worse, new_data, report)
  25. +notify(*) Observer +notify(*) ObserverA +notify(*) ObserverB notifyObservers(*) for observer in

    observerCollection: observer.notify(*) +registerObserver(1) +unregisterObserver(1) +notifyObservers(*) observerCollection Observable Observer
  26. var Post = function (text, state) { this.initialize(text, state); };

    _.extend(Post.prototype, { initialize: function (text, state) { this.text = text; this.state = state; }, getMaxCharacterCount: function () { this.state.getMaxCharacterCount(); }, getCharacterCount: function (text) { this.state.getCharacterCount(text); } });
  27. var FacebookBehavior = function () {}; _.extend(FacebookBehavior.prototype, { getMaxCharacterCount: function

    () { return 450; }, getCharacterCount: function (text) { return text.length; } }); CH20 = 'xxxxxxxxxxxxxxxxxxxx'; var TwitterBehavior = function () {}; _.extend(TwitterBehavior.prototype, { getMaxCharacterCount: function () { return 140; }, getCharacterCount: function (text) { return text.replace(URL_REGEXP, CH20).length; } });
  28. A B

  29. A B

  30. Design patterns + TDD + Seams Michael Feathers, Working Effectively

    with Legacy Code + 2nd pair of eyes + 3rd pair of eyes