A Gentle Introduction to Generators and Coroutines

Transcript

1. A Gentle Introduction to Generators Coroutines and
2. Hello! Hacker/Programmer @ WalletKit, Inc. Open Source Enthusiast Python Fanboy @kirang89 http://kirang.in
3. Generators Coroutines
4. Let’s back up a bit
5. Functions Takes some input Returns some output (or flow of control) Stateless
6. Now consider a new type of function Pretty much the same (Well, almost) Remembers state after returning flow of control Instead of returning, it yields some output
7. yield = return + sorcery* * It’s not all that magical from a computer’s perspective
8. Generator Functions a.k.a Generators Functions that ‘yield’ are called
9. Coz they’re Why are Generators awesome? Lazy
10. def infinite_seq(): i = 0 while True: yield i i = i +1 https://projecteuler.net/problem=10 OR
11. Example
12. def fibonacci_gen(): a, b = 0, 1 while True: yield b a, b = b, a + b
13. >>> f = fibonacci_gen() >>> type(f) <type 'generator'> >>> f <generator object fibonacci at 0x107ef3870>
14. Print first 5 terms of the fibonacci series f = fibonacci_gen() print(next(f)) # Prints 1 print(next(f)) # Prints 1 print(next(f)) # Prints 2 print(next(f)) # Prints 3 print(next(f)) # Prints 5
15. Using Generators - Generator Functions - Generator Expressions
16. def even_range(n): for i in range(n): if i % 2 == 0: yield i vs even_range_10 = (a for a in range(10) if a % 2 ==0)
17. Performance ? Memory Usage ?
18. kiran:~/ $ python -m timeit "s=[a for a in range(1000000)]” 10 loops, best of 3: 61.3 msec per loop 70 MB kiran:~/ $ python -m timeit "s=(a for a in range(1000000))" 10 loops, best of 3: 16.4 msec per loop ~66 MB kiran:~/ $ python -m timeit "s=(a for a in xrange(1000000))" 1000000 loops, best of 3: 0.802 usec per loop ~3.4 MB
19. Generators Coroutines
20. Co-operative Multitasking/Communication via Enhanced Generators
21. Enhanced ? Allow values/exceptions to be passed as arguments when a generator resumes
22. yield as a keyword yield as an expression vs
23. Receive a value value = (yield) Send a value coroutine.send(data) Close coroutine.close()
24. Example
25. def match(pattern): print('Looking for ' + pattern) try: while True: s = (yield) if pattern in s: print(s) except GeneratorExit: print("Done")
26. >>> matcher = match('python') >>> matcher.send(None) Looking for python >>> matcher.send('Hello World') >>> matcher.send('python is awesome!') python is awesome! >>> matcher.close() Done
27. Let’s look at a bit more awesome example
28. def word_count(): wc = 0 try: while True: _ = (yield) wc = wc + 1 except GeneratorExit: print "Word Count: ", wc pass def match(pattern, counter): print('Looking for ' + pattern) try: while True: s = (yield) if pattern in s: counter.send(None) except GeneratorExit: counter.close() print("Done") def parse(file, matcher): f = open('sampleset.txt', 'r') for line in f.readlines(): for word in line.split(' '): matcher.send(word) matcher.close()
29. counter = word_count() counter.send(None) matcher = match('python', counter) matcher.send(None) parse('sampleset.txt', matcher)
30. We’ve not even scratched the surface!
31. Resources - PEP 255 (Generators) - PEP 289 (Generator Expressions) - PEP 342 (Coroutines) - http://www.dabeaz.com/coroutines/
32. Thank you !