Python for Humans

Simplify terrible APIs. Document our best practices.

https://github.com/kennethreitz
http://twitter.com/kennethreitz

Transcript

1. Python For Humans Kenneth Reitz
2. Hi.
3. @kennethreitz
5. Open Source
6. Requests HTTP for Humans
7. Httpbin.org $ curl http://httpbin.org/get?test=1 { "url": "http://httpbin.org/get", "headers": { "Content-Length": "", "Connection": "keep-alive", "Accept": "*/*", "User-Agent": "curl/7.21.4 ...", "Host": "httpbin.org", "Content-Type": "" }, "args": { “test”: “1” }, "origin": "67.163.102.42" }
8. Et Cetera • Legit: Git Work ow for Humans • Envoy: Subprocess for Humans • Tablib: Tabular Data for Humans • Clint: CLI App Toolkit • Autoenv: Magic Shell Environments • OSX-GCC-Installer: Provokes Lawyers 275+ More
9. Open Source All The Things!
10. Build for Open Source • Components become concise & decoupled. • Concerns separate themselves. • Best practices emerge (e.g. no creds in code). • Documentation and tests become crucial. • Code can be released at any time.
11. Philosophy
12. We share a dark past. Perl, Java, PHP, ColdFusion, Classic ASP, &c.
13. The Zen of Python >>> import this
14. Beautiful is better than ugly.
15. Explicit is better than implicit.
16. Simple is better than complex.
17. Complex is better than complicated.
18. If the implementation is hard to explain, it’s a bad idea. (except PyPy)
19. There should be one—and preferably only one—obvious way to do it.
20. Welcome to Paradise
21. Lies!
22. We know Ruby... require 'net/http' require 'uri' uri = URI.parse('https://api.github.com/user') http = Net::HTTP.new(uri.host, uri.port) http.use_ssl = true req = Net::HTTP::Get.new(uri.request_uri) req.basic_auth('username', 'password') r = http.request(req) puts r
23. Python’s net/http? http/url/lib/2
24. Several hours later...
25. import urllib2 gh_url = 'https://api.github.com/user' req = urllib2.Request(gh_url) password_manager = urllib2.HTTPPasswordMgrWithDefaultRealm() password_manager.add_password(None, gh_url, 'user', 'pass') auth_manager = urllib2.HTTPBasicAuthHandler(password_manager) opener = urllib2.build_opener(auth_manager) urllib2.install_opener(opener) handler = urllib2.urlopen(req) print handler.read()
26. import re class HTTPForcedBasicAuthHandler(HTTPBasicAuthHandler): auth_header = 'Authorization' rx = re.compile('(?:.*,)*[ \t]*([^ \t]+)[ \t]+' 'realm=(["\'])(.*?)\\2', re.I) def __init__(self, *args, **kwargs): HTTPBasicAuthHandler.__init__(self, *args, **kwargs) def http_error_401(self, req, fp, code, msg, headers): url = req.get_full_url() response = self._http_error_auth_reqed( 'www-authenticate', url, req, headers) self.reset_retry_count() return response http_error_404 = http_error_401
27. Admit it. You’d leave and never come back.
28. The Problem. • Unclear which module to use in the rst place. • Prognosis seems to be urllib2, but the docs are useless. • Worst API ever.
29. This is a serious problem. HTTP should be as simple as a print statement.
30. The Solution is Simple. Build elegant tools to perform these tasks.
31. Python needs more Pragmatic Packages.
32. pra•gmat•ic |pragˈmatik|, adj: Dealing with things sensibly and realistically in a way that is based on practical rather than theoretical considerations
33. Python For Humans
34. Let’s Break it Down. • A small set of methods with consistent parameters. • HEAD, GET, POST, PUSH, PUT, PATCH, DELETE, &c. • They all accept Headers, URL Parameters, Body/Form Data. What is HTTP at its core?
35. Urllib2 is Toxic. • Heavily over-engineered. • Abolishes most of PEP20. • Docs are impossible to read. • HTTP is simple. Urllib2 is not. • Scares people away from Python.
36. Enter Requests.
37. HTTP for Humans.
38. import requests url = 'https://api.github.com/user' auth = ('username', 'password') r = requests.get(url, auth=auth) print r.content
40. Achievement Unlocked! • A small set of methods with consistent parameters. • HEAD, GET, POST, PUSH, PUT, PATCH, DELETE, &c. • They all accept Headers, URL Parameters, Body/Form Data.
41. Do this.
42. The Litmus Test If you have to refer to the documentation every time you use a module, nd (or build) a new module.
43. Fit the 90% Use Case.
44. The API is all that matters. Everything else is secondary.
45. I Mean Everything. • Features. • E ciency. • Performance. • Corner-cases. • Everything.
46. Pivot! • At rst, Requests was far from powerful. • But, it deeply resonated with people. • Features grew over time, but the API was never compromised.
47. Requests Today • Cookies, sessions, content-iteration, decompression, le uploads, async i/o, keep-alive, connection pooling, callback hooks, proxies, OAuth, &c • ~400,000 downloads from PyPi. • Kippt, PayPal, Native Instruments, The Washington Post, Twitter, Readability, &c.
48. Cool Story, Bro. • We need better APIs. • We want better APIs. • It’s worth your time as a developer. • It’s worth everyone’s time as users.
49. Barriers to Entry
50. File and System Operations • sys | shutils | os | os.path | io modules • Really di cult to run external commands. • Blocks dev+ops folks from adopting Python.
51. Installing Python • Just use the system Python? • Python 2 or Python 3? • Installer from Python.org? • 32bit or 64bit? • Build from source? • Unix or Framework build?
52. There should be one—and preferably only one—obvious way to do it.
53. XML Hell • etree annoys people. • lxml is awesome, but can be di cult to install.
54. Packaging & Depedencies • Pip or easy_install? • No easy_uninstall? • Distribute vs Setuptools? • Setuptools appears to be built into Python. • Broken setup.py les. • “Released” packages not in the Cheeseshop.
55. Date[time]s. • Which module to use? Datetime? Date? Time? Calendar? Dateutil? 1.5? • Timezones. • The stdlib can generate but not parse ISO8601 dates.
56. Unicode.
57. Testing.
58. Installing Dependencies. • Python-mysql (if you remember the name) • Python Imaging Library. • Mod_WSGI. • lxml
59. The Hitchhiker’s Guide to Python. http://python-guide.org
61. Python-Guide.org • Documented best practices. • Guidebook for newcomers. • Reference for seasoned veterans. • Don’t panic & always carry a towel. The Hitchhiker’s Guide to Python
62. Best Practices • Recommends distribute, pip, and virtualenv out of the box. Explicit installation directions for every OS. • Instills a resistance to doctest. • Teaches the use of datetime.utcnow()
63. There’s only one rule...
64. There should be one—and preferably only one—obvious way to do it.
65. This Fixes... • Makes Python more accessible, lowering the barrier to entry. • Sets developers on the right path. • Great reference guide for seasoned veterans. • Practice what we preach.
66. THE MANIFESTO
67. Simplify terrible APIs.
68. Document our best-practices.
69. github.com/kennethreitz Questions?