Boosting Python With Rust 🚀

RIIR makes much sense in the Python world. This session explores the development and distribution of Python apps written in Rust.

This point in time has seen the development of great toolings and major libraries switching to Rust runtimes. This provides concrete validation for adopting this approach.

The session also includes a case study of projects written in Rust as well as past approaches to the topic.

Transcript

1. Boosting Python with Rust (TM)
4. Python Mauritius Usergroup site fb linkedin mailing list 4
5. url pymug.com site 5
6. About me compileralchemy.com 6
7. slides 7
8. Boosting Python with Rust (TM) 8
9. My relationship with Rust 9
10. Read the Rust book twice Read the Google rust training guide Know only about releasing scope and returning ownership Still don't know 3/4 of rust 10
12. Python / Rust friendliness 12
13. convention_of_methods readability emulates english 13
14. uses toml as default - toml invented by pypa core dev 14
15. build tool in py 15
16. iterators >>> x = itertools.cycle([1,2,3]) >>> next(x) 1 >>> next(x) 2 >>> next(x) 3 >>> dir([1]) [..., '__iter__', ...] 16
17. let nums = vec![1, 2, 3]; for num in nums.iter() { println!("{}", num); } loop { match range.next() { Some(x) => { println!("{}", x); }, None => { break } } } 17
18. consumers py: yield rust: ex .collect 18
19. string types b' ' b' ' 19
20. for in loop 20
21. for i, item in enumerate(bytes): if item == b' ': return i for (i, &item) in bytes.iter().enumerate() { if item == b' ' { return i; } } 21
22. Methods len(nums) nums.len() 22
23. -> return type def x() -> None: ... fn area(&self) -> u32 { self.width * self.height } 23
24. Pattern matching 24
25. def where_is(point): match point: case Point(x=0, y=0): print("Origin") case Point(): print("Somewhere else") case _: print("Not a point") fn value_in_cents(coin: Coin) -> u8 { match coin { Coin::Penny => { println!("Lucky penny!"); 1 } Coin::Nickel => 5, Coin::Dime => 10, Coin::Quarter => 25, } } 25
26. generics 26
27. from typing import Dict, Generic, TypeVar T = TypeVar("T") class Registry(Generic[T]): def __init__(self) -> None: self._store: Dict[str, T] = {} fn largest<T>(list: &[T]) -> &T 27
28. assert assert x == 1 assert!(larger.can_hold(&smaller)); 28
29. Why Rust? 29
30. performance 30
31. threading (no GIL) 31
32. use rust crates 32
33. recursion 33
34. Py-Rust projects 34
35. Rustimport 35
36. ./ termprint.rs // rustimport:pyo3 use pyo3::prelude::*; #[pyfunction] pub fn boxaround(s: &str){ println!("{}", "-".repeat(s.chars().count()+4)); println!("| {} |", s); println!("{}", "-".repeat(s.chars().count()+4)); } 36
37. $ python >>> import rustimport.import_hook >>> import termprint # This will pause for a moment to compile the module >>> termprint.boxaround('abc') ------- | abc | ------- 37
38. Protypting 38
39. $ python3 -m rustimport new my_single_file_extension.rs $ python3 -m rustimport new my_crate import my_crate 39
40. https://github.com/mityax/rustimport#usage-in-production 40
41. setuptools-rust 41
42. Poor docs most people no longer use it fit for binaries as well as modules see demo 42
43. Maturin 43
44. . └── guessing-game ├── Cargo.lock ├── Cargo.toml ├── pyproject.toml └── src └── lib.rs 44
45. $ maturing develop $ maturin build $ maturin publish 45
46. https://github.com/indygreg/PyOxidizer Packaging python with Rust micro contrib 46
47. https://github.com/RustPython/RustPython Py interp in rust 47
48. https://github.com/PyO3/pyo3 Rust bindings for python 48
49. https://pyo3.rs/v0.19.1/python_from_rust.html Python::with_gil(|py| { let fun: Py<PyAny> = PyModule::from_code( py, "def example(*args, **kwargs): if args != (): print('called with args', args) if kwargs != {}: print('called with kwargs', kwargs) if args == () and kwargs == {}: print('called with no arguments')", "", "", )? .getattr("example")? .into(); ... }) 49
50. use pyo3::prelude::*; Python::with_gil(|py| { let result = py .eval("[i * 10 for i in range(5)]", None, None) .map_err(|e| { e.print_and_set_sys_last_vars(py); })?; let res: Vec<i64> = result.extract().unwrap(); assert_eq!(res, vec![0, 10, 20, 30, 40]); Ok(()) }) 50
51. Common Gotchas 51
52. slow dev mode, release wrong usage of rust 52
53. integer overflow 53
54. Python projects using Rust 54
55. Pydantic Rewrote v2 in Rust 55
57. Polars The fast Pandas alternative 57
58. Ruff The fastest py linter 58
59. Robyn async web server in Rust 59
60. compileralchemy.com arj.python+urgent@gmail.com @osdotsystem github.com/abdur-rahmaanj Thank you 60