uploading takes too much OLT: up to 15min ONTs: up to 15min, each Scenario initialization just takes too loooong We really needed Continuous Integration… 13
Scenario initialization optimization Don’t upload firmware if already there Quick reset configuration Not perfect but it works most times! OLT equipment type and scenario completely configurable in YAML file 21
"<port>" with id "<onuid>" is upgraded with version "<file_fw_version>“ And the OLT equipment does not have any services configured And a ONU profile exists with |state |name | vendor |model |pon|eth|rf|voip|e1|veip| |enabled |RGWs/rf |PTIN |RGWs/rf |1 |4 |0 |2 |0 |1 | |enabled |SFU_PTIN |PTIN |SFU |1 |1 |1 |0 |0 |0 | |enabled |teste |PTIN |teste |1 |1 |0 |0 |0 |0 | Then ONU present in slot "<slot>" and pon "<port>" with id "<onuid>" should have the version "<version_to_test>" commited and activated 30
have any services configured And an Ethernet interface exists in slot "<slot>", port "<port>" with mtu "<mtu>" and state "enabled“ When the traffic with the following characteristics is created in generator |stream_name|svlan |cvlan |src_MAC |dest_MAC |src_IP |dest_IP |rate |frame_size|downstream_port|upstream_port| |downstream1 |100 | |00:00:08:00:AA:01|00:00:08:00:AB:01|192.0.0.1 |192.0.1.1 |1000000|1000|1|2| |upstream1 |3100 |100 |00:00:08:00:AB:01|00:00:08:00:AA:01|192.0.1.1 |192.0.0.1 |1000000|1000|2|1| And the traffic configured in generator runs for "5" seconds Then the traffic stream named "downstream1" should have no losses 31
25 30 35 Time to execute regression tests Days Before After Average distinct tests executed per build Before After + 744 % Total regression tests executed Before After + 811 % 0 5 10 15 20 25 30 35 Effort need to execute regression testing Man Days Before After 33
effects: Hardware stress tests Testing team now mainly writes code Brake human barriers, use APIs LISTEN and involve everyone Show how to fish Make things that matter => real benefits! Start simple, not perfect Use the right tools (Ruby, Cucumber, Jenkins, JIRA, Xray add-on) 35