Upgrade to Pro — share decks privately, control downloads, hide ads and more …

PhD Defense - "Extending maintainability analys...

PhD Defense - "Extending maintainability analysis beyond code smells"

This is the presentation that I used for my PhD defense that I successfully defended.

Tushar Sharma

May 02, 2019
Tweet

More Decks by Tushar Sharma

Other Decks in Research

Transcript

  1. Tushar Sharma Supervisor: Prof. Diomidis Spinellis Extending Maintainability Analysis Beyond

    Code Smells Funded by SENECA project under Marie-Skłodowska Curie Actions Innovative Training Networks ITN-EID. Grant agreement number 642954. May 2, 2019
  2. 4 Software Engineering in Enterprise Cloud Applications SENECA Product quality

    - Hosted by SIG and TU Delft - 3 PhD students Process quality - Hosted by URJC and Bitergia - 3 PhD students Operation quality - Hosted by AUEB and Singular Logic - 3 PhD students including me 38 publications and counting…
  3. Overview 5 Introduction (4) Experiments and results (24) Conclusions (8)

    • Context • Problem statement • Goals • Theoretical background • Method • Experiments • Results • Implications • Contributions • Publications • Future work
  4. Context 6 …certain structures in the code that suggest (sometimes

    they scream for) the possibility of refactoring. - Kent Beck Code Smells Smells’ characteristics • Indicator • Poor solution • Violates best practices • Impacts quality • Recurrence
  5. Importance of the research topic 7 Artifact • Maintainability •

    Effort/cost • Reliability • Change proneness • Testability • Performance Processes People • Morale and motivation • Productivity • Code smells • Implementation smells • Architecture smells • Design smells • Test smells • Performance smells • Configuration smells • Database smells • Models smells • Web smells • … Impact Types
  6. 8

  7. Motivation 10 Empirical studies on code smells • Plenty but

    lack scale and breadth Smell detection • Common issues • Is deep learning an answer? Extending maintainability analysis • for subdomains of software
  8. Research goals 1. Maintainability analysis for configuration code • A

    method to propose a catalog of configuration smells, detect them, and investigate intra- and inter-category relationships. 2. Maintainability analysis for database schema smells • A mechanism to collate, evaluate, and detect database smells • A method to investigate code quality of embedded SQL statements and understand their impact on database and production code properties. 3. Maintainability analysis for production code • Smells at different granularities • Honoring scale and breadth 4. Smell detection using deep learning • Feasibility to detect smells without extensive feature engineering • Explore transfer-learning applicability 11
  9. 12 Maintainability analysis on configuration code Research questions Download 4621

    Puppet repositories Detected configuration smells Analyze smells to provide answers to the research questions Tools (Puppeteer and PuppetLint) Taxonomy of configuration smells
  10. 13 Maintainability analysis on configuration code Repositories 4,621 Puppet files

    142,662 Class declarations 132,323 Define declarations 39,263 File resources 117,286 Package resources 49,841 Service resources 18,737 Exec declarations 43,468 Lines of code (Puppet only) 8,948,611 Curated a catalog of configuration smells • 13 implementation • 11 design Puppeteer – a tool to detect configuration smells
  11. 14 Maintainability analysis on configuration code 1. What is the

    distribution of maintainability smells in configuration code? 2. What is the relationship between the occurrence of design configuration smells and implementation configuration smells? 3. Is the principle of coexistence applicable to smells in configuration projects? 4. Does smell density depend on the size of the configuration project? Research questions
  12. 15 Maintainability analysis on configuration code Results High correlation between

    design and implementation configuration smells (⍴ = 0.66) Intra-category correlation analysis – whenever a duplicate entity smell is found, it is likely to find other smells from the same category
  13. 17 Maintainability analysis on database code Research questions Analyze code

    Detected database schema smells Analyze smells to provide answers to the research questions DbDeo – SQL statement extractor and database smell detector Catalog of database schema smells 2568 open-source and 357 industrial repositories Developers’ survey
  14. 18 0 5 10 15 20 25 30 35 40

    45 50 CA AL SK MC MD PA MA CT VA IA GT MN OA Respondents Don’t know Recommended practice Neither a smell nor a recommended practice Database schema smell Both a smell and a recommended practice depending on the context Clearly marked smells More context- sensitive
  15. 19 1. What are the occurrence patterns of database smells?

    2. Does the size of the project or the database play a role in smell density? 3. Does the nature of code (type of the application, or usage of ORM frameworks) affect the smell density? 4. What is the degree of co-occurrence among database smells? Research questions Maintainability analysis on database code
  16. 20 Maintainability analysis on database code Attributes Industry OSS Repositories

    (initial) 840 16,057 Repositories with SQL statements 357 2,568 Files 2,559,984 3,297,932 LOC 220,489,273 409,155,497 SELECT 51,652 74,096 CREATE TABLE 18,907 50,682 INSERT 74,416 66,830 UPDATE 10,454 29,002 CREATE INDEX 7,152 10,798
  17. 21 Maintainability analysis on database code ORM (Object-Relational Mapping) frameworks

    • 19 well-known frameworks identified 0 0.5 1 1.5 2 2.5 3 Projects using ORM (681, 238) Rest of the projects (1887, 199) Average smell density Open-source Industrial The difference is not statistically significant! Thus, ORM frameworks do not bring immunity from database smells.
  18. Maintainability analysis for production code 24 1. What is the

    distribution of implementation, design, and architecture smells in C# code? 2. Do the detected smell instances belonging to different granularities correlate? 3. Is the principle of coexistence applicable to smells in C# projects? 4. Does smell density depend on the size of the C# repository? 5. Are architecture smells collocated with design smells? 6. Can the refactoring of design smells lead to fewer architecture smells? Research questions
  19. Maintainability analysis for production code 25 Most frequently occurring smells

    • Architecture - Cyclic dependency • Design – Cyclically-dependent modularization • Implementation – Magic number Repositories 3,209 Components 75,205 Types 724,854 Methods 3,739,387 LOC (C#) 83,135,679 Results
  20. Maintainability analysis for production code 26 Results - Correlation 0

    200 400 600 800 1000 0 50 100 150 Design smells Architecture Smells Very strong correlation between architecture and design smell occurrences ⍴ = 0.86 (p-value <2.2e−16) Poor correlation between individual pairs of smells
  21. Maintainability analysis for production code 27 Results - Collocation A

    design smell instance D and architecture smell instance A are considered to be “collocated” if a class reported by the instance D participates in the A instance. • Proposed a mechanism to infer participating classes for an architecture smell • Compute contingency matrix and phi-coefficient Very selective collocation
  22. Maintainability analysis for production code 28 Results – Impact of

    design smell refactoring on architecture smells • Refactored state of the project required after the design smells are refactored • A mapping of potential influence of design smells refactoring on architecture smells • Simulated the refactored state Some architecture smells disappear but a large number of architecture smells remained after design smell refactoring. Therefore, refactoring smells is important at all granularities.
  23. 31 0.2 1, sigmoid Embedding layer LSTM layer Dropout layer

    Dense layer Inputs Output Repeat this set of hidden units Model architectures Detecting smells using deep learning
  24. 32 RQ1: Would it be possible to use deep learning

    methods to detect code smells? RQ2: Is transfer-learning feasible in the context of detecting smells? Transfer-learning refers to the technique where a learning algorithm exploits the commonalities between different learning tasks to enable knowledge transfer across the tasks Research questions Detecting smells using deep learning
  25. 33 Results – RQ1 0.38 0.41 0.31 0.04 0.02 0.22

    0.29 0.35 0.68 0.09 0.06 0.02 0 0.2 0.4 0.6 0.8 CNN-1D CNN-2D RNN CNN-1D CNN-2D RNN CNN-1D CNN-2D RNN CNN-1D CNN-2D RNN CM ECB MN MA F1 Deep learning models can detect smells without extensive feature engineering, though their performance is smell-specific. Detecting smells using deep learning
  26. 34 Results – RQ2 0.38 0.51 0.41 0.57 0.31 0.42

    0.04 0.08 0.02 0.06 0.22 0.16 0.29 0.42 0.35 0.48 0.68 0.92 0.09 0.02 0.06 0.00 0.02 0.00 0.0 0.2 0.4 0.6 0.8 1.0 DL TL DL TL DL TL DL TL DL TL DL TL DL TL DL TL DL TL DL TL DL TL DL TL CNN- 1D CNN- 2D RNN CNN- 1D CNN- 2D RNN CNN- 1D CNN- 2D RNN CNN- 1D CNN- 2D RNN CM ECB MN MA F1 Detecting smells using deep learning
  27. Key implications • Code quality practices in IaC paradigm •

    Apart from production code, subdomains of software systems such as configuration code may also suffer from code quality issues and hence must be treated similar to as production code • IDEs, configuration language, and external tools may help avoid many of the configuration smells • Database smells – its not black and white • Developers perceive smells with context and hence not all smells are equally quality problems • ORM and database schema quality • Though Object-Relational Mapping framework make programming easier with database, they do not bring immunity from database smells 36
  28. Key implications • Granularity matters • Smells occur at all

    granularities and they are correlated • Development teams must identify and refactor smells for all granularities • Even if all design smells are refactored, a significant number of architecture smells remain • Attention on code quality when size increases • Higher attention required on code quality (specifically, at architecture granularity) as the size of a software grows 37
  29. Key implications • Deep learning opens new possibilities • We

    demonstrate the feasibility of applying deep learning to detect smells without extensive feature engineering • It may motivate researchers and developers to explore this direction and build over it. • Make once, use repeatedly • The shown feasibility of transfer-learning leads to reusing existing smell detection tools for other programming languages. • No silver-bullet • We observed there is no optimal universal model; performance of the models depends highly on the smell at hand 38
  30. Contributions of the thesis Practice • Tools • Designite –

    http://www.designite-tools.com • DesigniteJava – https://github.com/tushartushar/DesigniteJava • Puppeteer – https://github.com/tushartushar/Puppeteer • DbDeo – https://github.com/tushartushar/dbdeo • Smell catalog • Documented smells: 263 • Leading a way for a new category of tools based on transfer-learning 41
  31. Future work • Making code smells detection tools more effective

    • Exploiting the power of deep learning • Automated refactoring support for architecture smells • Scaling refactoring to large-scale potentially by using/developing bottom- up refactoring support • Software data analytics • Software development generates data representing different aspects that can be combined for better analysis and actionable insights 42
  32. Publications based on the thesis 1. Tushar Sharma, Marios Fragkoulis,

    and Diomidis Spinellis. 2016. Does your configuration code smell?. In Proceedings of the 13th International Conference on Mining Software Repositories (MSR '16). 189-200. 2. Tushar Sharma, Diomidis Spinellis. “A survey on software smells”, Journal of Systems and Software, Volume 138, 2018, Pages 158-173, ISSN 0164-1212. 3. Tushar Sharma, Marios Fragkoulis and Diomidis Spinellis, "House of Cards: Code Smells in Open-Source C# Repositories," 2017 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), Toronto, ON, 2017, pp. 424-429. 4. Tushar Sharma, Marios Fragkoulis, Stamatia Rizou, Magiel Bruntink, and Diomidis Spinellis. ``Smelly relations: measuring and understanding database schema quality'', In Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP '18). pp 55-64. 5. Tushar Sharma. 2018. Detecting and managing code smells: research and practice. In Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings (ICSE '18). ACM, New York, NY, USA, 546-547. 43
  33. Publications based on the thesis 6. Tushar Sharma. How Deep

    Is the Mud: Fathoming Architecture Technical Debt Using Designite. To appear in International Conference of Technical Debt (TechDebt'19), Tools track. Submitted 7. Tushar Sharma, Paramvir Singh, Diomidis Spinellis, "An Empirical Investigation on the Relationship between Design and Architecture Smells” under review in Journal of Software and Systems (JSS). Apr 2018. 8. Tushar Sharma, Vasiliki Efstathiou, Panos Louridas, and Diomidis Spinellis. On the Feasibility of Transfer-learning Code Smells using Deep Learning. April 2019. Eprint available at: https://arxiv.org/abs/1904.03031 (To be submitted at TOSEM) 44