Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
QA 蝦米 QA?我的扣超讚的啊
Search
LINE Developers Taiwan
PRO
June 19, 2024
Technology
0
1.4k
QA 蝦米 QA?我的扣超讚的啊
Speaker: Lawrence Tsai, YT Chen
Event: LINE TECH FRESH 畢業分享會
LINE Developers Taiwan
PRO
June 19, 2024
Tweet
Share
More Decks by LINE Developers Taiwan
See All by LINE Developers Taiwan
Scaling The E-Commerce Recommendation System
line_developers_tw
PRO
0
10
Enhanced EC Recommendations: Trustworthy Validation with Large Language Models for Two-Tower Model
line_developers_tw
PRO
0
5
揭秘LLMOps: 讓LLM服務像火箭 般穩定高效的祕密!
line_developers_tw
PRO
0
27
ML Life Cycle for LINE SHOPPING Recommender
line_developers_tw
PRO
0
9
Review AI from LINE EC NLP
line_developers_tw
PRO
0
6
LINE購物 App x ATDD: 利用 ATDD 改善開發流程
line_developers_tw
PRO
0
19
Grafana Alloy Best Practice
line_developers_tw
PRO
0
1.1k
Distributed Tracing in LINE Taiwan
line_developers_tw
PRO
0
36
只有 Status page 還不夠!講人話才知道 Infra 發生什麼事
line_developers_tw
PRO
2
300
Other Decks in Technology
See All in Technology
第45回 MLOps 勉強会 - ML Test Score を用いた機械学習システムの定量的なアセスメント
masatakashiwagi
3
190
Amazon BedrockとPR-Agentでコードレビュー自動化に挑戦・実際に運用してみた
diggymo
0
550
OPENLOGI Company Profile for engineer
hr01
1
12k
KDD2024参加報告
cyberagentdevelopers
PRO
1
200
HashHub会社案内「なぜ今、パブリックブロックチェーンに賭けるのか」
hashhub
3
75k
【shownet.conf_】多様化するネットワーク環境を柔軟に統合するルーティングテクノロジー
shownet
PRO
0
280
小さな勉強会の始め方、広げ方、あるいは友達の作り方 / How to Start, Grow, and Build Connections with Small Study Groups
ar_tama
2
810
10Xでのデータ基盤の変遷とこれから: データマネジメントのリアル 〜BtoB企業3社の歩みとこれから〜
10xinc
6
1.2k
Efficient zero-copy networking using io_uring
ennael
PRO
0
270
ドメインと向き合う - 旅行予約編
hidenorigoto
4
520
Create Inquiry via Bedrock / 生成 AI で問い合わせ品質は変わるのか?思いついてぱっと作ったものを供養してみる
kazzpapa3
1
200
【shownet.conf_】ローカル5Gを活用したウォーキングツアーの体感向上
shownet
PRO
0
250
Featured
See All Featured
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
355
29k
A Modern Web Designer's Workflow
chriscoyier
692
190k
The Brand Is Dead. Long Live the Brand.
mthomps
53
38k
The Art of Programming - Codeland 2020
erikaheidi
50
13k
The Language of Interfaces
destraynor
154
24k
Debugging Ruby Performance
tmm1
73
12k
Docker and Python
trallard
40
3k
How to name files
jennybc
77
98k
The Pragmatic Product Professional
lauravandoore
31
6.2k
No one is an island. Learnings from fostering a developers community.
thoeni
19
2.9k
Building Your Own Lightsaber
phodgson
102
6k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
230
17k
Transcript
QA 蝦米 QA? 我的扣超讚的啊
01 02 03 04 Development Process Job Responsibility 專案分享:Test Case
⾃動分類 Introduction 05 專案分享:Release 流程優化 CONTENT
01 Introduction
Lawrence Tsai Education • M.S. in Management Information Systems @
NTU • B.S.S. in Journalism & Communication @ CUHK Experience • 2023 LINE Taiwan | TECH FRESH @ LINE TRAVEL • 2022 Dcard | QA Intern @ EC TECH FRESH @ LINE
機票 住宿 體驗 團旅 Logo 取⾃ Flaticon
YT Chen Education • M.S. in Computer Science @ NTUT
• B.B.A in Finance @ TKU Experience • 2023 | TECH FRESH @ LINE Taiwan • 2022 | Backend Engineer Intern @ thingnario • 2020-2021 | Data Engineer @ iiNumbers TECH FRESH @ LINE
A mobile ecommerce alliance platform for shopping guide and point
reward.
02 Development Process
Software Development Life Cycle 1 ANALYSIS 2 DESIGN 3 DEVELOPMENT
4 TESTING 5 DEPLOYMENT 6 MAINTENANCE Business Designer Developer QA Operations Technical Support
Development Process for QA 1 ANALYSIS 2 DESIGN 3 DEVELOPMENT
4 TESTING 5 DEPLOYMENT 6 MAINTENANCE Test Requirement Analysis Automation Script Development E2E Testing Stress Testing CUJ Testing Test Case Writing Performance Monitoring Regression Testing Continuous Development (CD) Continuous Integration (CI)
03 Job Responsibility
Test Case & Test Run Test Case Test Run Test
Case 1 2 3 Test Case 3 明確的⽬的&可執⾏的步驟 預期結果 vs 實際結果? 清楚涵蓋特定的功能或問題點 ⼀系列的多 Test Cases 組合 根據某種具體的使⽤者場景所定義 記錄測試點以評估軟體品質
Job Responsibility Test Case Preparation Automation Manual Testing 2 DESIGN
3 DEVELOPMENT 圖片取⾃ TestRail
Manual Testing Job Responsibility 確認⾴⾯上有「LINE 購物」的 logo Test Case 1
2 確認⾴⾯上有「搜尋框」的元素 Test Run 3 DEVELOPMENT 4 TESTING Test Case Logo 取⾃網路 Automation
Job Responsibility 5 DEPLOYMENT 6 MAINTENANCE Continuous Integration (CI) 圖片取⾃網路
Job Responsibility 圖片取⾃網路 Continuous Deployment (CD) 5 DEPLOYMENT 6 MAINTENANCE
Job Responsibility 5 DEPLOYMENT 6 MAINTENANCE 圖片取⾃網路 Monitoring
04 專案分享: Test Case ⾃動分類
寫 Test Case 也會有技術債? Epic:⾸⾴標題 Banner 確認⾴⾯上有「LINE 購物」的 logo 2000~3000
筆 確認⾴⾯上有「搜尋框」的元素 確認「搜尋框」旁是「相機」的 icon 確認⾴⾯上有「購物⾞」的 icon 確認跳轉⾴⾯可以導購成功 確認商店⾴⾯上有「專屬推薦」 Epic:??? Test Case Solution: 舉辦 workshop 讓⼤家⼀起償還歷史共業 🥳
架構圖 testrail- backup build-pipeline TestRail Cloud Preprocess & Modeling GitHub
Actions Test Cases (TC) Test Runs (TR) Prediction Result Request Export Pull Data Upload Upload
建立模型 P N P • True Positives (TP) • False
Negatives (FN) N • False Positives (FP) • True Negatives (TN) Baseline • Text preprocessing:TF-IDF • Model:Naive Bayes classifier Optimized • Text preprocessing:TF-IDF • Model:Random Forest classifier Performance = Naïve Bayes Classifier
模型效能 0.54 0.63 0.85 0.89 0 0.1 0.2 0.3 0.4
0.5 0.6 0.7 0.8 0.9 1 標完的資料 標完的資料 + Test Run 資料 Baseline Optimized
05 專案分享: Release 流程優化
Release Calendar • 公司有多個團隊及產品 • 每個產品有 Maintenance、Resolved 等不同狀態 • 需要有
Calendar 記錄更新時間、Release 的產品、 Release 版號等訊息⽅便統⼀管理
架構圖 Trigger Jenkins Deployment Manifests Pull Changes Sync Cluster Status
Pull Image & Update Containers Trigger Python code Logo 取⾃ Flaticon、網路 Update Calendar
ArgoCD 在 ArgoCD Sync 以及 Sync Success 的時候更新 Calendar 圖⽚取⾃網路
K8s 利⽤ ArgoCD Hook 在 Sync 時觸發 Job Curl Jenkins
執⾏任務並 帶入 Parameters
Jenkins 可⼿動選擇⾏為,或通過 parameters 決定
None