Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
An ETL Framework for Online Analytical Processi...
Search
Hiroyuki Inoue
June 15, 2013
Research
3
270
An ETL Framework for Online Analytical Processing of Linked Open Data
A presentation for the 14th International Conference on Web-Age Information Management (WAIM 2013).
Hiroyuki Inoue
June 15, 2013
Tweet
Share
More Decks by Hiroyuki Inoue
See All by Hiroyuki Inoue
Write ETL or ELT data processing jobs with bricolage.
inohiro
3
560
リアルタイム分析サービス『たべみる』を支える高可用性アーキテクチャ
inohiro
0
50
Pechakucha of Electrical Towers
inohiro
2
55
Introduction of '3dcg-arts.net'
inohiro
0
300
Other Decks in Research
See All in Research
いしかわ暮らしセミナー~移住にまつわるお金の話~
matyuda
0
140
言語処理学会30周年記念事業留学支援交流会@YANS2024:「学生のための短期留学」
a1da4
1
230
ミニ四駆AI用制御装置の事例紹介
aks3g
0
160
Weekly AI Agents News! 8月号 論文のアーカイブ
masatoto
1
160
データサイエンティストをめぐる環境の違い 2024年版〈一般ビジネスパーソン調査の国際比較〉
datascientistsociety
PRO
0
450
多様かつ継続的に変化する環境に適応する情報システム/thesis-defense-presentation
monochromegane
1
480
研究の進め方 ランダムネスとの付き合い方について
joisino
PRO
54
19k
LINEチャットボット「全力肯定彼氏くん(LuC4)」の 1年を振り返る
o_ob
0
2.5k
大規模言語モデルを用いた日本語視覚言語モデルの評価方法とベースラインモデルの提案 【MIRU 2024】
kentosasaki
2
500
秘伝:脆弱性診断をうまく活用してセキュリティを確保するには
okdt
PRO
3
730
「Goトレ」のご紹介
smartfukushilab1
0
740
Weekly AI Agents News! 7月号 論文のアーカイブ
masatoto
1
210
Featured
See All Featured
Build your cross-platform service in a week with App Engine
jlugia
229
18k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
228
52k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.2k
Making the Leap to Tech Lead
cromwellryan
132
8.9k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
4
290
No one is an island. Learnings from fostering a developers community.
thoeni
19
3k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
28
9.1k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
9
680
The Art of Programming - Codeland 2020
erikaheidi
51
13k
A Tale of Four Properties
chriscoyier
156
23k
Optimising Largest Contentful Paint
csswizardry
33
2.9k
How To Stay Up To Date on Web Technology
chriscoyier
788
250k
Transcript
"O&5-'SBNFXPSL GPS0OMJOF"OBMZUJDBM1SPDFTTJOH PG-JOLFE0QFO%BUB )JSPZVLJ*/06&̍ 5PTIJZVLJ"."("4" BOE)JSPZVLJ,*5"("8" ̍(SBEVBUF4DIPPMPG4ZTUFNTBOE*OGPSNBUJPO&OHJOFFSJOH
6OJWFSTJUZPG5TVLVCB 'BDVMUZPG&OHJOFFSJOH *OGPSNBUJPOBOE4ZTUFNT 6OJWFSTJUZPG5TVLVCB
! +6E>99>VJH>DCD;%>C@:9(E:C6I6%( ! B:I=D9IDEJ7A>H=6C9H=6G:HIGJ8IJG:996I6DCI=:0:7 ! Q0:7D;6I6U6I6A>C@:9L>I=:68=DI=:G ! +:HDJG8::H8G>EI>DCG6B:LDG@+ ! ;G6B:LDG@;DG9:H8G>7>C<G:HDJG8:HDCI=:0:7 ! -G>EA:,J7?:8I
)G:9>86I: 6C9(7?:8I ! ,I6I>HI>86A96I66H%>C@:9(E:C6I6 ! DK:GCB:CIHT6I6 <DK., JGDHI6I. ! ,8>:C8:H >DAD<N &:9>8>C:9GJ< ! ,:CHDGD7H:GK6I>DCHT0:6I=:G +69>6I>DC ! GDL>C<9:B6C9H;DGCJB:G>86A6C6ANH>HDK:G%( %>C@:9(E:C6I6 +
! C6ANI>86AEGD8:HH>C<B:I=D9;DG96I676H:H ! 6I6 8J7:BJAI> 9>B:CH>DC6ABD9:A ! 'JB:G>86AK6AJ:H ! M:HD;6C6ANH>H ! 8DCI6>CH=>:G6G8=>86AHIGJ8IJG:
! ,I6GH8=:B6 ! 68II67A: ! >B:CH>DCI67A:H (C %>C:C6ANI>86A)GD8:HH>C<(%) ĺ=IIE LLL 6IB6G@>I 8D ?E ;L>C@IJIDG HFA HFA 5 =IBA 100 32 4 32 32 128 128 128 64 64 64 386 386 386 686 686 686 16 16 8 8 8 2 2 DBDG> ,:C96> -D@ND (H6@6 !>GD H=>B6 6HI 0:HI )A68: J@J D@6 A =6A; ->B: ; =6A; * * * * ) 6I:<DGN (, &68 0>C %6EIDE :H@IDE +:HJAI " 86I:<DGN5>9 I>B:5>9 ,IDG:5>9 6I:<DGN " A6G<:86I:<DGN HB6AA86I:<DGN ->B: " =6A; FJ6GI:G )A68: " HI6I: 8>INC6B: 68I >B >B >B
! MIG68I -G6CH;DGB 6C9%D69_-%` ! MIG68IMIG68I96I6;GDB96I6G:HDJG8: ! -G6CH;DGB6I68A:6CH>C< ! %D69%D6996I6ID6I606G:=DJH:0!
-%;DG(%) ,8=:B6 %D69 MIG68I -G6CH;DGB 0!
! (7?:8I>K: ! )GDEDH:6;G6B:LDG@6EEAN>C<(%)IDINE>86A CJB:G>86ADGHI6I>HI>86A96I6EJ7A>H=:96H%( ! )GD7A:BH ! DCK:GI<G6E=HIGJ8IJG:96I6IDG:A6I>DC6AH8=:B6 ! )G:E6G:6M:H6C9=>:G6G8=>:HD;6C6ANH>H (7?:8I>K:6C9EGD7A:BH
! -LD9>G:8I>DCH .H:G:A6I>DC6A96I676H:6C9(%)HNHI:B ! $6BE<:C:I6A 23T69K6CI6<:>CE:G;DGB6C8: EEAN(%)
A>@:FJ:GN9>G:8IAN ! I8=:K:GGN:I6A 2 3TJH:,)+*%6+FJ:GNA6C<J6<: ! DI=B:I=D9HG:FJ>G: ! +6I6J7:/D867JA6GN* ! (E:CJ7:/D867JA6GNZ*(%) +:A6I:9LDG@ 23 $6BE<:C 6C9 !6GI= Q-G6CH;DGB>C<,I6I>HI>86A%>C@:96I6;DG.H:>C(%),NHI:BHU "C" ,&'-", I="CI DC; DC,:B6CI>8,NHI:BH 23% I8=:K:GGN6C9 /6>HB6C QC=6C8>C<(%)C6ANH>HL>I=0:7J7:HU "C,0 KDAJB:D;%:8IJG:'DI:H>CDBEJI:G,8>:C8: E6<:HT ,EG>C<:G 23% I8=:K:GGN6C9 /6>HB6C Q*(%)/D867JA6GN;DG(%)J7:HDCI=:,:B6CI>80:7U "C(% KDAJB: D;.+0DG@H=DE)GD8::9>C<H .+0, DG<
! -LD9>G:8I>DCH .H:G:A6I>DC6A96I676H:6C9(%)HNHI:B ! $6BE<:C:I6A 23T69K6CI6<:>CE:G;DGB6C8: EEAN(%)
A>@:FJ:GN9>G:8IAN ! I8=:K:GGN:I6A 2 3TJH:,)+*%6+FJ:GNA6C<J6<: ! DI=B:I=D9HG:FJ>G: ! +6I6J7:/D867JA6GN* ! (E:CJ7:/D867JA6GNZ*(%) +:A6I:9LDG@ 23 $6BE<:C 6C9 !6GI= Q-G6CH;DGB>C<,I6I>HI>86A%>C@:96I6;DG.H:>C(%),NHI:BHU "C" ,&'-", I="CI DC; DC,:B6CI>8,NHI:BH 23% I8=:K:GGN6C9 /6>HB6C QC=6C8>C<(%)C6ANH>HL>I=0:7J7:HU "C,0 KDAJB:D;%:8IJG:'DI:H>CDBEJI:G,8>:C8: E6<:HT ,EG>C<:G 23% I8=:K:GGN6C9 /6>HB6C Q*(%)/D867JA6GN;DG(%)J7:HDCI=:,:B6CI>80:7U "C(% KDAJB: D;.+0DG@H=DE)GD8::9>C<H .+0, DG< "CI=>HG:H:6G8= L:EGDEDH:<:C:G6A;G6B:LDG@ ID6EEAN(%)6C6ANH>HID%( 0::BEADN+6C9:M>HI>C<(%)HNHI:B
-%G6B:LDG@DK:GK>:L MIG68I+ 0:7 ,IDG:+ID+ "C9J8:9>B:CH>DCH :C:G6I:H8=:B6 1&% %D69
MIG68I -G6CH;DGB 0!
,IDG:+ID+ ! -NE: E6GI>I>DC:9-G>EA:,IDG:-)-, ! A6HH>;NIG>EA:HL>I=>IHQG9;INE:U ! ,IDG:IG>EA:>C6GDLL>I=D7?:8I96I6INE:
Q+:HJAIUI67A:_-)-,` MIG68I+ ,IDG:+ID+ >B:CH>DC>C9J8I>DC ,8=:B6<:C:G6I> HJ7?:8I EG:9>86I: D7?:8I INE: G:HJAI5 I>B: I>B:5 G:HDJG8: G:HJAI5 86I:<DGN 8DBEJI:G G:HDJG8: G:HJAI5 KDAJB: Q U A>I:G6A G:HJAI5 HIDG: -HJ@J76 G:HDJG8: G:HJAI5 I>B: I>B:5 G:HDJG8: G:HJAI5 KDAJB: Q U A>I:G6A G:HJAI5 HIDG: &>ID G:HDJG8: -HJ@J76 Q UY 8DBEJI:G 86I:<DGN KDAJB: I>B:5 I>B: G:HJAI5 HIDG: +:HJAI G:HJAI5 &>ID ,IDG: I>B:5 I>B: Q UY KDAJB: G9;INE:
! DCK:GI-)-,ID)GDE:GIN-67A: ! L:86C@CDLL=6I6IIG>7JI:HDGEGDE:GI>:HI=:G:6G: ,IDG:+ID+ HJ7?:8I2)$3 I>B:2$3 86I:<DGN2$3 KDAJB:
HIDG:2$3 G:HJAI5 I>B:5 8DBEJI:G Q U -HJ@J76 G:HJAI5 I>B:5 CJAA Q U &>ID Q+:HJAIUI67A:_)GDE:GIN-67A:` HJ7?:8I EG:9>86I: D7?:8I INE: G:HJAI5 I>B: I>B:5 G:HDJG8: G:HJAI5 86I:<DGN 8DBEJI:G G:HDJG8: G:HJAI5 KDAJB: Q U A>I:G6A G:HJAI5 HIDG: -HJ@J76 G:HDJG8: G:HJAI5 I>B: I>B:5 G:HDJG8: G:HJAI5 KDAJB: Q U A>I:G6A G:HJAI5 HIDG: &>ID G:HDJG8: Q+:HJAIUI67A:_-)-,` MIG68I+ ,IDG:+ID+ >B:CH>DC>C9J8I>DC ,8=:B6<:C:G6I> +:HJAIH8=:B6 )$)G>B6GN@:N $DG:><C@:N +:HJAI 2)$3HJ7?:8I 2$3I>B: 2$386I:<DGN KDAJB: 2$3HIDG:
,:A:8I>DCD;B:6HJG: ! .H:G8=DDH:HB:6HJG:6BDC<CJB:G>86AK6AJ:H +:HJAI HJ7?:8I 86I:<DGN5" I>B:5" HIDG:5" KDAJB: 6I:<DGN HJ7?:8I
C6B: ->B: HJ7?:8I 96I: I>B: ,IDG: HJ7?:8I AD86I>DC5" <CAD86I>DC HJ7?:8I C6B: />H>IDG HJ7?:8I HIDG:5" I>B:5" K>H>IDG8DJCI:G ,ID8@ HJ7?:8I EGD9J8I5C6B: 86I:<DGN5" HIDG:5" HID8@CJB7:GH 68I >B I67A:86C9>96I:H
.H:=>:G6G8=6AHIGJ8IJG: ;GDBDJIH>9:96I6 >B:CH>DC>C9J8I>DC ! G:6I:9>B:CH>DCI67A:;DG(%) ! I=G::8G:6I>DCB:I=D9H ,6A:HKDAJB: HJ7?:8I
86I:<DGN5" I>B:5" HIDG:5" KDAJB: 86I:<DGN HJ7?:8I C6B: ->B: HJ7?:8I 96I: I>B: <CAD86I>DC HJ7?:8I <CC6B: 68I .H:A>I:G6AI=6I>HLG>II:C>C96I69>G:8IAN .H:=>:G6G8=6AHIGJ8IJG: >HLG>II:C>C96I69>G:8IAN MIG68I+ ,IDG:+ID+ >B:CH>DC>C9J8I>DC ,8=:B6<:C:G6I> )6G:CI6I:<DGN HJ7?:8I C6B: :D'6B:H :I8
! 86H:QKDAJB:UL6HH:A:8I:96H6B:6HJG: ! ;68I I67A:`+:HJAIH ! 9>B I67A:`->B:Z6I:<DGNZ,IDG: <CEA68:
:C:G6I:H8=:B6;DG(%) +:HJAIH HJ7?:8I 86I:<DGN5" I>B:5" HIDG:5" KDAJB: 6I:<DGN HJ7?:8I C6B: ->B: HJ7?:8I =DJG 96N BDCI= FJ6I:G N:6G ,IDG: <CEA68: HJ7?:8I %_9>HIG>8I` %_EG:;:8IJG:` %_8DJCIGN` %_8DCI>C:CI` 68I >B >B >B +6I6+:IG>:K6A +6I6,IDG>C< >B:CH>DC>C9J8I ,8=:B6<:C:G6
6H:HIJ9N ! +69>6I>DC68I>K>IN96I6 ! '6I>DC6A+69>D68I>K>IN,I6I6H%>C@:96I6 ! Q&DC>IDG>C<>C;DGB6I>DCD;:CK>GDCB:CI6AG69>D68I>K>INA:K:AU ;GDB'J8A:6G+:<JA6I>DCJI=DG>IN>C#6E6C ! 'JB D;-G>EA:H
&6G :8 >C ! :D'6B:HT;DG<:D<G6E=>8G:HDJG8:H ! JH:99JBE:9RA: ! 0:6AHD6EEA>:9IDDI=:G96I6H:IH ! %>C@:9,:CHDG (7H:GK6I>DC6I6T,:CHDGD7H:GK:9 ! >D>C;DGB6I>8H =IIE LLL @6CO6@> 8DB LDG@H HI6I G6 =IIE G69>D68I>K>IN CHG <D ?E ?6
! G:6I:9H8=:B6L=:CQK6AJ:UL6HJH:96H6B:6HJG: ! ;68I I67A:`D7H:GK6I>DC5>CHI6C8: ! 9>B I67A:`->B: %D86I>DC
+:HJAIH D7H:GK6I>DC5>CHI6C8: HJ7?:8I EA68:5HJ7?:8I I>B:5HJ7?:8I K6AJ: 68I EA68: HJ7?:8I A6N:G5_9>HIG>8I` A6N:G5_EG:;:8IJG:` A6N:G5_8DJCIGN` A6N:G5_8DCI>C:CI` I>B: HJ7?:8I H:8 B>C =DJG 96N BDCI= N:6G G6 E I Q U <C G9;K6AJ: I>B: -)-! :KEA68: :KI>B: Q - U 44MH996I:->B: IA6I (7H "CHI6C8: /6AJ: >B >B I>B: AD86I>DC &:6HJG:
! C-%G6B:LDG@;DG(%)D;%( ! 6CN9:9>86I:9+KD867JA6G>:H ! <:C:G6I:HHI6GH8=:B6;DG(%)H:B> 6JIDB6I>86AAN !
&6EE>C<+IDG:A6I>DC6AH8=:B6 ! "C9J8:=>:G6G8=>86AHIGJ8IJG:H;GDB>CC:G DJI:GD;96I6 ! 6H:HIJ9N ! EEA>:9IDG69>6I>DC68I>K>IN96I6 ! "C9J8:96M>HD;6C6ANH>H <:C:G6I:96HI6GH8=:B6 ! JIJG:LDG@ ! G:A6I:9IDI=:QG9;INE:U ! ,J7?:8IL=>8=9D:HCPI=6K:6CNQG9;INE:U ! ,J7?:8IL=>8==6HB6CNQG9;INE:UH ! EEAN%(JE96I:IDH8=:B6 DC8AJH>DC6C9JIJG:LDG@
-=6C@NDJ