Generative A.I. + Law - A Year in Review

Generative A.I. + Law - A Year in Review - Including GPT Passes the Bar & Eleven Days that Defined the Year in (Legal) A.I.

Talk Delivered at The Legal Tech Fund Summit - TLTF Miami (2023)

December 4, 2023

Transcript

1. G E N E R AT I V E A . I . + L AW @ computational professor daniel martin katz danielmartinkatz.com Illinois tech - chicago kent law 273Ventures.com A Y E A R I N R E V I E W I N C LU D I N G G P T PA S S E S T H E B A R & E L E V E N DAY S T H AT D E F I N E D T H E Y E A R I N ( L E G A L ) A I https://bit.ly/3yxhY2e
3. NOVEMBER 30, 2022
4. I THINK THIS DAY WILL GO DOWN AS A VERY IMPORTANT DAY IN THE HISTORY OF TECHNOLOGY
5. NOVEMBER 30, 2022 IS THE DAY THAT CHATGPT WAS FIRST RELEASED BECAUSE
6. THIS WAS THE BEGINNING OF THE BROADER PUBLIC’S AWARENESS …
7. OF WHAT WAS ALREADY TRUE …
8. WHICH IS THAT IN THE BACKGROUND
9. THERE HAVE BEEN FUNDAMENTAL IMPROVEMENTS OCCURRING WITHIN THE WORLD OF NATURAL LANGUAGE PROCESSING (NLP)
11. I PERSONALLY HAVE BEEN WORKING IN THIS AREA FOR A WHILE …
13. THINKING ABOUT HOW TO USE LANGUAGE MODELS HERE IN THE LEGAL SECTOR
14. BUT IT HAS BEEN HARD TO COMMUNICATE TO MANY FOLKS IN THE LEGAL AND RELATED SECTORS …
15. ABOUT THE NATURE OF THE LANDSCAPE SHIFT IN THE FIELD …
16. MAYBE IT IS ROBOLAWYER FATIGUE …?
18. MAYBE IT IS THE ABSENCE OF A CLEAR DEMONSTRATION PROJECT …
20. SO NOW WE ARE JUST 12 MONTHS INTO ARGUABLY THE MOST SUCCESSFUL PRODUCT LAUNCH IN HISTORY …
23. SO TO KICK THINGS OFF HERE AT THE TLTF SUMMIT
24. TODAY — I THOUGHT I WOULD OFFER SOME OPENING COMMENTS ON THIS MAGICAL YEAR …
25. STARTING WITH AN OVERVIEW …
26. AND THEN TRANSITIONING TO A ‘YEAR IN REVIEW’
27. A ‘YEAR IN REVIEW’ THROUGH THE LENS OF ELEVEN DATES THAT HELPED DEFINED THE PRESENT AND FUTURE FOR OUR FIELD…
29. BUT FIRST — HOW DID WE GET HERE?
30. ALL OF THIS GENERATIVE A.I. DID NOT COME OUT OF NOWHERE …
31. MACHINES ARE INCREASINGLY IMPROVING IN THEIR ABILITY TO PROCESS AND ‘UNDERSTAND’ LANGUAGE
32. INITIAL PERFORMANCE AND HUMAN PERFORMANCE ARE NORMALIZED TO -1 AND 0 RESPECTIVELY (KIELA ET AL., 2021).
33. AND LEADING MODELS ARE RAPIDLY GROWING IN SCALE
34. SIZE OF LARGE LANGUAGE MODELS IN BILLIONS OF PARAMETERS
35. THE IMPLICATION IS THAT PREVIOUSLY UNTOUCHABLE PROBLEMS WILL BEGIN TO COME WITHIN REACH …
37. THIS IS MOSTLY A STORY OF BRUTE FORCE COMPUTING …
38. Moore’s law !
39. Kryder’s law !
40. AND THAT BRUTE FORCE GETS APPLIED TO LANGUAGE AND PATTERNS IN LANGUAGE
42. WHAT IS GPT ? WHAT IS CHATGPT ? WHAT IS GPT-4 ?
43. GPT = GENERATIVE PRE-TRAINED TRANSFORMER (WE CAN TRY TO UNPACK ALL OF THIS IN A MINUTE)
44. GPT = IT IS A LARGE LANGUAGE MODEL (LLM) BUT FAR FROM THE ONLY ONE GENERATIVE PRE-TRAINED TRANSFORMER
45. XAVIER AMATRIAIN, TRANSFORMER MODELS: AN INTRODUCTION AND CATALOG, ARXIV:2302.07730 (2023) HTTPS://ARXIV.ORG/ABS/2302.07730 THE LEADING LLM MODELS
46. BETTER HARDWARE PARALLEL COMPUTING ATTENTION MECHANISM THE PATH TO MEGASCALE LARGE LANGUAGE MODELS HAS BEEN DRIVEN BY A MIXTURE OF
47. THE SAME TECH THAT HAS POWERED HIGHLY IMMERSIVE GAMING HAS ALSO PUSHED SCIENCE FORWARD … https://www.thegamer.com/pc-games-best-intense-graphics/
48. APRIL 5, 2023 NOT COMPARED DIRECTLY WITH THE H100 BUT THIS SHOWS YOU THE NATURE OF THE COMPETITION TAKING PLACE https://www.cnbc.com/2023/04/05/google- reveals-its-newest-ai-supercomputer- claims-it-beats-nvidia-.html
49. WOULD TAKE 300 YEARS TO TRAIN EVEN GPT-3 ON A SINGLE GPU BUT WE TRANSFORMER ARCHITECTURE ALLOWS FOR SIGNIFICANT PARALLELIZATION
50. TRAINED MODEL ON A BILLION PAIRS OF WORDS IN JUST 3.5 DAYS ON EIGHT NVIDIA GPUS … THIS APPROACH HIGHLIGHTED A PATH TO THE PRESENT WITH EVER LARGER FUTURE https://blogs.nvidia.com/blog/2022/03/25/ what-is-a-transformer-model/
51. NOW PARALLEL COMPUTING IS BEING DONE ON A MEGASCALE
52. SOME INPUTS TO GPT COMMON CRAWL WEBTEXT2 BOOKS1/2 WIKIPEDIA OPENAI LIKELY DID SOME SIGNIFICANT CLEANING / PREPROCESSING OF THESE SOURCES PRIOR TO TRAINING GPT-3 IS 175B PARAMETERS TRAINED WITH 499B TOKENS
53. THE POINT HERE IS TO MAKE CLEAR THAT THERE ARE MANY STEPS AND MOVING PARTS …
54. THERE ARE OTHER PLAYERS BESIDES OPENAI AND THEY WILL LIKELY PURSUE OTHER STEPS / MOVING PARTS … AND MANY MORE …
56. NOW WHY IS ALL OF THIS INTERESTING HERE IN THE WORLD OF LAW?
57. LANGUAGE IS THE ‘COIN OF THE REALM’ HERE IN THE LEGAL WORLD
58. VIRTUALLY ALL ROADS IN LAW LEAD TO A DOCUMENT (CONSUMPTION, PRODUCTION OR BOTH)
59. IF MACHINES CAN ‘UNDERSTAND’ NOT ONLY GENERAL LANGUAGE BUT COMPLEX ‘LEGALESE’ …
60. THEN THEY MIGHT BE ABLE TO REALLY HELP OUR FIELD …
61. BUT HOW WELL CAN LEADING MODELS PERFORM ON COMPLEX PROFESSIONAL TASKS ?
63. RIGHT BEFORE THE HOLIDAYS ROUGHLY DEC 22, 2022
64. I CALLED MY FRIEND AND FREQUENT COLLABORATOR MIKE BOMMARITO
65. AND SAID LET’S EVALUATE CHATGPT ON THE MULTIPLE CHOICE PART OF THE BAR EXAM
66. AND IT DID PRETTY WELL …
67. V1.01 - December 29, 2022 V2.01 - January 3, 2023
68. LITTLE DID WE KNOW AT THE TIME THAT THIS PAPER PUT US ON A PATH …
69. TO BE INVOLVED IN THE LAUNCH OF GPT-4* *OBVIOUSLY WE ARE JUST PLAYING A VERY SMALL ROLE IN THE BIG PICTURE (BUT WE WILL TAKE IT!)
70. GPT-4 BAR EXAM https://openai.com/research/gpt-4 March 14, 2023
72. https://www.youtube.com/watch?v=4pGG79VdNmU
73. CHATGPT BAR EXAM PASSES Paper Now Available on SSRN! March 15, 2023 - Version 1.01 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4389233
76. AND IT CAN DO THE ESSAYS AS WELL …
78. (GPT-3.0 was released in 2020)
79. (GPT-3.0 was released in 2020) This ain’t passing any bar exam
82. OBVIOUSLY THE BAR EXAM IS *NOT* THE ‘BE ALL END ALL’ BUT IT IS SOME MEASURE OF CAPABILITY
83. BUT THE BROADER QUESTION IS HOW TO INDUSTRIALIZE THESE RAW CAPABILITIES WITHIN SPECIFIC LEGAL WORKSTREAMS / USE CASES
84. OVER THE PAST YEAR …
85. MANY (LEGAL) ORGANIZATIONS HAVE HAD TO CONSIDER HOW TO INCORPORATE AND/ OR METABOLIZE THESE DEVELOPMENTS
87. FROM ‘OUT OF THE BOX’ RAW CAPABILITIES TO INDUSTRIAL APPLICATIONS
88. OUR BAR EXAM ANALYSIS IS REALLY AN EVALUATION OF THE ‘OUT OF THE BOX’ CAPABILITIES OF GPT-4 (ALSO CALLED A ‘ZERO-SHOT’ ANALYSIS OF THE CAPABILITIES)
89. IN OTHER WORDS, WE ARE SHOWING THE BARE MINIMUM OF THE CAPABILITIES HERE
91. ‘OUT OF THE BOX’ ENTER PROMPT RECEIVE ANSWER (ZERO-SHOT)
92. ‘AD HOC PROMPT ENGINEERING’ ENTER PROMPT RECEIVE ANSWER ’PROMPT ENGINEERING’ IS ABOUT TUNING / REFINING PROMPTS TO OBTAIN BETTER ANSWERS (HALF-SHOT)
93. MUCH MORE CAN BE DONE WITH ADDITIONAL ENGINEERING LAYERS BUILT ON TOP OF THESE RAW CAPABILITIES
95. HERE ARE TEN EXAMPLES OF LLMs APPLICATIONS / USE CASES IN THE LEGAL SECTOR
96. LOOK AT THESE EXAMPLES OF THE CURRENT ‘ART OF THE POSSIBLE’
97. BECAUSE SOME OF THE APPROACHES / FRAMEWORKS CAN BE RETROFITTED TO OTHER PROBLEMS
99. (1) DRAFT A BRIEF HERE DAMIEN RIEHL FROM VLEX WALKS THROUGH HOW TO BUILD MORE OF A BRIEF THROUGH SEQUENTIAL PROMPTING … HTTPS://WWW.LINKEDIN.COM/PULSE/CHATGPT- LEGAL-BRIEFWRITING-TOOL-DAMIEN-RIEHL/
100. HTTPS://WWW.LINKEDIN.COM/PULSE/CHATGPT- LEGAL-BRIEFWRITING-TOOL-DAMIEN-RIEHL/
102. CONTRACT NEGOTIATION (2) (AUTOMATIC REDLINE AGAINST A PLAYBOOK)
106. (3) REGULATORY MONITORING
107. MANY (ALL) ORGANIZATIONS MUST MONITOR THE CHANGING REGULATORY ENVIRONMENT
108. PARTICULARLY ON A GLOBAL BASIS — THE IDENTIFICATION AND ROUTING OF ALL OF THIS WORK IS A GOOD CANDIDATE FOR MACHINES …
109. THINK OF AN ‘AIR TRAFFIC CONTROL SYSTEM’ BUT FOR REGULATORY MANAGEMENT
110. 1. IDENTIFY NEW REGULATIONS 2. IDENTIFY ANY IMPACTED INTERNAL POLICIES / PROCEDURES 3. IDENTIFY INDIVIDUAL / TEAM RESPONSIBLE FOR COMPLIANCE WITH NEW REGULATIONS 4. ISSUE TICKET TO THE INDIVIDUAL / TEAM TO UPDATE POLICY AND COMPLIANCE PLAN APPROXIMATE WORKFLOW FOR REGULATORY MONITORING** **NOTE: EXACT INTERNAL PROCESS MAY DIFFER BY ORGANIZATION
113. (4) PATENT DRAFTING
117. (5) LEGAL RESEARCH
120. THOSE ARE JUST A FEW MORE OF MANY OTHER POTENTIAL AREAS WHERE THIS CLASS OF TECH MIGHT BE USEFUL … AND MANY MANY OTHER EXAMPLES 6. E-DISCOVERY 7. DEALS DATABASES 8. LITIGATION MGMT 9. BUSINESS OF LAW 10. COMPLEX FINANCIAL DOCS
122. GOOD NEWS YOU ARE NOT GOING TO HAVE TO IMAGINE ALL OF THE POSSIBILITIES
123. BECAUSE MORE THAN 30+ COMPANIES ARE GOING TO PRESENT OVER THE NEXT FEW DAYS
124. STARTUP SHOWCASE COMPANIES
125. SCALE STAGE COMPANIES
127. BUT TO SET THE STAGE FOR THE DAYS TO COME …
128. ELEVEN DAYS THAT HELPED DEFINE THE PRESENT AND FUTURE FOR GEN (LEGAL) A.I. THE YEAR IN REVIEW
129. FOR EACH OF THESE ELEVEN DATES, I WILL OFFER THOUGHTS ON THE IMPLICATIONS OF THESE DATES TO THE FUTURE OF (LEGAL) AI
131. NOVEMBER 30, 2022 TWO DATES HIGHLIGHTED SO FAR #1 OF 11 IMPLICATION GPT / LLMS GO MAINSTREAM
132. IMPLICATION MARCH 15, 2023 #2 OF 11 GPT-4 IS A SERIOUS UPGRADE OVER PRIOR VERSIONS TWO DATES HIGHLIGHTED SO FAR
134. MARCH 30, 2023 THE RISE OF VERTICALIZED LLMS #3 OF 11
135. FOLKS OFTEN ASK ME — WILL THERE BE A ‘LAW GPT’? PROBABLY SOON
136. HERE IS PROBABLY THE CLOSEST EXAMPLE… USING ~300+ BILLION FINANCE TOKENS**
137. https://www.bloomberg.com/company/press/ bloomberggpt-50-billion-parameter-llm-tuned- fi nance/ https://arxiv.org/pdf/2303.17564.pdf
138. NOT ONLY COMPETITION AMONG FOUNDATIONAL MODELS IMPLICATION BUT ALSO VERTICALIZED GPTS (E.G. LAW GPTS) (GPT, CLAUDE , GEMINI / BARD, ETC.)
140. APRIL 6, 2023 INFO SEC, GEN AI POLICIES AND THE RISE PRIVATE INSTANCES #4 OF 11
141. https://mashable.com/article/samsung-chatgpt-leak-details
142. THE ROGUE ASSOCIATE (OR PARTNER) PASTING STUFF INTO GPT OR ANOTHER LLM MODEL LAW VERSION OF THE CONCERN
143. FUD VS FEAR, UNCERTAINTY, & DOUBT FEAR OF MISSING OUT FOMO ORGANIZATIONS / INDIVIDUALS TOGGLE BETWEEN THESE TWO POINTS OF VIEW (SOMETIME WITHIN THE SAME CONVERSATION)
144. ORGANIZATIONS LAUNCH PRIVATE INSTANCES OF GPT-4, ETC.
145. https://legaltechtrends.substack.com/p/legal-tech-trends-newsletter-14 ORGANIZATIONS LAUNCH PRIVATE INSTANCES OF GPT-4, ETC.
146. FEAR / DOUBT IS ULTIMATELY GOING TO BE MANAGED AS THESE CAPABILITIES BECOME BAKED INTO ENTERPRISE GRADE OFFERINGS IMPLICATION
148. MAY 27, 2023 THE NEW YORK CHATGPT LAWYER #5 OF 11
150. BECAUSE OF THE POTENTIAL FOR MODEL HALLUCINATION, ETC.
151. IT IS IMPORTANT TO USE THESE TOOLS (AT LEAST FOR NOW) AS PART OF A HUMAN IN THE LOOP PROCESS
152. ONE WAY TO DRAMATICALLY REDUCE THE LIKELIHOOD OF A HALLUCINATION IS TO ANCHOR OUTPUT AGAINST SOME ‘GROUND TRUTH’ …
153. ONE SHOT ENHANCE THIS QUERY USING CONTEXTUALLY RELEVANT INFORMATION ORIGINAL QUERY OUTPUT* (RETRIEVAL AUGMENTATION) (COULD BE CONSTRUCTED ON VIA ‘PROMPT ENGINEERING’) ENTERED INTO A FOUNDATIONAL MODEL (VARIOUS TECHNIQUES ARE POSSIBLE SUCH AS USING EMBEDDINGS AND STORED IN A VECTOR DATABASE) ( QUERY & CONTEXTUAL INFO) REVISED QUERY **NOTE OUTPUT CAN BE FURTHER ENHANCED IN FEW SHOT EXAMPLES
154. THERE IS A BROADER ENGINEERING ARC WHICH WE WILL SEE AS TOOLS / OFFERINGS MATURE
155. LAYERS OF ENGINEERING ON TOP OF LLMS IS KEY TO TRULY UNLOCK COMPLEX VERTICALS LIKE LAW IMPLICATION
157. JUNE 26, 2023 CASETEXT & THOMSON REUTERS DEAL #6 OF 11
158. https://techcrunch.com/2023/06/26/ thomson-reuters-buys-casetext-an-ai- legal-tech-startup-for-650m-in-cash/
159. EVERY STARTUP IN THIS ROOM OWES A DEBT OF GRATITUDE TO CASETEXT FOR SETTING A FAIRLY LARGE PUBLIC NUMBER
160. MASS APPEAL PRODUCT FIN(LEGAL)TECH DOCUSIGN LEGALZOOM LIT FINANCE RISK MGMT BUT EVEN LARGER $$ ARE POSSIBLE FOR THIS SPACE
161. MORE BROADLY, I THINK MANY LEGACY LEGALTECH PROVIDERS ARE GOING TO NEED HELP ON THEIR GEN AI TRANSITION
162. EVENTUALLY SOME WILL GIVE UP ON THEIR HALF BAKED INTERNAL EFFORTS AND SEEK TO INNOVATE VIA ACQUISITION
163. MORE M&A TRANSACTIONS ARE COMING IN 2024 IMPLICATION
165. JULY 18, 2023 LLAMA 2 RELEASE #7 OF 11
168. WILL OPEN SOURCE MODEL ULTIMATELY MATCH OR EXCEED PERFORMANCE OF LEADING MODELS ?
169. THIS REMAINS TO BE SEEN …
170. OPEN SOURCE LLMS ARE IN A SERIOUS HORSE RACE WITH OPENAI, ETC. IMPLICATION SIGNIFICANT IMPLICATIONS FOR INVESTMENT, ENGINEERING, ETC.
172. SEPTEMBER 15, 2023 GPT USE IN KNOWLEDGE WORK THE AGE OF CENTAUR CHESS #8 OF 11
173. BIG PICTURE HERE IS A BRAND NEW STUDY WHICH HIGHLIGHTS BOTH THE POTENTIAL PRODUCTIVITY AND QUALITY GAINS IN PROFESSIONAL SERVICES
174. “Our study conducted with Boston Consulting Group, a global management consulting fi rm, we examine the performance implications of AI on realistic, complex, and knowledge- intensive tasks. … [The] experiment involved 758 consultants … subjects were randomly assigned to one of three conditions: no AI access, GPT-4 AI access, or GPT-4 AI access with a prompt engineering overview. For each one of a set of 18 realistic consulting tasks within the frontier of AI capabilities, consultants using AI were signi fi cantly more productive (they completed 12.2% more tasks on average, and completed tasks 25.1% more quickly), and produced signi fi cantly higher quality results (more than 40% higher quality compared to a control group).” https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4573321
175. CENTAUR CHESS HUMAN + MACHINE HUMAN OR MACHINE >
176. AND REMEMBER THIS STUDY ONLY CONSIDERS GPT-4 WITH PROMPTING IMPLICATION GREATER PERFORMANCE WILL FOLLOW WHEN ENGINEERING ENHANCEMENTS ARE ADDED SIGNIFICANT QUALITY AND EFFICIENCY RESULTS
178. NOVEMBER 6, 2023 OPEN AI DEV DAY AGENTS, AGENTS, AGENTS #9 OF 11
180. GENERATIVE AGENTS
182. WE HAVE SEEN QUITE A BIT OF THIS SINCE THE LAUNCH OF CHATGPT
183. WHAT IS THE PRODUCT VALUE ADD OVER BASELINE CAPABILITIES? TRUST BUT VERIFY THERE IS GOING TO BE SIGNIFICANT PRESSURE ON LEGAL TECH COMPANIES TO OVERSTATE THE ACTUAL CONTRIBUTION OF THEIR OFFERING ABOVE JUST AN LLM API CALL I SUGGEST YOU TRUST BUT VERIFY ALL CLAIMS
184. IMPLICATION MORE INNOVATION MORE DISRUPTION MORE NEED FOR ADAPTATION AND THIN PRODUCTS BUILT ON GPT WILL LIKELY NEED TO PIVOT …
186. NOVEMBER 17, 2023 SUPPLY CHAIN RISK FOR THE WORLD OF GEN AI #10 OF 11
187. NOVEMBER 17 2023 https://www.nytimes.com/2023/11/17/technology/openai-sam-altman-ousted.html
189. NOVEMBER 22, 2023 https://www.nytimes.com/2023/11/22/technology/openai-sam-altman-returns.html
190. THIS AMONG OTHER THINGS HIGHLIGHTS SUPPLY CHAIN RISK IN AI …
191. BUT ALSO A MORE FUNDAMENTAL TRUTH …
192. K-LLMS WHERE K IS SOME NUMBER GREATER THAN ONE THIS WAS ALWAYS GOING TO BE ABOUT MIXING AND MATCHING MODELS (FANCY WAY TO SAY MIX AND MATCH MODELS)
193. IMPLICATION COMPANIES NEED TO BE ABLE TO ADAPT AS TECH LANDSCAPE RAPIDLY EVOLVES COMPANIES WITH A SINGLE SOURCE LLM STRATEGY ARE AT REAL RISK
195. FINAL THOUGHTS
196. ELEVEN DAYS THAT HELPED DEFINE THE PRESENT AND FUTURE FOR GEN (LEGAL) A.I.
197. SO FAR I HAVE MENTIONED TEN OF THE DATES THAT WILL HELP DEFINE THE FUTURE FOR OUR FIELD…
198. APRIL 6, 2023 JUNE 26, 2023 JULY 18, 2023 NOVEMBER 6, 2023 NOVEMBER 17, 2023 MARCH 30, 2023 SEPTEMBER 15, 2023 MAY 27, 2023 SAM ALTMAN FIRED OPEN AI DEV DAY LLAMA 2 RELEASE HBS STUDY RELEASE CASETEXT + TR DEAL NY CHATGPT LAWYER BLOOMBERG GPT RELEASE SAMSUNG CODE INCIDENT SUMMARY OF TEN KEY DATES FOR THE YEAR MARCH 15, 2023 GPT-4 RELEASE DAY NOVEMBER 30, 2022 CHATGPT RELEASE DAY
199. HIGHLIGHTS AI SUPPLY CHAIN RISKS OPEN SOURCE MODELS MIGHT WIN BIG GAINS IN PROFESSIONAL SERVICES MORE M&A ACTIVITY TO FOLLOW NEED LAYERS ON TOP BASE MODELS BLOOMBERG GPT SAMSUNG INCIDENT GPT-4 RELEASE 11.30.22 CHATGPT RELEASE GPT GOES MAINSTREAM 3.15.23 3.30.23 RISE OF VERTICALIZED LLMS GPT-4 IS A SERIOUS UPGRADE 4.06.23 ENTERPRISE DEPLOYMENT NEEDED SAM ALTMAN FIRED OPEN AI DEV DAY LLAMA 2 RELEASE HBS STUDY RELEASE CASETEXT + TR DEAL NY CHATGPT LAWYER TEN DAYS AND THEIR IMPLICATIONS 5.27.23 6.26.23 7.18.23 9.15.23 11.6.23 11.17.23 AGENTS - MORE INNOVATION COMING
200. BUT I THINK YOU ALREADY KNOW THE ELEVENTH DAY THAT IS GOING TO DEFINE THE FUTURE …
201. DECEMBER 4, 2023 BECAUSE THAT DAY IS TODAY #11 OF 11
202. WHAT AN AMAZING COLLECTION OF INDIVIDUALS AND ORGANIZATIONS …
203. THIS IS INDEED GOING TO BE THE ‘ROOM WHERE IT HAPPENS’ …
204. BECAUSE ALL OF YOU ARE GOING TO MAKE IT HAPPEN …
206. NO DOUBT THIS HAS BEEN THE MOST EXCITING YEAR IN TECHNOLOGY IN A VERY LONG TIME
207. HERE WE GO BUT THE BEST IS YET TO COME ! !
211. 273VENTURES.COM KELVIN.LEGAL
212. https://www.linkedin.com/in/daniel-katz-3b001539/
213. G E N E R AT I V E A . I . + L AW @ computational professor daniel martin katz danielmartinkatz.com Illinois tech - chicago kent law 273Ventures.com Y E A R I N R E V I E W I N C LU D I N G G P T PA S S E S T H E B A R & E L E V E N DAY S T H AT D E F I N E D T H E Y E A R I N ( L E G A L ) A I https://bit.ly/3yxhY2e