Tag: gpt3

News
A Review of Deepmind's WaveNet for TTS/Audio Synthesis (Does it look like GPT to you?)
Tutorials

Deepmind์˜ WaveNet TTS/์˜ค๋””์˜ค ํ•ฉ์„ฑ ๋ฆฌ๋ทฐ (๋‹น์‹ ์—๊ฒŒ GPT์ฒ˜๋Ÿผ ๋ณด์ด๋‚˜์š”?)

Tacotron ์ด์ „์—, VALL-E ์ด์ „์—, ์‹ ๊ฒฝ ์ฝ”๋ฑ์ด ์˜ค๋””์˜ค๋ฅผ ํ† ํฐ์œผ๋กœ ๋ณ€ํ™˜ํ•˜๊ธฐ ์ด์ „์—, DeepMind์˜ WaveNet์€ ์‹ ๊ฒฝ๋ง์ด ์›๋ณธ ์˜ค๋””์˜ค ํŒŒํ˜•์„ ์ƒ˜ํ”Œ ๋‹จ์œ„๋กœ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Œ์„ ๋ณด์—ฌ์ค€ ๋…ผ๋ฌธ์ด์—ˆ๊ณ  ๋ชจ๋“  ๋งค๊ฐœ๋ณ€์ˆ˜์‹

5์›” 6, 2023ยท 1 min read
Disclosing OpenAI GPT-4's vision+text model, data, and cost to train (speculated)
Tutorials

OpenAI GPT-4์˜ ๋น„์ „+ํ…์ŠคํŠธ ๋ชจ๋ธ, ๋ฐ์ดํ„ฐ ๋ฐ ํ•™์Šต ๋น„์šฉ ๊ณต๊ฐœ (์ถ”์ธก)

OpenAI๋Š” GPT-4์˜ ์•„ํ‚คํ…์ฒ˜, ํŒŒ๋ผ๋ฏธํ„ฐ ์ˆ˜, ํ•™์Šต ๋ฐ์ดํ„ฐ ๋˜๋Š” ์ปดํ“จํŒ… ์˜ˆ์‚ฐ์„ ๊ณต๊ฐœํ•˜์ง€ ์•Š๊ธฐ๋กœ ์•…๋ช…๋†’์œผ๋ฉฐ, ์ด๋Š” ๊ธฐ์ˆ  ๋ณด๊ณ ์„œ๋ฅผ ML ์ปค๋ฎค๋‹ˆํ‹ฐ๋ฅผ ์œ„ํ•œ ๋กœ๋ฅด์ƒคํ ํ…Œ์ŠคํŠธ๋กœ ๋ฐ”๊พธ์—ˆ์Šต๋‹ˆ๋‹ค.

4์›” 1, 2023ยท 1 min read
A Review of GPT-4's Technical Report (GPT-4 in a Nutshell)
Tutorials

GPT-4์˜ ๊ธฐ์ˆ  ๋ณด๊ณ ์„œ ๋ฆฌ๋ทฐ (ํ•œ๋ˆˆ์— ๋ณด๋Š” GPT-4)

GPT-4์˜ ๊ธฐ์ˆ  ๋ณด๊ณ ์„œ๋Š” ์•„ํ‚คํ…์ฒ˜ ์„ธ๋ถ€์‚ฌํ•ญ์ด ๋ถ€์กฑํ•˜๊ณ  ๋Šฅ๋ ฅ ์ฃผ์žฅ์ด ๋งŽ๊ธฐ๋กœ ์•…๋ช…๋†’์œผ๋ฉฐ, ์ด๋Š” ๋ช…ํ™•ํ•œ ๋ฆฌ๋ทฐ๋ฅผ ๊ทธ ์œ„์— ๊ตฌ์ถ•ํ•˜๋Š” ๋ชจ๋“  ์‚ฌ๋žŒ์„ ์œ„ํ•ด ํ•„์ˆ˜ ์ฝ๊ธฐ๋กœ ๋งŒ๋“ญ๋‹ˆ๋‹ค.

3์›” 25, 2023ยท 1 min read
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 3/3: Results&Rest)
Tutorials

OpenAI์˜ GPT-3์— ๋Œ€ํ•œ ์‹ฌ์ธต ๋ฆฌ๋ทฐ : ์–ธ์–ด ๋ชจ๋ธ์€ ์†Œ์ˆ˜ ์ƒท ํ•™์Šต์ž์ž…๋‹ˆ๋‹ค (ํŒŒํŠธ 3/3: ๊ฒฐ๊ณผ ๋ฐ ๋‚˜๋จธ์ง€)

์ด 3๋ถ€์ž‘ GPT-3 ์‹ฌ์ธต ๋ถ„์„์˜ ์ตœ์ข… ํšŒ์ฐจ๋Š” ๊ฒฐ๊ณผ์— ๋„๋‹ฌํ•ฉ๋‹ˆ๋‹ค: 1,750์–ต ๊ฐœ์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ๋ฒค์น˜๋งˆํฌ ์Šค์œ„ํŠธ์— ํˆฌ์ž…ํ•˜๊ณ  ๋ฏธ์„ธ ์กฐ์ •์„ ์™„์ „ํžˆ ๊ฑด๋„ˆ๋›ธ ๋•Œ ์‹ค์ œ๋กœ ์–ด๋–ค ์ผ์ด ๋ฐœ์ƒํ•˜๋Š”์ง€์— ๋Œ€ํ•ด.

3์›” 8, 2023ยท 1 min read
[10 mins] Explain Why OpenAI's Whisper API Isn't As Good As ChatGPT
Tutorials

[10๋ถ„] OpenAI์˜ Whisper API๊ฐ€ ChatGPT๋งŒํผ ์ข‹์ง€ ์•Š์€ ์ด์œ  ์„ค๋ช…

Whisper๋Š” ํฐ ์„ฑ๊ณต์„ ๊ฑฐ๋‘์—ˆ์ง€๋งŒ, GPT-3์ด NLP๋ฅผ ์žฌํŽธํ–ˆ๋˜ ๋ฐฉ์‹์œผ๋กœ ASR์„ ์žฌํŽธํ•˜์ง€๋Š” ๋ชปํ–ˆ์Šต๋‹ˆ๋‹ค. ์ด 10๋ถ„์งœ๋ฆฌ ๋ฆฌ๋ทฐ๋Š” ๊ทธ ์ด์œ ๊ฐ€ ๋…ผ๋ฌธ ์ž์ฒด์— ๋‚ด์žฌ๋˜์–ด ์žˆ๋‹ค๊ณ  ์ฃผ์žฅํ•ฉ๋‹ˆ๋‹ค.

3์›” 4, 2023ยท 1 min read
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 2/3: Results)
Tutorials

OpenAI์˜ GPT-3์— ๋Œ€ํ•œ ์‹ฌ์ธต ๊ฒ€ํ† : ์–ธ์–ด ๋ชจ๋ธ์€ Few-Shot ํ•™์Šต์ž์ž…๋‹ˆ๋‹ค (ํŒŒํŠธ 2/3: ๊ฒฐ๊ณผ)

์ด GPT-3 ์‹ฌ์ธต ๋ถ„์„์˜ 2๋ถ€๋Š” ์„ค์ •์„ ๋„˜์–ด ์‹ค์ œ๋กœ ์‚ฌ๋žŒ๋“ค์ด NLP๋ฅผ ์žฌ์ƒ๊ฐํ•˜๊ฒŒ ํ•œ ๊ฒฐ๊ณผ๋กœ ์ด๋™ํ•ฉ๋‹ˆ๋‹ค.

2์›” 25, 2023ยท 1 min read
ChatGPT/ChatGPT Plus/InstructGPT:Training language models to follow instructions with human feedback
Tutorials

ChatGPT/ChatGPT Plus/InstructGPT: ์ธ๊ฐ„ ํ”ผ๋“œ๋ฐฑ์œผ๋กœ ์ง€์‹œ๋ฅผ ๋”ฐ๋ฅด๋„๋ก ์–ธ์–ด ๋ชจ๋ธ ํ›ˆ๋ จ

ChatGPT ์ œํ’ˆ ๋’ค์—๋Š” InstructGPT ๋…ผ๋ฌธ์ด ์žˆ์œผ๋ฉฐ, ์ด ์ƒ์„ธ ๋ฆฌ๋ทฐ๋Š” ์›์‹œ GPT-3์„ ์‚ฌ๋žŒ๋“ค์ด ์‹ค์ œ๋กœ ๋Œ€ํ™”ํ•˜๊ณ  ์‹ถ์–ด ํ•˜๋Š” ๊ฒƒ์œผ๋กœ ๋ณ€ํ™˜ํ•œ ํŒŒ์ดํ”„๋ผ์ธ์„ ์ž์„ธํžˆ ๋ถ„์„ํ•ฉ๋‹ˆ๋‹ค.

1์›” 28, 2023ยท 1 min read
Explain how ChatGPT/ChatGPT Plus works in 3 minutes
Tutorials

3๋ถ„ ์•ˆ์— ChatGPT/ChatGPT Plus๊ฐ€ ์–ด๋–ป๊ฒŒ ์ž‘๋™ํ•˜๋Š”์ง€ ์„ค๋ช…

ChatGPT๋Š” ์™ธ๋ถ€์—์„œ๋Š” ๋งˆ๋ฒ•์ฒ˜๋Ÿผ ๋ณด์ด์ง€๋งŒ, ์–ด๋””๋ฅผ ๋ด์•ผ ํ•˜๋Š”์ง€ ์•Œ๋ฉด ๋ ˆ์‹œํ”ผ๋Š” ์ž˜ ๋ฌธ์„œํ™”๋˜์–ด ์žˆ์œผ๋ฉฐ, ์ด 3๋ถ„ ์„ค๋ช…์€ ํ•ต์‹ฌ ์•„์ด๋””์–ด๋ฅผ ์š”์•ฝํ•ฉ๋‹ˆ๋‹ค.

1์›” 28, 2023ยท 1 min read
[Olewave's Review] OpenAI's Whisper ASR: Robust Speech Recognition via Large-Scale Weak Supervision
Tutorials

[Olewave์˜ ๋ฆฌ๋ทฐ] OpenAI์˜ Whisper ASR: ๋Œ€๊ทœ๋ชจ ์•ฝํ•œ ์ง€๋„๋ฅผ ํ†ตํ•œ ๊ฐ•๊ฑดํ•œ ์Œ์„ฑ ์ธ์‹

OpenAI๊ฐ€ Whisper๋ฅผ ์ถœ์‹œํ–ˆ์„ ๋•Œ, ASR ์ปค๋ฎค๋‹ˆํ‹ฐ๋Š” 68๋งŒ ์‹œ๊ฐ„์˜ ๋‹ค๊ตญ์–ด, ๋‹ค์ค‘ ์ž‘์—…, ์›น ํฌ๋กค๋ง ์˜ค๋””์˜ค๋กœ ํ›ˆ๋ จ๋˜์–ด ์‚ฌํˆฌ๋ฆฌ, ๋ฐฐ๊ฒฝ ์†Œ์Œ, ๊ธฐ์ˆ  ์šฉ์–ด ์ „๋ฐ˜์— ๊ฑธ์ณ

10์›” 31, 2022ยท 1 min read
Google fired Blake Lemoine for saying AI bot is sentient? Does LaMDA or ChatGPT think like human?
Tutorials

Google์ด AI ๋ด‡์ด ์„ผํ‹ฐ์–ธํŠธ๋ผ๊ณ  ๋งํ•œ Blake Lemoine์„ ํ•ด๊ณ ํ–ˆ๋‚˜? LaMDA๋‚˜ ChatGPT๊ฐ€ ์ธ๊ฐ„์ฒ˜๋Ÿผ ์ƒ๊ฐํ• ๊นŒ?

Google์ด LaMDA๊ฐ€ ์„ผํ‹ฐ์–ธํŠธ๊ฐ€ ๋˜์—ˆ๋‹ค๋Š” ์ฃผ์žฅ์„ ๊ณต๊ฐœํ•œ Blake Lemoine์„ ํ•ด๊ณ ํ–ˆ์„ ๋•Œ, ๊ทธ ์ด์•ผ๊ธฐ๋Š” ๋ฐ”์ด๋Ÿด์ด ๋˜์—ˆ์ง€๋งŒ, ๊ทผ๋ณธ์ ์ธ ์งˆ๋ฌธ์ด ๋‚จ์•˜์Šต๋‹ˆ๋‹ค: LaMDA์™€ ChatGPT์™€ ๊ฐ™์€ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ์ด ์‹ค์ œ๋กœ ์ƒ๊ฐ์„

8์›” 5, 2022ยท 1 min read