A Review of Deepmind's WaveNet for TTS/Audio Synthesis (Does it look like GPT to you?)
Before Tacotron, before VALL-E, before neural codecs turned audio into tokens, DeepMind's WaveNet was the paper that showed neural networks could generate raw …
Disclosing OpenAI GPT-4's vision+text model, data, and cost to train (speculated)
OpenAI famously refused to disclose GPT-4's architecture, parameter count, training data, or compute budget, which turned the tech report into a Rorschach test…
A Review of GPT-4's Technical Report (GPT-4 in a Nutshell)
GPT-4's technical report is famously thin on architecture details and thick on capability claims, which makes a clear-headed review essential reading for anyon…
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 3/3: Results&Rest)
The final installment of this three-part GPT-3 deep dive gets to the payoff: what actually happens when you throw 175 billion parameters at a benchmark suite a…
![[10 mins] Explain Why OpenAI's Whisper API Isn't As Good As ChatGPT](/media/video/2023/03/10-mins-explain-why-openais-whisper-api-isnt-as-good-as-chatgpt/preview.jpg)
[10 mins] Explain Why OpenAI's Whisper API Isn't As Good As ChatGPT
Whisper landed with a bang, but it did not reshape ASR the way GPT-3 reshaped NLP, and this ten-minute review argues the reasons are baked into the paper itsel…
In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 2/3: Results)
Part two of this GPT-3 deep dive moves past the setup and into the results that actually made people rethink NLP.
ChatGPT/ChatGPT Plus/InstructGPT:Training language models to follow instructions with human feedback
Behind the ChatGPT product sits the InstructGPT paper, and this detailed review pulls apart the pipeline that turned a raw GPT-3 into something people actually…
Explain how ChatGPT/ChatGPT Plus works in 3 minutes
ChatGPT looks like magic from the outside, but the recipe is well-documented if you know where to look, and this three-minute explainer condenses the core idea…
![[Olewave's Review] OpenAI's Whisper ASR: Robust Speech Recognition via Large-Scale Weak Supervision](/media/video/2022/10/olewaves-review-openais-whisper-asr-robust-speech-recognition-via-large-scale-weak/preview.jpg)
[Olewave's Review] OpenAI's Whisper ASR: Robust Speech Recognition via Large-Scale Weak Supervision
When OpenAI dropped Whisper, the ASR community had to reckon with a system trained on 680,000 hours of multilingual, multitask, web-scraped audio that just wor…
Google fired Blake Lemoine for saying AI bot is sentient? Does LaMDA or ChatGPT think like human?
When Google fired Blake Lemoine for going public with claims that LaMDA had become sentient, the story went viral, but the underlying question stuck around: do…