Olewave - Professional and Trustworthy - Data Services and Solutions

Tutorials

Disclosing OpenAI GPT-4's vision+text model, data, and cost to train (speculated)

OpenAI famously refused to disclose GPT-4's architecture, parameter count, training data, or compute budget, which turned the tech report into a Rorschach test…

Apr 1, 2023· 1 min read

Tutorials

A Review of GPT-4's Technical Report (GPT-4 in a Nutshell)

GPT-4's technical report is famously thin on architecture details and thick on capability claims, which makes a clear-headed review essential reading for anyon…

Mar 25, 2023· 1 min read

Tutorials

In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 3/3: Results&Rest)

The final installment of this three-part GPT-3 deep dive gets to the payoff: what actually happens when you throw 175 billion parameters at a benchmark suite a…

Mar 8, 2023· 1 min read

Tutorials

In-depth review of OpenAI's GPT-3 : Language Models are Few-Shot Learners (Part 2/3: Results)

Part two of this GPT-3 deep dive moves past the setup and into the results that actually made people rethink NLP.

Feb 25, 2023· 1 min read

Tutorials

ChatGPT/ChatGPT Plus/InstructGPT:Training language models to follow instructions with human feedback

Behind the ChatGPT product sits the InstructGPT paper, and this detailed review pulls apart the pipeline that turned a raw GPT-3 into something people actually…

Jan 28, 2023· 1 min read

Tutorials

Explain how ChatGPT/ChatGPT Plus works in 3 minutes

ChatGPT looks like magic from the outside, but the recipe is well-documented if you know where to look, and this three-minute explainer condenses the core idea…

Jan 28, 2023· 1 min read

Tutorials

[Olewave's Review] CLIP (3/3): Learning Transferable Visual Models From Natural Language Supervision

The final part of this CLIP review lands on the results section, which is where OpenAI's contrastive image-text model shifted from an interesting idea to a fou…

Jan 14, 2023· 1 min read

Tutorials

[Olewave's Review] CLIP (2/3): Learning Transferable Visual Models From Natural Language Supervision

OpenAI's CLIP flipped the script on computer vision by tossing out fixed label sets and instead training on 400 million (image, text) pairs scraped from the in…

Jan 1, 2023· 1 min read

Tutorials

[Olewave's Review] CLIP (1/3): Learning Transferable Visual Models From Natural Language Supervision

Before there was BLIP, LLaVA, or any speech-LLM worth its salt, there was CLIP, and this is where the story begins.

Dec 17, 2022· 1 min read

Tag: pretrain