Olewave - Professional and Trustworthy - Data Services and Solutions

Tutorials

[Long Review] CLAS: Deep context: end-to-end contextual speech recognition

Anyone who has shipped an ASR product knows the pain of proper nouns: contact names, song titles, medication names, obscure place names.

Apr 9, 2022· 1 min read

Tutorials

[Long Review] Hurdles to Progress in Long Form Question Answering

Long-form question answering is one of those benchmarks that looks impressive on the leaderboard and disturbing under a microscope.

Apr 2, 2022· 1 min read

Tutorials

[Long Review] Finetuned Language Models Are Zero-Shot Learners

Before InstructGPT made instruction tuning a household phrase, Google's FLAN paper made the case that a modest amount of multi-task fine-tuning on natural-lang…

Mar 5, 2022· 1 min read

Tutorials

[Long Review] 'GShard': Scaling Giant Models with Conditional Computation and Automatic Sharding

Scaling a Transformer past a hundred billion parameters gets philosophical fast: do you activate the whole network for every token, or route each token to the …

Feb 26, 2022· 1 min read

Tag: googleresearch

[Long Review] CLAS: Deep context: end-to-end contextual speech recognition

[Long Review] Hurdles to Progress in Long Form Question Answering

[Long Review] Finetuned Language Models Are Zero-Shot Learners

[Long Review] 'GShard': Scaling Giant Models with Conditional Computation and Automatic Sharding