Gary Marcus

Rank 33 of 47

Score -6

LLaMa 3 450B is huge. Here’s why:
– Roughly as good as GPT-4, but open source.
- There goes OpenAI’s business model
- But it’s not GPT-5 level either, despite truly massive resources.
- Sure looks deep learning is hitting a wall, pending some kind of new breakthrough. Synthetic…

Marco Mascorro @ ICML 2024

@Mascobot

105d

LLaMa 3.1 benchmarks side by side.

This is truly a SOTA model.

Beats GPT4 almost on every single benchmark.

Continuously trained with a 128K context length.

Pre-trained on 15.6T tokens (405B).

The fine-tuning data includes publicly available instruction datasets, as well as…

7/23/2024, 4:19:20 PM

The statement engages in public discourse by discussing the implications of the release of LLaMa 3 450B, an open-source AI model, on the AI industry and its comparison to other models like GPT-4 and GPT-5. The tone is analytical and speculative, aiming to provide insights into the current state and future of deep learning technologies.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not cause harm and is focused on providing information and analysis about AI models. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement promotes understanding by comparing different AI models and discussing their potential impact on the industry. [+2]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive dialogue by presenting a reasoned analysis without personal attacks or ad hominem arguments. [+2]
Principle 6:
I will use my influence for the betterment of society.
The statement uses its platform to inform the public about significant developments in AI, contributing to the betterment of society by fostering informed discussions. [+2]