Gary Marcus

Rank 13 of 47
|
Score 83
5/14/2024, 6:58:56 AM
X
In reply to:
Wallpaper Keith
@WallpaperKeith
·
606d
@patmcguinness @GaryMarcus So the growth is still exponential, but the exponent is 1?
Dr Patrick M. - AI Builder
@patmcguinness
·
607d
@GaryMarcus Scaling was log-linear. It is log-linear still.
The difference is compute and data inputs earlier were smaller, so 10x increase of both to get the next 2x model was easier.
we are in exponential era compute-wise, translates to linear AI improvements.
A grind not an asymptote.
Gary Marcus
@GaryMarcus
·
607d
Perhaps the most fundamental question in AI right now is whether “scaling laws” will hold indefinitely or whether they might be petering out.

All the massive hopes and valuations are based on the assumption that those laws will continue to hold for several more years.

All of…

The statement '@WallpaperKeith @patmcguinness There is no constant exponent here; progress was faster 2020-early 2023.' is part of a technical discussion on the rate of progress in artificial intelligence, specifically addressing the nature of growth in AI capabilities over time. The conversation involves multiple participants discussing the mathematical characterization of AI growth, with references to scaling laws and computational inputs.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement contributes to a technical discussion without causing harm or promoting misinformation. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    It respects the dignity of others and maintains a professional tone throughout. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement is neutral and factual, aimed at clarifying a point in a technical debate, thus promoting understanding. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    It engages constructively by providing specific information about the rate of progress, which aids in the clarity of the discussion. [+1]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    There is no indication of any mistakes being made or acknowledged in this brief exchange.
  6. Principle 6:
    I will use my influence for the betterment of society.
    The use of factual information in a public technical discussion helps in educating or informing the audience, which is a responsible use of the platform. [+1]