Skip Navigation
InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)GL
Posts
9
Comments
384
Joined
2 yr. ago
  • Just done it myself with deepseek. Fed in a list of the executive orders and got it to model scenarios and knock on effects.

    That’s worse case, if he manages to deport a significant % of immigrants, retains all funding freezes, doesn’t have anything knocked back in court.

    Just realised any tariffs that go into effect are not included in that estimate either.

  • From someone in the field

    It lowered training costs by quite a bit. To learn from preference data (whats termed as alignment with human values), we used a very large reward model as a proxy for human feedback. 

    They completely got rid of this, hence also the need to have very large clusters

    This has serious implications for spending though. Big companies who would have to train foundation models coz they couldnt directly use meta's llama, can now just use deepseek.

    and directly move to the human/customer alignment phase, which was already  significantly cheaper than pretraining (first phase of foundation model training). With their new algorithm, even the later stage does not need huge compute

    so they def got rid of a big chunk of compute by not relying on what is called a “reward” model

    GRPO: group relative policy optimization

    huggingface is trying to replicate their results

    https://github.com/huggingface/open-r1

  • United Kingdom @feddit.uk
    Glasgow @lemmy.ml

    Camping with the far-right: What I learned from a year undercover

    World News @lemmy.world
    Glasgow @lemmy.ml
    politics @lemmy.world
    Glasgow @lemmy.ml
    Palestine @lemmy.ml
    Glasgow @lemmy.ml
    Fediverse @lemmy.world
    Glasgow @lemmy.ml
    United Kingdom @feddit.uk
    Glasgow @lemmy.ml

    Liz Truss: Oppressed by Tweets, Victimized by Reality

    United Kingdom @feddit.uk
    Glasgow @lemmy.ml
    United Kingdom @feddit.uk
    Glasgow @lemmy.ml

    Ukraine war latest: British-supplied tanks used in Ukraine's Russian incursion, BBC told

    CryptoTCG @lemmy.ml
    Glasgow @lemmy.ml