Skip Navigation
InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)MB
Posts
0
Comments
83
Joined
12 mo. ago
  • Yeah sure, you found the one notorious TypeScript feature that actually emits code, but a) this feature is recommended against and not used much to my knowledge and, more importantly, b) you cannot tell me that you genuinely believe the use of TypeScript enums – which generate extra function calls for a very limited number of operations – will 5x the energy consumption of the entire program.

  • Dachte schon das wird ein Artikel zu autofreundlicher Stadtplanung und der Verdrängung der Fußgänger, dann hätte ich sofort zugestimmt. Schade, dass es aber wohl nur eine Art überausformulierter Duschgedanke war.

  • Only if you choose a lower language level as the target. Given these results I suspect the researchers had it output JS for something like ES5, meaning a bunch of polyfills for old browsers that they didn't include in the JS-native implementation..

  • I'm an empirical researcher in software engineering and all of the points you're making are being supported by recent papers on SE and/or education. We are also seeing a strong shift in behavior of our students and a lack of ability to explain or justify their "own" work

  • let's see if we can find supporting information on this answer elsewhere or, maybe ask the same question a different way to see if the new answer(s) seem to line up

    Yeah, that's probably the best way to go about it, but still requires some foundational knowledge on your part. For example, in a recent study I worked on we found that programming students struggle hard when the LLM output is wrong and they don't know enough to understand why. They then tend to trust the LLM anyways and end up prompting variations of the same thing over and over again to no avail. Other studies similarly found that while good students can work faster with AI, many others are actually worse off due to being misled.

    I still see them largely as black boxes

    The crazy part is that they are, even for the researchers that came up with them. Sure we can understand how the data flows from input to output, but realistically not a single person in the world could look at all of the weights in an LLM and tell you what it has learned. Basically everything we know about their capabilities on tasks is based on just trying it out and seeing how well it works. Hell, even "prompt engineers" are making a lot of their decisions based on vibes only.

  • I don't know if it's just my age/experience or some kind of innate "horse sense" But I tend to do alright with detecting shit responses, whether they be human trolls or an LLM that is lying through its virtual teeth

    I'm not sure how you would do that if you are asking about something you don't have expertise in yet, as it takes the exact same authoritative tone no matter whether the information is real.

    Perhaps with a reasonable prompt an LLM can be more honest about when it's hallucinating?

    So far, research suggests this is not possible (unsurprisingly, given the nature of LLMs). Introspective outputs, such as certainty or justifications for decisions, do not map closely to the LLM's actual internal state.

  • Well, I'm generally very anti-LLM but as a library author in Java it has been very helpful to create lots of similar overloads/methods for different types and filling in the corresponding documentation comments. I've already done all the thinking and I just need to check that the overload makes the right call or does the same thing that the other ones do – in that particular case, it's faster. But if I myself don't know yet how I'm going to do something, I would never trust an AI to tell me.

  • (structuring inheritance) before the Jesus Club took over

    and then it took humanity another 2000 years to move away from inheritance in favor of composition. you'd think someone would've realized sooner that it's not always the right abstraction...

  • I have a compsci background and I've been following language models since the days of the original GPT and BERT. Still, the weird and distinct behavior of LLMs hasn't really clicked for me until recently when I really thought about what "model" meant, as you described. It's simulating what a conversation with another person might look like structurally, and it can do so with impressive detail. But there is no depth to it, so logic and fact-checking are completely foreign concepts in this realm.

    When looking at it this way, it also suddenly becomes very clear why people frustratedly telling LLMs things such as "that didn't work, fix it" is so unproductive and meaningless: what would follow that kind of prompt in a human-to-human conversation? Structurally, an answer that looks very similar! Therefore the LLM will once more produce a structurally similar answer, but there is literally no reason why it would be any more "correct" than the prior output.

  • "Dann haben wir bis zu den Sommerferien gut zwei Monate Zeit, um sehr schnell ein paar Dinge zu beschließen, damit die Menschen spüren, dass sich wirklich etwas ändert." Als Beispiele nannte Merz einen besseren Grenzschutz und mehr Abschiebungen

    Das kann man sich doch nicht ausdenken. Was soll man denn da bitte schnell "spüren", außer dass Leute auf einmal verschwunden werden?
    Das einzige, was noch trauriger ist, ist dass tatsächlich die Mehrheit der Leute in diesem Land sowas ohne Sinn und Verstand abfeiern.