Skip Navigation
InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)OS
Posts
2
Comments
17
Joined
6 mo. ago
  • Writing code in languages I'm not familiar with yet. Reading code is much easier than learning all the syntax details, so I can still verify that it's correct. I've even written a poc in lang 1 and used LLM to rewrite it in lang 2.

  • The FB export files have everything (your posts, comments, reactions etc) as html files and images/videos.

    Getting it from those files into parts that can be uploaded somewhere else will take some work. Either with programming if OP has knowledge, or copy-paste.

  • Funny, I've mostly seen complaints that Mastodon is "empty".

    Some tips:

    • Use high-volume hashtags for discovery, not for following.
    • Discovery: niched hashtags (e.g. #photography - >#birdphoto)
    • Discovery: accounts that use the high-use hashtags. Follow or mute
    • mute/filter "spammers" and "spammy" hashtags
    • Ditch FOMO, grow your feed slowly.
    • Look at boosted accounts from accounts you follow. Maybe they're interesting for you.
  • Pixelfed has been around for a couple of years. I created an account in the summer of 2022. But it didn't become popular until there was an app. A web app that does the same isn't enough. If it isn't in App Store/Play it doesn't exist for most people (which is something all Fediverse devs must think about).

    Anyway, plenty of information about the development pace was available for anyone who wants to make an informed decision before they send their money somewhere. Apparently >2000 people thought it was worth it.

  • A decentralised Bluesky won't work. We have all heard the arguments that it's totally impossible to decide which Fediverse instance to join. Surely that problem will doom Bluesky's decentralisation efforts.

    /s

  • Ollama's Python API works well and there's a lot of examples. However, I've not gotten the Ollama REST API to work, the response doesn't unpack into json for me.

    Just design the rest of your system so that it doesn't have to know anything about the implementation (only prompts and responses) and you should be able to easily replace the LLM part later.

  • If Bluesky becomes federated with multiple instances, it will be just as impossible to enter as ActivityPub-based services apparently are since instance-selection is a blocker.

    RIght?

    ;)

  • of course, I haven't looked at models >9B for now. So I have to decide if I want to run larger models quickly or even larger models quickly-but-not-as-quick-as-on-a- Mac-Studio.

    Or I could just spend the money on API credits :D

  • LocalLLaMA @sh.itjust.works
    Oskar @piefed.social

    Mac Studio 2025

    Thinking about a new Mac, my MPB M1 2020 16 GB can only handle about 8B models and is slow.

    Since I looked it up I might as well shared the LLM-related specs:
    Memory bandwidth
    M4 Pro (Mac Mini): 273GB/s M4 Max (Mac Studio): 410 GB/s

    Cores cpu / gpu
    M4 pro 14 / 20
    M4 Max 16 / 40

    Cores & memory bandwidth is of course important, but with the Mini I could have 64 GB ram instead of 36 (within my budget that is fixed for tax reasons).

    Feels like the Mini with more memory would be better. What do you think?

    Free Open-Source Artificial Intelligence @lemmy.world
    Oskar @piefed.social

    Models specialized on only one programming language

    There are lots of general-purpose models to use locally, and also coding-specific models.

    But are there models specialized in one programming language? My thought was that a model that only needs to handle one language (e.g. Python) could be faster, or be better for a given size.

    E.g If I need to code in Rust and is limited to an 8B model to run locally, I was hoping to get better results with a model that is narrower. I don't need it to be able to help with Java.

    This approach would of course require switching models, but that's no problem for me.

  • I don't have any recommendations, but I'm sharing information about train travel through a Mastodon account in Swedish https://mastodonsweden.se/@interrailinfosvenska I wish you good luck creating a new community in the Fediverse! And I have posted a challenge for a similar thing in Sweden.