freamon

@freamon@lemmy.world

Mostly just used for moderation.

Main account is piefed.social/u/andrew_s

This profile is from a federated server and may be incomplete. View on remote instance

freamon ,

Most likely reason is that you unticked 'English' as a language you understand when you were playing around.

freamon ,

Yeah, I know what you mean. That note is misleading, and kinda redundant too - you can physically de-select Undetermined in the UI, but the change won't actually take if you press 'Save'.

freamon Mod ,

Sorry - that was the auto-mod. It removes heavily down-voted stuff, which normally is something that needs removing, but not always. I'll restore your comment.

freamon OP Mod ,

Everything out there (inc. Lemmy) wants to turn any GIF that's more than a few frames into a movie anyway, so we may as well take advantage.

freamon ,

Firstly, sorry for any potential derailment. This is a comment about the Markdown used in your post (I wouldn't normally mention it, but consider it fair game since this is a 'Fediverse' community).
The spec for lemmy's spoiler format is colon-colon-colon-space-spoiler. If you miss out the space, then whilst other Lemmy instances can reconstitute the Markdown to see this post as intended, Lemmy itself doesn't generate the correct HTML when sending it out over ActivityPub. This means that other Fediverse apps that just look at the HTML (e.g. Mastodon, KBIN) can't render it properly.
Screenshot from kbin:
https://i.postimg.cc/x1JsXDZ3/kbin-post.jpg

Also, if you add a horizontal rule without a blank line above it, Markdown generally interprets this as meaning that you want the text above it to be a heading. So anything that doesn't have the full force of Lemmy's Markdown processor that is currently trying to re-make the HTML from Markdown now has to deal with the ending triple colons having 'h2' tags around it.
Screenshot from piefed:
https://i.postimg.cc/X7JWDqZN/piefed-post.jpg

(apologies again for being off-topic)

freamon ,

Well, there's good news and bad news.

The good news is that Lemmy is now surrounding your spoilers with the expected Details and Summary tags, and moving the HR means PieFed is able to interpret the Markdown for both spoilers.

The bad news:
It turns out KBIN doesn't understand Details/Summary tags (even though a browser on it own does, so that's KBIN's problem).
Neither PieFed, or KBIN, or MS Edge looking at raw HTML can properly deal with a list that starts at '0'.
Lemmy is no longer putting List tags around anything inside the spoilers. (so this post now looks worse on KBIN. Sorry about that KBIN users)

Quick video demonstrating that lemmy.world sends every activity out twice ( i.imgur.com )

I realise this is a known issue and that lemmy.world isn't the only instance that does this. Also, I'm aware that there are other things affecting federation. But I'm seeing some things not federate, and can't help thinking that things would be going smoother if all the output from the biggest lemmy instance wasn't 50% spam....

freamon OP ,

I can't re-produce anything, because I don't run Lemmy on my server. It's possible to infer that's it's related to the software (because LW didn't do this when it was on 0.18.5). However, it's not something that, for example, lemmy.ml does. An admin on LW matrix chat suggested that it's likely a combination of instance configuration and software changes, but a bug report from me (who has no idea how LW is set up) wouldn't be much use.

I'd gently suggest that, if LW admins think it's a configuration problem, they should talk to other Lemmy admins, and if they think Lemmy itself plays a role, they should talk to the devs. I could be wrong, but this has been happening for a while now, and I don't get the sense that anyone is talking to anyone about it.

freamon OP ,

They'll all POST requests. I trimmed it out of the log for space, but the first 6 requests on the video looked like (nginx shows the data amount for GET, but not POST):

ip.address - - [07/Apr/2024:23:18:44 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.world"
ip.address- - [07/Apr/2024:23:18:44 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.world"
ip.address - - [07/Apr/2024:23:19:14 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.world"
ip.address - - [07/Apr/2024:23:19:14 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.world"
ip.address - - [07/Apr/2024:23:19:44 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.world"
ip.address - - [07/Apr/2024:23:19:44 +0000] "POST /inbox HTTP/1.1" 200 0 "-" "Lemmy/0.19.3; +https://lemmy.world"

If I was running Lemmy, every second line would say 400, from it rejecting it as a duplicate. In terms of bandwidth, every line represents a full JSON, so I guess it's about 2K minimum for the standard cruft, plus however much for the actual contents of comment (the comment replying to this would've been 8K)

My server just took the requests and dumped the bodies out to a file, and then a script was outputting the object.id, object.type and object.actor into /tmp/demo.txt (which is another confirmation that they were POST requests, of course)

freamon OP , (edited )

We were typing at the same time, it seems. I've included more info in a comment above, showing that they were POST requests.

Also, the green terminal is outputting part of the body of for each request, to demonstrate. If they weren't POST requests to /inbox, my server wouldn't have even picked up them.

EDIT: by 'server' I mean the back-end one, the one nginx is reverse-proxying to.

freamon OP ,

A bug report for software I don't run, and so can't reproduce would be closed anyway. I think 'steps to reproduce' is pretty much the first line in a bug report.

If I ran a server that used someone else's software to allow users to download a file, and someone told me that every 2nd byte needed to be discarded, I like to think I'd investigate and contact the software vendors if required. I wouldn't tell the user that it's something they should be doing. I feel like I'm the user in this scenario.

freamon OP ,

When I've mentioned this issue to admins at lemmy.ca and endlesstalk.org (relevant posts here and here), they've suggested it's a misconfiguration. When I said the same to lemmy.world admins (relevant comment here), they also suggested it was misconfig. I mentioned it again recently on the LW channel, and it was only then was Lemmy itself proposed as a problem. It happens on plenty of servers, but not all of them, so I don't know where the fault lies.

freamon OP ,

Yeah, that's the conclusion I came away with from the lemmy.ca and endlesstalk.org chats. That's it due to multiple docker containers. In the LW Matrix room though, an admin said he saw one container send the same activity out 3 times. Also, LW were presumably running multiple containers with 0.18.5, when it didn't happen, so it maybe that multiple containers is only part of the problem.

freamon OP ,

I'm only running one process, I'd assume the problem isn't happening for Feddit.dk.

Perhaps. The lemmy.ca post has a comment in from the mander.xyz admin who's only running one, and there's a new comment in this thread saying mander.xyx is one of the instances they see the most duplicates from.

freamon OP ,

okay

freamon OP ,

I've since relented, and filed a bug

freamon OP ,

I've been coerced into reporting it as bug in Lemmy itself - perhaps you could add your own observations here so I seem like less of a crank. Thanks.

freamon OP ,

Update: for LW, this behaviour stopped around about Friday 12th April. Not sure what changed, but at least the biggest instance isn't doing it anymore.

Lemmyverse historical data? ( data.lemmyverse.net )

I am interested in checking out the historical growth of a particular community. Lemmy Explorer crawls for data about the Lemmyverse every 24 hours or something, and that data is made available on their website. But I can only find where to download the latest data. Is there somewhere that I can find historical data? Does Lemmy...

freamon ,

(same person on different account, just so I can preview what the table will look like)

Hmmm. This might not help you much. That community was launched on 2024-01-22, with a page full of posts, so by the time the crawler picked up on it, it was already at 501 subs, 23 posts.
It lost 15 posts on 2024-02-12 (Stamets?).
There's data missing from 2024-02-26 - 2024-03-01 (this data is from the bot at !trendingcommunities; I think those days are missing because I changed it from measuring Active Users Month (AUM) to Active Users Week (AUW)).
In terms of active users, the jump on 2024-03-04 is due to lemmy.world 'upgrading' to 0.19.3.

date subs aum posts
2024-01-23 501 71 23
2024-01-24 601 103 27
2024-01-25 643 125 32
2024-01-26 663 130 33
2024-01-27 668 130 33
2024-01-28 668 130 33
2024-01-29 670 130 33
2024-01-30 670 130 33
2024-01-31 670 130 33
2024-02-01 670 130 33
2024-02-02 670 130 33
2024-02-03 672 130 33
2024-02-04 672 130 33
2024-02-05 672 130 33
2024-02-06 672 130 33
2024-02-07 673 140 34
2024-02-08 678 144 35
2024-02-09 681 150 36
2024-02-10 681 150 36
2024-02-11 698 155 38
2024-02-12 703 156 23
2024-02-13 703 156 23
2024-02-14 711 160 24
2024-02-15 711 160 24
2024-02-16 711 160 24
2024-02-17 713 160 24
2024-02-18 713 160 24
2024-02-19 714 160 24
2024-02-20 715 160 24
2024-02-21 715 160 24
2024-02-22 715 160 24
2024-02-23 715 119 24
2024-02-24 715 77 24
2024-02-25 716 48 24

[data missing]

date subs auw posts
2024-03-02 718 2 25
2024-03-03 722 2 25
2024-03-04 726 129 26
2024-03-05 732 200 27
2024-03-06 748 397 29
2024-03-07 754 437 30
2024-03-08 755 453 31
2024-03-09 756 455 31
2024-03-10 770 576 33
2024-03-11 779 631 34
2024-03-12 782 651 35
2024-03-13 785 583 36
2024-03-14 787 473 36
2024-03-15 797 476 37
2024-03-16 802 493 39
2024-03-17 807 542 40
2024-03-18 812 650 41
2024-03-19 815 431 42
2024-03-20 817 400 43
2024-03-21 819 421 44
2024-03-22 819 437 44
2024-03-23 822 484 46
2024-03-24 829 533 47
2024-03-25 831 384 48
2024-03-26 833 395 49
2024-03-27 837 431 50
2024-03-28 840 462 51
2024-03-29 849 416 52
2024-03-30 851 390 53
2024-03-31 854 414 53
2024-04-01 861 466 56
2024-04-02 865 560 57
2024-04-03 868 473 58
freamon ,

Yeah. It seems like the kind of community he'd post in. I think there was some drama between him and startrek.website, resulting in him or the admins deleting the account.

freamon , (edited )

Oh, right. The chat on GitHub is over my head, but I would have thought that solving the problem of instances sending every activity 2 or 3 times would help with that, since even rejecting something as a duplicate must eat up some time.

freamon Mod , (edited )

Hey OP. Sorry to clutter up your post. I need to show LW admins something. I'll delete 'em later.

4 announcements for the same post. No following 'Delete' activity. 1 is legit. Other 3 refer to non-existent posts on feddit.de. 2 are slightly bigger than the other two because they have a 'image' tag in as well.

freamon Mod ,

Announcement 1 (wrong post id)

{
  "@context": [
    "https://join-lemmy.org/context.json",
    "https://www.w3.org/ns/activitystreams"
  ],
  "actor": "https://lemmy.world/c/starwarsmemes",
  "to": [
    "https://www.w3.org/ns/activitystreams#Public"
  ],
  "object": {
    "id": "https://feddit.de/activities/create/59af650f-98f6-49b7-ae42-ec608cd35c97",
    "actor": "https://feddit.de/u/Oiconomia",
    "@context": [
      "https://join-lemmy.org/context.json",
      "https://www.w3.org/ns/activitystreams"
    ],
    "to": [
      "https://www.w3.org/ns/activitystreams#Public"
    ],
    "object": {
      "type": "Page",
      "id": "https://feddit.de/post/10594542",
      "attributedTo": "https://feddit.de/u/Oiconomia",
      "to": [
        "https://lemmy.world/c/starwarsmemes",
        "https://www.w3.org/ns/activitystreams#Public"
      ],
      "name": "Happy Easter everyone",
      "cc": [],
      "mediaType": "text/html",
      "attachment": [
        {
          "href": "https://feddit.de/pictrs/image/0e83ff3b-55d6-4c96-b55c-a4c41b5716a1.jpeg",
          "type": "Link"
        }
      ],
      "image": {
        "type": "Image",
        "url": "https://feddit.de/pictrs/image/e9155764-4ed7-406e-9711-955b015d3c8d.jpeg"
      },
      "commentsEnabled": true,
      "sensitive": false,
      "published": "2024-03-31T18:11:59.718207Z",
      "language": {
        "identifier": "en",
        "name": "English"
      },
      "audience": "https://lemmy.world/c/starwarsmemes"
    },
    "cc": [
      "https://lemmy.world/c/starwarsmemes"
    ],
    "type": "Create",
    "audience": "https://lemmy.world/c/starwarsmemes"
  },
  "cc": [
    "https://lemmy.world/c/starwarsmemes/followers"
  ],
  "type": "Announce",
  "id": "https://lemmy.world/activities/announce/create/d74aadba-2a2a-4561-9e6c-ce31dad3522f"
}
freamon Mod ,

Announcement 3 (wrong post id (doesn't exist)

{
  "@context": [
    "https://join-lemmy.org/context.json",
    "https://www.w3.org/ns/activitystreams"
  ],
  "actor": "https://lemmy.world/c/starwarsmemes",
  "to": [
    "https://www.w3.org/ns/activitystreams#Public"
  ],
  "object": {
    "id": "https://feddit.de/activities/create/6d5789e6-36f7-41b5-bc5e-f79423920127",
    "actor": "https://feddit.de/u/Oiconomia",
    "@context": [
      "https://join-lemmy.org/context.json",
      "https://www.w3.org/ns/activitystreams"
    ],
    "to": [
      "https://www.w3.org/ns/activitystreams#Public"
    ],
    "object": {
      "type": "Page",
      "id": "https://feddit.de/post/10594545",
      "attributedTo": "https://feddit.de/u/Oiconomia",
      "to": [
        "https://lemmy.world/c/starwarsmemes",
        "https://www.w3.org/ns/activitystreams#Public"
      ],
      "name": "Happy Easter everyone",
      "cc": [],
      "mediaType": "text/html",
      "attachment": [
        {
          "href": "https://feddit.de/pictrs/image/0e83ff3b-55d6-4c96-b55c-a4c41b5716a1.jpeg",
          "type": "Link"
        }
      ],
      "commentsEnabled": true,
      "sensitive": false,
      "published": "2024-03-31T18:14:56.128762Z",
      "language": {
        "identifier": "en",
        "name": "English"
      },
      "audience": "https://lemmy.world/c/starwarsmemes"
    },
    "cc": [
      "https://lemmy.world/c/starwarsmemes"
    ],
    "type": "Create",
    "audience": "https://lemmy.world/c/starwarsmemes"
  },
  "cc": [
    "https://lemmy.world/c/starwarsmemes/followers"
  ],
  "type": "Announce",
  "id": "https://lemmy.world/activities/announce/create/ac5c8189-ba24-4119-a96a-7e302a37c886"
}
freamon Mod ,

Announcement 2 (wrong post id)

{
  "@context": [
    "https://join-lemmy.org/context.json",
    "https://www.w3.org/ns/activitystreams"
  ],
  "actor": "https://lemmy.world/c/starwarsmemes",
  "to": [
    "https://www.w3.org/ns/activitystreams#Public"
  ],
  "object": {
    "id": "https://feddit.de/activities/create/8fae74c5-b8a5-437f-95fb-c79249901b30",
    "actor": "https://feddit.de/u/Oiconomia",
    "@context": [
      "https://join-lemmy.org/context.json",
      "https://www.w3.org/ns/activitystreams"
    ],
    "to": [
      "https://www.w3.org/ns/activitystreams#Public"
    ],
    "object": {
      "type": "Page",
      "id": "https://feddit.de/post/10594543",
      "attributedTo": "https://feddit.de/u/Oiconomia",
      "to": [
        "https://lemmy.world/c/starwarsmemes",
        "https://www.w3.org/ns/activitystreams#Public"
      ],
      "name": "Happy Easter everyone",
      "cc": [],
      "mediaType": "text/html",
      "attachment": [
        {
          "href": "https://feddit.de/pictrs/image/0e83ff3b-55d6-4c96-b55c-a4c41b5716a1.jpeg",
          "type": "Link"
        }
      ],
      "image": {
        "type": "Image",
        "url": "https://feddit.de/pictrs/image/668bb619-6b0f-486b-8c80-f1db42741be7.jpeg"
      },
      "commentsEnabled": true,
      "sensitive": false,
      "published": "2024-03-31T18:14:06.929611Z",
      "language": {
        "identifier": "en",
        "name": "English"
      },
      "audience": "https://lemmy.world/c/starwarsmemes"
    },
    "cc": [
      "https://lemmy.world/c/starwarsmemes"
    ],
    "type": "Create",
    "audience": "https://lemmy.world/c/starwarsmemes"
  },
  "cc": [
    "https://lemmy.world/c/starwarsmemes/followers"
  ],
  "type": "Announce",
  "id": "https://lemmy.world/activities/announce/create/77123fc8-5de7-455c-a3ce-a2e9885242f2"
}
freamon Mod , (edited )

Announcement 4 (correct post id)

{
  "@context": [
    "https://join-lemmy.org/context.json",
    "https://www.w3.org/ns/activitystreams"
  ],
  "actor": "https://lemmy.world/c/starwarsmemes",
  "to": [
    "https://www.w3.org/ns/activitystreams#Public"
  ],
  "object": {
    "id": "https://feddit.de/activities/create/42916e31-4ca0-4356-b8f4-60a2fa9815e4",
    "actor": "https://feddit.de/u/Oiconomia",
    "@context": [
      "https://join-lemmy.org/context.json",
      "https://www.w3.org/ns/activitystreams"
    ],
    "to": [
      "https://www.w3.org/ns/activitystreams#Public"
    ],
    "object": {
      "type": "Page",
      "id": "https://feddit.de/post/10594594",
      "attributedTo": "https://feddit.de/u/Oiconomia",
      "to": [
        "https://lemmy.world/c/starwarsmemes",
        "https://www.w3.org/ns/activitystreams#Public"
      ],
      "name": "Happy Easter everyone",
      "cc": [],
      "mediaType": "text/html",
      "attachment": [
        {
          "href": "https://feddit.de/pictrs/image/0e83ff3b-55d6-4c96-b55c-a4c41b5716a1.jpeg",
          "type": "Link"
        }
      ],
      "commentsEnabled": true,
      "sensitive": false,
      "published": "2024-03-31T18:15:46.986773Z",
      "language": {
        "identifier": "en",
        "name": "English"
      },
      "audience": "https://lemmy.world/c/starwarsmemes"
    },
    "cc": [
      "https://lemmy.world/c/starwarsmemes"
    ],
    "type": "Create",
    "audience": "https://lemmy.world/c/starwarsmemes"
  },
  "cc": [
    "https://lemmy.world/c/starwarsmemes/followers"
  ],
  "type": "Announce",
  "id": "https://lemmy.world/activities/announce/create/456d80e9-7a1c-450c-a21a-7ee691320e54"
}
freamon ,

They come from lemmyverse.net (specifically the JSON file that's provided every 6 hours at data.lemmyverse.net)

If you want to track growth yourself, you'd need to do what the bot does, and download that file every time.

As for your community, are you talking about 'Nowhere else to share'? ('cos that's appeared loads - last Thursday and Friday, for example)

freamon ,

It's alright. It didn't sound like that. I don't mind investigating if the bot is misbehaving (and I occasionally get the satisfaction of finding out that it's not)

freamon ,

Lemmy let's you un-delete anything you've deleted, so nothing really gets nuked (it seems to be the way these things work anyway, that it's just a 'deleted' flag that's flipped between true and false).

On the one hand, it's a Lemmy problem - I can see you're comment using the API:

curl --request GET \
     --url 'https://lemmy.world/api/v3/comment?id=8986376' \
     --header 'accept: application/json'

=>
{
  "comment_view": {
    "comment": {
      "id": 8986376,
      "creator_id": 399371,
      "post_id": 13748490,
      "content": "See what i mean? I deleted this!",
      "removed": false,
      "published": "2024-03-31T09:48:22.897008Z",
      "deleted": true,
      "ap_id": "https://lemmy.world/comment/8986376",
      "local": true,
      "path": "0.8986376",
      "distinguished": false,
      "language_id": 37
     ...

But there's also a bug with Sync in that it's not checking the flag if someone try to reply.

freamon , (edited )

Removed by Mod vs. Deleted by User (sorry, this reply is in the wrong place)

freamon ,

If it's something you feel strongly about, then for this reason, and the usual federation reasons, it's probably better to overwrite your content with "[deleted]" or something, rather than delete it.

freamon ,

Removed by Mod vs. Deleted by User

(you may have already seen this - my original reply went to the wrong place. Which is another Sync bug incidentally, when using the notification to reply (Android))

freamon ,

"active users" are defined by lemmy: posts + comments + votes

The bot is trying to catch upwards trend in the amount of active users. This tends to be communities that were dead or fairly dead, and then one or two posts got some engagement and spiked the number up.

In terms of absolute active numbers, there's no need for a bot because lemmy can tell you that. The bigger communities tend to swing up and down in terms of activity (cancelling themselves out).

For example, tenforward@lemmy.world had 65 posts this week, but active users ended up pretty much where it was. The table below has 28 entries as the crawler at lemmyverse usually reports 4 times a day, so it's for about 7 days:

posts subscribers active users
903 2466 3233
902 2461 3259
902 2461 3259
895 2453 3194
894 2447 3455
894 2447 3455
888 2443 3392
888 2443 3392
883 2440 3447
883 2440 3447
879 2437 3493
879 2437 3493
875 2434 3467
872 2424 3631
872 2424 3631
868 2426 3588
868 2426 3588
863 2413 3457
863 2413 3457
856 2407 3446
856 2407 3446
854 2402 3247
854 2402 3247
847 2391 3188
847 2391 3188
844 2386 3081
844 2386 3081
838 2384 3235
freamon ,

Might be some rogue results for lemmy.world for a few days: for some communities there's been a bit of lag (from using the old measurement for active growth to the new one, and/or for the crawler at lemmyverse to pick up on the change)

freamon Mod ,

(test comment - edit)

freamon ,

No, it's still running. I just got out of the habit of adding posts. I didn't realise it'd been 2 weeks. I'll start it up again in a bit.

freamon OP Mod ,

automod test: anakin?

freamon Mod ,

somehow palpatine returned?

freamon Mod ,

anakin?

freamon Mod ,

anakin?

freamon Mod ,

anakin?

freamon Mod ,

auto-mod testing. anakin?

freamon Mod ,

auto-mod testing. anakin?

freamon Mod ,

auto-mod testing. anakin?

freamon Mod ,

somehow palpatine returned?

freamon Mod ,

auto-mod test. anakin?

  • All
  • Subscribed
  • Moderated
  • Favorites
  • •
  • supersentai
  • WatchParties
  • Rutgers
  • jeremy
  • Lexington
  • cragsand
  • mead
  • RetroGamingNetwork
  • loren
  • steinbach
  • xyz
  • PowerRangers
  • AnarchoCapitalism
  • kamenrider
  • Mordhau
  • WarhammerFantasy
  • itdept
  • AgeRegression
  • mauerstrassenwetten
  • MidnightClan
  • space_engine
  • learnviet
  • bjj
  • Teensy
  • khanate
  • electropalaeography
  • neondivide
  • fandic
  • All magazines
    •