Cleanup of duplicate or broken feeds

[Marzal]

I think these are too many for PI.social

• https://podcastindex.org/search?q=Derecho%20y%20Animales&type=title

  • Good 950072 / Dup 2226607

• https://podcastindex.org/search?q=oposicionespolicianacional&type=all

  • Good 4832071 / Dups: 6634149 6625572 6601173 6601174 6666228 -> feeds of some categories of their WP blog.
  • https://podcasts.apple.com/es/podcast/oposiciones-polic%C3%ADa-nacional/id1594580827

• Peertube broken feeds from shutdown instances:

  • 5624751 and 6524176

• https://podcastindex.org/search?q=Linux%20Express&type=all

  • Good 326983 / Dup 5947897

• https://podcastindex.org/search?q=Eduardo%20Collado&type=all

  • Good 850213 / Dups: WP blog 4726201 2787932 ivoox 1566438 WP Category 6259909
  • https://podcasts.apple.com/es/podcast/podcast-de-redes-de-eduardo-collado/id1584333404

[stevencrader]

Thanks. I resolved all the issues.

[Marzal]

Thanks! Should I close this issue or do you prefer that I use it for the next reports?

As:

• https://podcastindex.org/search?q=madresfera&type=all
• Good https://podcastindex.org/podcast/570780 / Dups: 4574880 2037922

[stevencrader]

I removed those duplicates also. I'm fine if you keep this open.

[Marzal]

Ok, so here is the next batch

• https://podcastindex.org/search?q=voro%20mv&type=all

  • Good: 1763159 / Dups: 5624353

• https://podcastindex.org/search?q=nadie%20como%20mam%C3%A1&type=all

  • Good: 175256 / Dups: 1858444

• https://podcastindex.org/search?q=el%20salto%20radio&type=all

  • Good: 5912584 / Dups: 2114873

  • Good: 5508869 / Dups: 4730050

• https://podcastindex.org/search?q=educando%20en%20conexi%C3%B3n&type=all

  • Good: 708808 / Dups: 1399215

• https://podcastindex.org/search?q=educando%20geek&type=all

  • Good: 1106878 / Dups: 1624651 1141629

• https://podcastindex.org/search?q=salmorejo%20geek&type=all

  • Good: 808216 / Dups: 5928865 1584483 2454273

• https://podcastindex.org/search?q=zumo%20de%20ara%C3%B1a&type=all

  • Good: 255852 / Dups: 2050293

[stevencrader]

I removed the dupes as requested.

I do have a question for @daveajones about how ivoxx feeds are handled. Do you have a "best practices" for these feeds? Ivoxx seems to provide different URLS in different places. They also seem to ignore part of the URL. For example, the following feeds all return 200 and the same content.

• From 5912584: https://www.ivoox.com/podcasts_fg_f1922056_filtro_1.xml
• From 2114873: https://www.ivoox.com/podcasts-el-salto_fg_f1922056_filtro_1.xml
• From the "RSS" link on https://www.ivoox.com/podcast-salto-radio_sq_f1922056_1.html: https://www.ivoox.com/feed_fg_f1922056_filtro_1.xml
• From the "subscribe" page https://www.ivoox.com/en/s_p2_922056_1.html: https://www.ivoox.com/salto-radio_fg_f1922056_filtro_1.xml
• Customized by me to remove extra data: https://www.ivoox.com/a_fg_f1922056.xml

[daveajones]

Thanks guys.

@stevencrader Let me look through those and respond.

[cisene]

I've rewritten URL like the customized variant at the bottom, like @stevencrader .. https://www.ivoox.com/_fg_f1922056.xml .. as that is how it was "discovered". Ivoox also dabbles around with different subdomains, www, mx or any TLDcc of spanish speaking countries, I've tried to normalize these before submitting to the Index.

Pattern: https://www.ivoox.com/_fg_f{identity}_filtro_1.xml

Also: When verified and followed, final link submitted to PI

[ThomasUmstattd]

I found a cause of a lot of duplicate feeds in the index. PowerPress has a feature called "Enhance All Feeds" that turns every website RSS feed into a podcast feed. So example.com/feed is a podcast feed, as is example.com/feed/podcast. Unless the site is also a blog, these will have the same episodes.

Example: https://podcastindex.org/podcast/2123998 and https://podcastindex.org/podcast/4430.

PowerPress runs on 40k sites, and since this is the recommended setting, this causes tens of thousands of duplicate entries.

In 99% of cases, "example.com/feed/podcast" is the primary/original feed.

[daveajones]

Will look into this.

[Marzal]

Hi, new broken feed found and some dups

• https://podcastindex.org/podcast/6511950 BAD

  • https://podcastindex.org/podcast/6556582 GOOD
    • But better feed would be https://tube.kockatoo.org/feeds/podcast/videos.xml?videoChannelId=3

• https://podcastindex.org/podcast/6556576 OK

  • But better feed would be https://tube.kockatoo.org/feeds/podcast/videos.xml?videoChannelId=1032

• https://podcastindex.org/podcast/6553330 Original / Source

  • https://podcastindex.org/podcast/6545319 DUP
  • https://podcastindex.org/podcast/6534628 DUP

[stevencrader]

• https://podcastindex.org/podcast/6511950 BAD

  • https://podcastindex.org/podcast/6556582 GOOD

    • But better feed would be https://tube.kockatoo.org/feeds/podcast/videos.xml?videoChannelId=3

I can't replace a Feed URL directly. Instead, I added the desired Feed and marked the others as duplicates. See https://podcastindex.org/podcast/6761187

• https://podcastindex.org/podcast/6556576 OK

  • But better feed would be https://tube.kockatoo.org/feeds/podcast/videos.xml?videoChannelId=1032

Same as above. See https://podcastindex.org/podcast/6761188

• https://podcastindex.org/podcast/6553330 Original / Source

  • https://podcastindex.org/podcast/6545319 DUP
  • https://podcastindex.org/podcast/6534628 DUP

Done

[daveajones]

Instead, I added the desired Feed and marked the others as duplicates.

that’s what I do most of the time too.

[Marzal]

Hi!

• DUP : https://podcastindex.org/podcast/6523766 👎
  • GOOD : https://podcastindex.org/podcast/6518287 👍
    • P20 feed: https://fediverse.tv/feeds/podcast/videos.xml?videoChannelId=18452 👌

Question:

If the usual fix is to delete both entries/items in PI DB and create a new one with the better feed, would the AP actor be lost in case some is following @6518287@ap.podcastindex.org on the Fediverse?

[stevencrader]

That is an interesting question. I'm not sure how @daveajones is handling duplicates and the AP bridge.

[stevencrader]

I merged 6523766 in to 6518287.

The P20 Feed was also added as https://podcastindex.org/podcast/6809087

I've messaged @daveajones about the AP issue but not sure how it will be treated. See https://podcastindex.social/@steven/111910978193046513