May

Various pipeline improvements as well as bug fixes

This month I have focused on continuing to improve the pipeline, improving the stability of checking for updates as well as eliminating some of the last remaining bugs related to Chapters v2 work. Overall I am quite happy with how the month went and makes me a lot more confident in the platform. For all details, check out Changelog:

📋Changelog

New Series Detection

Possibly the most important update this month has been finishing the automatic new series detection. Previously, someone would have to suggest a series for it to appear in my review queue and eventually become available in search, for everyone to add.

Obviously, that was never ideal - it means all of you still have to check scanlator Discord servers or just keep an eye on the site, which I want to completely eliminate from the equation. Instead, I will now detect the moment a new series has been uploaded and add it to the review queue for me to approve.

Currently, that will only happen for scanlator sites - MangaDex, MangaHub and Webtoon still require suggestions every time, as there are just too many series that could be added there in a single day.

New Supported Sites

We've had quite a few sites get removed in the past two months, dropping the number of supported sites from all time high of 30. While I've been focusing on adding Tapas and other official sites, I decided to quickly add a couple of scanlator sites to replace the ones we lost

I plan to add at least 2 more scanlator sites in June, but I am mostly focused on finishing support for Tapas and moving onto more official sites. You can find the list of all sites that I plan to add in the coming months here:

Bug Fixes & Improvements

I've added a lot of improvements, mostly around Data Pipeline to Kenmei this month. Some of the highlights:

  • Improve handling of source redirection drastically

  • Improve and unify updating logic

  • Major upgrade for the payment processing logic

Moreover, I've also tried to fix as many bugs as I could - while many still remain, I've fixed some I considered quite bad, such as:

  • Fix chapters getting out of sync when existing chapter gets overwritten

  • Fix sometimes logging people out before 2 months pass

  • Fix incorrectly assigning chapters to the wrong sources

  • Fix not showing correct error, when trying to mark deleted chapter as read

As always, I will continue to mix up bug fixes with feature work, especially focusing on trying to eliminate all the Chapters v2 bugs. I think major ones are behind us, which makes it possible to start building new functionality on top

📈Progress Overview

As mentioned, this month has been a slow build-up on top of the existing functionality, really solidifying all the work that I've put into the platform in the past 2 years, making me really happy to see it all coming together now.

And as promised, I have started to prototype Discovery functionality, which I've committed to finishing by the end of the year. There is still plenty of data to be fixed before I could even release that functionality, but I am now able to do both at the same time, hence making it my top priority for the coming Summer.

Here's the breakdown of the priorities for the next month:

  1. Kenmei Discovery

  2. Data Pipeline Improvements

  3. Populating missing and/or invalid data

  4. Adding new sources (primarily official sites)

  5. Bug fixing & across the board improvements

Last updated