Slow product transfer from Delcampe to website

  • busch_collectibles

    39 messages

    France

    Hello there,

    My delcampe store is linked to my website via the API. I'm noticing that the products put on sale last week are coming up very slowly (currently, every night, my products put on sale from Delcampe on 31/10 are coming to my website, in small numbers).
    Is this problem already known?

    Thanks.
    Best regards,
    busch_collectibles
  • Servitel

    403 messages

    Suisse

    Since yesterday night we experience a very big delay on listing

    On a single Item listing, the id is not available as usual in a few seconds
  • @lco
    Administrateur

    86 messages

    Belgique

    Hello,

    when you send a new item using the API, your call is registered but is not handled immediately if the images have to be downloaded from a remote server.
    In this scenario your new sell is held in a queue that is basically managed first-in, first-out.
    Depending on the load on this queue the download can happen quite immediately or take sometimes hours. The SLA is 24 hours max.

    Only when the download is complete, you'll receive the notification with the new ID.

    Regards,
    Laurent.
  • Servitel

    403 messages

    Suisse

    Hello,

    when you send a new item using the API, your call is registered but is not handled immediately if the images have to be downloaded from a remote server.
    In this scenario your new sell is held in a queue that is basically managed first-in, first-out.
    Depending on the load on this queue the download can happen quite immediately or take sometimes hours. The SLA is 24 hours max.

    Only when the download is complete, you'll receive the notification with the new ID.

    Regards,
    Laurent.
    • Posté le 9 nov. 2023 à 04:04
    • #1628166
    Hi Laurent
    I know the flow but the problem is for every item listed I need two calls:
    one for list the item
    one (or more) for retrieve item id on your site

    Obviously I don't want to teach you but as other services the best scenario is to show the id immediatly after your system receive the list call and show the item on item list at your convenience

    Sometimes my system need 4/5 calls before retrieve the item id. At the end of the day for your system means tons of call for nothing :)

    Regards
    Roberto
  • @lco
    Administrateur

    86 messages

    Belgique

    Hi Roberto,

    the first implementation of this API endpoint was real time, as you would still like it to be, if I understand well your request.

    However this lead to many problems, because we usually hit the maximum allowed quota on the remote server (well the other side also have to protect its infrastructure, especially on low cost providers) and in the end our IP/infrastructure is blacklisted or is voluntary responded slowly.

    Then from your perspective, the API call will appear hung, will timeout, not knowing whether the sell is created or not, and you could have duplicates by retrying.

    That's the reason why we now use a queue for new sales. When it is is empty, your call will be treated within seconds, but not within the call itself.

    Like in every systems, people tends to do the same thing at the same time, and sometimes you have to wait in the line.

    Increasing infrastructure resources is not always a solution, if we hit too hard on remote servers we could be reported as attackers, and banned endlessly, sometimes across multiple organizations (it has happened).

    You have to call multiple times to retrieve the final ID of the sale. This call is, by far, lighter (hundreds of magnitude) than the one which process the images of a new sell.

    That's why it is as it is.

    I hope I have enlighten those reasons .

    Have a good day,

    Laurent.
  • busch_collectibles

    39 messages

    France

    Good morning Laurent,

    During last night (15th to 16th of November), only one product (Delcampe ID 1898017152), I listed on 6th of November was forwarded via the API.

    Is this situation still to be considered as normal under your explanations? Or do I face a problem here?

    Thanks a lot.
    Best regards,
    Benjamin Busch

Rejoignez la communauté des collectionneurs !

S'inscrire Se connecter