Recherche
Fermer
  1. Accueil
  2. Forum
  3. API users
  4. Request limit Risposta 429 Client Error: Too Many Requ
Liste des forums Liste des messages

Request limit Risposta 429 Client Error: Too Many Requ

  • Stefi58
    Stefi58 100% (649x)

    46 messages

    Italie

    Hi All

    I've done some time ago a simple script that check periodically the active auction. In the latest day it stops to work due to error 429 Client Error: Too Many Request.

    Has something changed? till a couple of day ago I was able to do also 200 request per minute (and it was already slow) now I can't do more than 60 per minute.

    I don't see the reason of this limitation, the previous limit was low but reasonable to detect a DDoS for a decent system but now it is unreasonable slow in 2024.
  • @lco
    Compte fermé

    94 messages

    Belgique

    Hello,
    we had to activate a rate limiter yesterday, because of recent abuses from indexing bot that had lead to an overall slowdown on the website.
    This limit applies only for anonymous traffic, 60 requests per minute are allowed with a burst of 120 on the first minute.
    There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    You should use the API to check the status of you item instead of the public URL, your API token will authenticate your traffic and you will bypass this rate limiter.

    Regards,
    Laurent.
  • Stefi58
    Stefi58 100% (649x)

    46 messages

    Italie

    Hello,
    we had to activate a rate limiter yesterday, because of recent abuses from indexing bot that had lead to an overall slowdown on the website.
    This limit applies only for anonymous traffic, 60 requests per minute are allowed with a burst of 120 on the first minute.
    There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    You should use the API to check the status of you item instead of the public URL, your API token will authenticate your traffic and you will bypass this rate limiter.

    Regards,
    Laurent.
    • Posté le 12 janv. 2024 à 04:23
    • #1655798
    Ok, please link to the api document. Are them available for python? Are free to use?
  • @lco
    Compte fermé

    94 messages

    Belgique

    A club+ gold subscription is required to acces the API: Lien (https)

    Then you can ask and use your API access token to fetch your item status without limitation.
    The API documentation: Lien (https)
    You are looking for this call: Lien (https)
    The example is in PHP but can be easily translated to python:

    import requests
    url = ' Lien (https) '
    response = requests.get(url)
    xml_response = response.content

    Regards,
    Laurent.
  • Stefi58
    Stefi58 100% (649x)

    46 messages

    Italie

    A club+ gold subscription is required to acces the API: Lien (https)

    Then you can ask and use your API access token to fetch your item status without limitation.
    The API documentation: Lien (https)
    You are looking for this call: Lien (https)
    The example is in PHP but can be easily translated to python:

    import requests
    url = ' Lien (https) '
    response = requests.get(url)
    xml_response = response.content

    Regards,
    Laurent.
    • Posté le 12 janv. 2024 à 04:51
    • #1655828
    So basically the solution proposed to browse and check if there is something new to buy is to pay. :fight3:
  • @lco
    Compte fermé

    94 messages

    Belgique

    I misunderstood your initial request, as this API forum is dedicated to sellers. The API calls only works for your own items.

    As a buyer, you can register favorites searches and be notified once a day by email.
    If you still poll the website for new objects, you will have to conform to the rate limiter as any other bot.

    Regards,
    Laurent.
  • Stefi58
    Stefi58 100% (649x)

    46 messages

    Italie

    So even if I'm a goldmember I need also to be a professtional seller :deal: to download API, right? O
  • Stefi58
    Stefi58 100% (649x)

    46 messages

    Italie

    I misunderstood your initial request, as this API forum is dedicated to sellers. The API calls only works for your own items.

    As a buyer, you can register favorites searches and be notified once a day by email.
    If you still poll the website for new objects, you will have to conform to the rate limiter as any other bot.

    Regards,
    Laurent.
    • Posté le 12 janv. 2024 à 05:34
    • #1655855
    Delcampe notification service is almost useless and is nothing comparable to the simple script I've done that scrap and search for the new items added within a timeframe, keep the history of the items already viewed to prevent to see infinite time the same items and opens automatically the links. Time is money also for Delcampe.. if I can check 10k auction or 100k auction automatically in the time that I check 100 auction manually there is more opportunity for Delcampe to get profit by the item sold...

    To sum up, even if I became a goldmember with a professional account I can't use the API to make myself a better interface for delcampe (at least better for my buyer use case).

    During my test I've notice that open a link to an auction seems to consume 2 access ... so when opening a link the rate limite is 30 per minute :whiteflag:

    BTW Thanks Ico for your support, I'm complaining (again) about the Delcampe choices not to your support :)
  • fnwbr
    Compte fermé

    34 messages

    Allemagne

    Hello,
    we had to activate a rate limiter yesterday, because of recent abuses from indexing bot that had lead to an overall slowdown on the website.
    This limit applies only for anonymous traffic, 60 requests per minute are allowed with a burst of 120 on the first minute.
    There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    You should use the API to check the status of you item instead of the public URL, your API token will authenticate your traffic and you will bypass this rate limiter.

    Regards,
    Laurent.
    • Posté le 12 janv. 2024 à 04:23
    • #1655798
    Dear Delcampe team,

    I'd like to report that even when authenticated I'm seeing myself being rate-limited.

    > There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    When calling the `/category` endpoint with a fresh token we're still seeing a `429 Too Many Requests` after two minutes. We're only having troubles with that endpoint specifically, as we're calling this endpoint once a month -- to comply with recent major Delcampe category structure changes.

    Can you please double-check this specific endpoint and confirm that authenticated requests are still un-affected by the new rate limiter?

    There are over 20.000 categories; only allowing for 60 requests / minute would mean that requesting all categories would now take days. Or is there another endpoint which I'm not aware of that returns all existing categories all at once?
  • @lco
    Compte fermé

    94 messages

    Belgique

    Hello fnwbr,

    you are right, the API endpoint to fetch the categories is not configured to be optionally authenticated, therefore the rate limiter is not aware of user token and falls back to the unauthenticated quota, whether authenticated or not.
    This only applies to this specific endpoint.

    We are deploying a fix this morning.

    Regards,

    Laurent.
  • ansichtskartenpool
    ansichtskartenpool 100% (76409x)
    PRO ultimate

    35 messages

    Allemagne

    Hello fnwbr,

    you are right, the API endpoint to fetch the categories is not configured to be optionally authenticated, therefore the rate limiter is not aware of user token and falls back to the unauthenticated quota, whether authenticated or not.
    This only applies to this specific endpoint.

    We are deploying a fix this morning.

    Regards,

    Laurent.
    • Posté le 8 févr. 2024 à 04:23
    • #1678009
    Dear @Ico (Laurent),

    but now i am confused. Because we are API users and we get the same message for about a month now when we try listing new items or end items, check anything .... whatever.

    So where is the limitation? pls check

    regards
    Ansichtskartenpool
  • @lco
    Compte fermé

    94 messages

    Belgique

    Dear @Ico (Laurent),

    but now i am confused. Because we are API users and we get the same message for about a month now when we try listing new items or end items, check anything .... whatever.

    So where is the limitation? pls check

    regards
    Ansichtskartenpool
    • Posté le 8 févr. 2024 à 07:34
    • #1678147
    Dear ansichtskartenpool,

    I'm afraid i didn't understand your request. Here is a summary of the various rate limits setup in order to guarantee a constant response time:

    1/ You can create a maximum of 10 000 items per 24 hours
    2/ There is a limit of 60 API requests per minute when you are NOT authenticated
    3/ There is a limit of 180 API requests per minute when you are authenticated with an initial burst of 5000 calls without any limitation

    I hope it will answer your question.

    Regards,
    Laurent.
  • ansichtskartenpool
    ansichtskartenpool 100% (76409x)
    PRO ultimate

    35 messages

    Allemagne

    Dear ansichtskartenpool,

    I'm afraid i didn't understand your request. Here is a summary of the various rate limits setup in order to guarantee a constant response time:

    1/ You can create a maximum of 10 000 items per 24 hours
    2/ There is a limit of 60 API requests per minute when you are NOT authenticated
    3/ There is a limit of 180 API requests per minute when you are authenticated with an initial burst of 5000 calls without any limitation

    I hope it will answer your question.

    Regards,
    Laurent.
    • Posté le 8 févr. 2024 à 08:25
    • #1678168
    Dear Laurent,

    so, the limitation ist 180 API requests per minute.
    Btw, why should I use the API without an authenticated API-Token.
    That sounds strange to me.
    Authentication should actually be the basic requirement for using an API interface

    Thx, since when was this changed? Where was the information?

    regards
    Ansichtskartenpool
  • @lco
    Compte fermé

    94 messages

    Belgique

    The documentation has been on Github for two years: Lien (https)

    Regards,
    Laurent.

Rejoignez la communauté des collectionneurs !

S'inscrire Se connecter