Zoekopdracht
Afsluiten
  1. Startpagina
  2. Forum
  3. API users
  4. Request limit Risposta 429 Client Error: Too Many Requ
Forumslijst Berichten lijst

Request limit Risposta 429 Client Error: Too Many Requ

  • Stefi58
    Stefi58 100% (604x)

    46 berichten

    Italië

    Hi All

    I've done some time ago a simple script that check periodically the active auction. In the latest day it stops to work due to error 429 Client Error: Too Many Request.

    Has something changed? till a couple of day ago I was able to do also 200 request per minute (and it was already slow) now I can't do more than 60 per minute.

    I don't see the reason of this limitation, the previous limit was low but reasonable to detect a DDoS for a decent system but now it is unreasonable slow in 2024.
  • @lco
    Rekening afgesloten

    94 berichten

    België

    Hello,
    we had to activate a rate limiter yesterday, because of recent abuses from indexing bot that had lead to an overall slowdown on the website.
    This limit applies only for anonymous traffic, 60 requests per minute are allowed with a burst of 120 on the first minute.
    There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    You should use the API to check the status of you item instead of the public URL, your API token will authenticate your traffic and you will bypass this rate limiter.

    Regards,
    Laurent.
  • Stefi58
    Stefi58 100% (604x)

    46 berichten

    Italië

    Hello,
    we had to activate a rate limiter yesterday, because of recent abuses from indexing bot that had lead to an overall slowdown on the website.
    This limit applies only for anonymous traffic, 60 requests per minute are allowed with a burst of 120 on the first minute.
    There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    You should use the API to check the status of you item instead of the public URL, your API token will authenticate your traffic and you will bypass this rate limiter.

    Regards,
    Laurent.
    • Aangemaakt 12 jan 2024 op 04:23
    • #1655798
    Ok, please link to the api document. Are them available for python? Are free to use?
  • @lco
    Rekening afgesloten

    94 berichten

    België

    A club+ gold subscription is required to acces the API: Link (https)

    Then you can ask and use your API access token to fetch your item status without limitation.
    The API documentation: Link (https)
    You are looking for this call: Link (https)
    The example is in PHP but can be easily translated to python:

    import requests
    url = ' Link (https) '
    response = requests.get(url)
    xml_response = response.content

    Regards,
    Laurent.
  • Stefi58
    Stefi58 100% (604x)

    46 berichten

    Italië

    A club+ gold subscription is required to acces the API: Link (https)

    Then you can ask and use your API access token to fetch your item status without limitation.
    The API documentation: Link (https)
    You are looking for this call: Link (https)
    The example is in PHP but can be easily translated to python:

    import requests
    url = ' Link (https) '
    response = requests.get(url)
    xml_response = response.content

    Regards,
    Laurent.
    • Aangemaakt 12 jan 2024 op 04:51
    • #1655828
    So basically the solution proposed to browse and check if there is something new to buy is to pay. :fight3:
  • @lco
    Rekening afgesloten

    94 berichten

    België

    I misunderstood your initial request, as this API forum is dedicated to sellers. The API calls only works for your own items.

    As a buyer, you can register favorites searches and be notified once a day by email.
    If you still poll the website for new objects, you will have to conform to the rate limiter as any other bot.

    Regards,
    Laurent.
  • Stefi58
    Stefi58 100% (604x)

    46 berichten

    Italië

    So even if I'm a goldmember I need also to be a professtional seller :deal: to download API, right? O
  • Stefi58
    Stefi58 100% (604x)

    46 berichten

    Italië

    I misunderstood your initial request, as this API forum is dedicated to sellers. The API calls only works for your own items.

    As a buyer, you can register favorites searches and be notified once a day by email.
    If you still poll the website for new objects, you will have to conform to the rate limiter as any other bot.

    Regards,
    Laurent.
    • Aangemaakt 12 jan 2024 op 05:34
    • #1655855
    Delcampe notification service is almost useless and is nothing comparable to the simple script I've done that scrap and search for the new items added within a timeframe, keep the history of the items already viewed to prevent to see infinite time the same items and opens automatically the links. Time is money also for Delcampe.. if I can check 10k auction or 100k auction automatically in the time that I check 100 auction manually there is more opportunity for Delcampe to get profit by the item sold...

    To sum up, even if I became a goldmember with a professional account I can't use the API to make myself a better interface for delcampe (at least better for my buyer use case).

    During my test I've notice that open a link to an auction seems to consume 2 access ... so when opening a link the rate limite is 30 per minute :whiteflag:

    BTW Thanks Ico for your support, I'm complaining (again) about the Delcampe choices not to your support :)
  • fnwbr
    fnwbr 100% (1x)

    34 berichten

    Duitsland

    Hello,
    we had to activate a rate limiter yesterday, because of recent abuses from indexing bot that had lead to an overall slowdown on the website.
    This limit applies only for anonymous traffic, 60 requests per minute are allowed with a burst of 120 on the first minute.
    There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    You should use the API to check the status of you item instead of the public URL, your API token will authenticate your traffic and you will bypass this rate limiter.

    Regards,
    Laurent.
    • Aangemaakt 12 jan 2024 op 04:23
    • #1655798
    Dear Delcampe team,

    I'd like to report that even when authenticated I'm seeing myself being rate-limited.

    > There is no limitation for authenticated traffic, whether logged on the website or authenticated on the API.

    When calling the `/category` endpoint with a fresh token we're still seeing a `429 Too Many Requests` after two minutes. We're only having troubles with that endpoint specifically, as we're calling this endpoint once a month -- to comply with recent major Delcampe category structure changes.

    Can you please double-check this specific endpoint and confirm that authenticated requests are still un-affected by the new rate limiter?

    There are over 20.000 categories; only allowing for 60 requests / minute would mean that requesting all categories would now take days. Or is there another endpoint which I'm not aware of that returns all existing categories all at once?
  • @lco
    Rekening afgesloten

    94 berichten

    België

    Hello fnwbr,

    you are right, the API endpoint to fetch the categories is not configured to be optionally authenticated, therefore the rate limiter is not aware of user token and falls back to the unauthenticated quota, whether authenticated or not.
    This only applies to this specific endpoint.

    We are deploying a fix this morning.

    Regards,

    Laurent.
  • ansichtskartenpool
    ansichtskartenpool 100% (74326x)
    PRO premium

    34 berichten

    Duitsland

    Hello fnwbr,

    you are right, the API endpoint to fetch the categories is not configured to be optionally authenticated, therefore the rate limiter is not aware of user token and falls back to the unauthenticated quota, whether authenticated or not.
    This only applies to this specific endpoint.

    We are deploying a fix this morning.

    Regards,

    Laurent.
    • Aangemaakt 8 feb 2024 op 04:23
    • #1678009
    Dear @Ico (Laurent),

    but now i am confused. Because we are API users and we get the same message for about a month now when we try listing new items or end items, check anything .... whatever.

    So where is the limitation? pls check

    regards
    Ansichtskartenpool
  • @lco
    Rekening afgesloten

    94 berichten

    België

    Dear @Ico (Laurent),

    but now i am confused. Because we are API users and we get the same message for about a month now when we try listing new items or end items, check anything .... whatever.

    So where is the limitation? pls check

    regards
    Ansichtskartenpool
    • Aangemaakt 8 feb 2024 op 07:34
    • #1678147
    Dear ansichtskartenpool,

    I'm afraid i didn't understand your request. Here is a summary of the various rate limits setup in order to guarantee a constant response time:

    1/ You can create a maximum of 10 000 items per 24 hours
    2/ There is a limit of 60 API requests per minute when you are NOT authenticated
    3/ There is a limit of 180 API requests per minute when you are authenticated with an initial burst of 5000 calls without any limitation

    I hope it will answer your question.

    Regards,
    Laurent.
  • ansichtskartenpool
    ansichtskartenpool 100% (74326x)
    PRO premium

    34 berichten

    Duitsland

    Dear ansichtskartenpool,

    I'm afraid i didn't understand your request. Here is a summary of the various rate limits setup in order to guarantee a constant response time:

    1/ You can create a maximum of 10 000 items per 24 hours
    2/ There is a limit of 60 API requests per minute when you are NOT authenticated
    3/ There is a limit of 180 API requests per minute when you are authenticated with an initial burst of 5000 calls without any limitation

    I hope it will answer your question.

    Regards,
    Laurent.
    • Aangemaakt 8 feb 2024 op 08:25
    • #1678168
    Dear Laurent,

    so, the limitation ist 180 API requests per minute.
    Btw, why should I use the API without an authenticated API-Token.
    That sounds strange to me.
    Authentication should actually be the basic requirement for using an API interface

    Thx, since when was this changed? Where was the information?

    regards
    Ansichtskartenpool
  • @lco
    Rekening afgesloten

    94 berichten

    België

    The documentation has been on Github for two years: Link (https)

    Regards,
    Laurent.

Word lid van de verzamelaars-community!

Registreren Aanmelden