Skip to main content

RateLimiter

Struct RateLimiter 

Source
pub struct RateLimiter { /* private fields */ }
Expand description

A token-bucket rate limiter: it lets at most max_rps calls per second pass, with bursts up to max_rps.

The BCS API limits REST calls per account, about 10 per second for most services and 3 per second for non-trade operations (broker docs). The HTTP client does not throttle on its own. Put one limiter in front of the calls of a service and call RateLimiter::acquire before each call. A limiter is cheap to clone, and clones share the same bucket, so one limiter can guard calls from many tasks.

This limiter is for the protocol layer. It does not know the limits of the broker: you give it the number. The connector crate has its own per-service limits.

§Examples

use brokapi_bcs_protocol::utils::rate_limiter::RateLimiter;

let limiter = RateLimiter::new(10); // 10 calls per second
for _ in 0..3 {
    limiter.acquire().await; // returns at once while the bucket has tokens
    // client.get_order_book(...).await
}

Implementations§

Source§

impl RateLimiter

Source

pub fn new(max_rps: u32) -> Self

Creates a limiter that allows max_rps calls per second. The bucket starts full, so the first max_rps calls pass without waiting.

max_rps must be above 0. With 0 the limiter would wait for a token that never comes, and RateLimiter::acquire would not return.

§Examples
use brokapi_bcs_protocol::utils::rate_limiter::RateLimiter;

let limiter = RateLimiter::new(3);
let _same_bucket = limiter.clone();
Source

pub async fn acquire(&self)

Waits until one call is allowed, then takes a token.

Returns at once if the bucket has a token, otherwise sleeps for the time one token needs to grow back. Tokens grow back at max_rps per second. There is no timeout, and no ordering guarantee between waiting tasks.

§Examples
use brokapi_bcs_protocol::utils::rate_limiter::RateLimiter;
use std::time::{Duration, Instant};

let limiter = RateLimiter::new(100);
let started = Instant::now();
for _ in 0..100 {
    limiter.acquire().await; // a full bucket: no waiting
}
assert!(started.elapsed() < Duration::from_millis(500));

Trait Implementations§

Source§

impl Clone for RateLimiter

Source§

fn clone(&self) -> RateLimiter

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for RateLimiter

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

§

impl<T> PolicyExt for T
where T: ?Sized,

§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] only if self and other return Action::Follow. Read more
§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] if either self or other returns Action::Follow. Read more
§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more