Gungho::Component::Throttle::Provider - Throttle Calls To The Provider
components:
- Throttle::Provider
throttle:
provider:
max_requests: 10
This module is still experimental. Use at your own peril.
Often times it is more conveinient to throttle the number of times
the Provider is invoked to fetch the next request than for the provider to
keep tabs of how many requests it has sent so far.
This component keeps track of how many URLs have gone through
send_request() and back to handle_response(), and will prevent
Gungho from calling the provider to fetch the next request.
Averts calling the actual "dispatch_requests"
when there are more requests than specified by
"max_requests" in the system.