Request for a proposal

1.

Request for a proposal
LOOKUP SOLUTION
Kredibay Data Engineering, UAE

2.

Solution Overview
1. An API based solution to fetch all the details from a web portal without manual intervention.
2. Kredibay.lookup api should accept a string (company name) as parameter and run a scrapper in the
background and fetch data from a web portal provided in slide 3.
3. Scrapper should be robust and secure enough to cross captcha and should be able to fetch all the
information that shows in manual search.
Expectations from API
1. API should be able to handle around 75000 requests / responses per month as this API will be used
by various financial institutions across UAE.
2. API should be tested thoroughly (load testing and Penetration testing)
Kredibay Data Engineering, UAE

3.

Expected Flow
API
Web Portal
https://ner.economy.ae/Search_By_BN.aspx
Kredibay Data Engineering, UAE

4.

Expectations from Vendor / Solution Provider
1. Since it is a web portal which belongs to Government of UAE, there is a captcha which should be
resolved by the web scrapper script smoothly.
2. What is the technology stack preferable for this requirement?
3. How to handle captcha and cost involved for the same?
4. There are high changes that IP address can be blocked by the web portal due to continuous pings, how
to handle this (proxy servers etc). Suggest which servers and cost involved for the same?
5. Where can API be deployed ? (which cloud provider? And cost involved for the same)
6. How much time ideally it takes to build both API and scrapper solution which is secure and rubust?
Kredibay Data Engineering, UAE

5.

Vendor Notes
Name:
Email:
Kredibay Data Engineering, UAE

6.

Kredibay Engineering
ManKhool,
Bur Dubai,
Dubai,
UAE
[email protected]
[email protected]
Kredibay Data Engineering, UAE