TENDER DATA SCRAPER TO CLICKUP API INEGRATION
Website Links: https://mahatenders.gov.in
https://www.eprocure.gov.in/eprocure/app
Integration App: ClickUp
Brief: Develop a web scraping application that can extract tender data from the predetermined
website. The scraped data should be seamlessly integrated and transferred into the ClickUp
project management platform.
Key responsibilities for this job include:
- Developing a web scraping application
- Extracting tender data from specified websites at regular time intervals
- Transferring the scraped data into ClickUp
Data Update Frequency: Daily
Input Option: Organisation Name
Data points for each tender:
1. Organisation Chain
2. Tender Reference Number
3. Tender ID
4. Form Of Contract
5. No. of Covers
6. Tender Fee in ₹
7. EMD Amount in ₹
8. Title
9. Tender Value in ₹
10. Product Category
11. Bid Opening Place
12. Published Date
13. Bid Opening Date
14. Bid Submission Start Date
15. Bid Submission End Date
16. NIT Document (PDF)
17. Name (Tender Inviting Authority)
18. Address (Tender Inviting Authority)
*There should be no duplicate data being uploaded onto clickUp, only the “new” data should
be updated as the previous data will be there already on the ClickUp app and one data point will
be there for days and months on the website.
The data points scraped above to be sent into clickUp via API integration as a task.
ClickUp Task Structure
Data Point Field Type Custom Field Type
Organisation Chain Custom Field Dropdown
Tender Reference Number Custom Field Short Text
Tender ID Custom Field Short Text
Form Of Contract Custom Field Dropdown
No. of Covers Custom Field Number
Tender Fee in ₹ Custom Field Money (₹)
EMD Amount in ₹ Custom Field Money (₹)
Title Task Name Task Name
Tender Value in ₹ Custom Field Money (₹)
Product Category Custom Field Dropdown
Bid Opening Place Custom Field Short Text
Published Date Custom Field Date
Bid Opening Date Custom Field Date
Bid Submission Start Date Custom Field Date
Bid Submission End Date Due Date Due Date
NIT Document Custom Field Attachment
Name Custom Field Long Text
Address Custom Field Long Text
Once the Task is uploaded into ClickUp the responsibility of the Developed app ends.