- this spider crawls data from websites to aggregate company info company data from builtInNYC's company page
- debugging is optional
- Export file is configured to export to txt files and transform to a format that is easily understood by a postgres database
- currently it is implemented to crawl builtInNYC's site for its profile page, company name, and company website
- Angelist
- Glassdoor