Opportunity brief
Responsibilities
- Use web scraping tools/scripts (Python, Selenium, BeautifulSoup, Scrapy, etc.) to extract structured/unstructured data from public websites.
- Maintain, modify, and execute existing scraping scripts and pipelines to ensure fresh and accurate data.
- Clean, normalize, and manage collected data using tools like Pandas, Excel, or SQL.
- Work on data enrichment and deduplication processes to maintain a high-quality database.
- Organize large datasets into readable formats for internal consumption or reporting.
- Store and manage data in Google Sheets, MySQL databases, or other internal data storage platforms.
- Regularly update, validate, and track the performance of scraping tools and suggest optimizations.
- Collaborate with internal teams to understand data needs and deliver relevant insights.